Kling 4.0: text, image, reference and video-edit modes with native audio

Kling 4.0 brings four video modes to Segmind — text-to-video, image-to-video, reference-to-video and video edit. Each renders 3–30 second clips at 720p or 1080p with steadier large-scale motion, from Kling, Kuaishou's video team.

Kling 4.0 is Kuaishou's latest model from the Kling team, and it reaches Segmind as four modes. Kling 4.0 Text to Video builds a clip from a prompt, and Kling 4.0 Image to Video animates a still. Kling 4.0 Reference to Video keeps supplied characters and places consistent, and Kling 4.0 Video Edit rewrites footage you have. Each renders 3–30 second clips at 720p or 1080p with Kling 4.0's steadier large-scale motion; the generative modes add native stereo audio.

What it does well

Kling 4.0 Text to Video

Kling 4.0 Text to Video turns one prompt into a finished clip with its own sound. Name the subject and one action, the camera move that action motivates, then the audio you want. In this run a b-boy's windmill-into-freeze stays coherent through the spin while the camera orbits low, over a synced stereo mix of beat, scuffs and breath.

ModelKling 4.0 Text to Video3-30s text-to-video with native stereo audio and stable motion.
Text to video: a b-boy's windmill-into-freeze with an orbiting camera and native stereo sound.

Kling 4.0 Image to Video

Kling 4.0 Image to Video animates a single still into a moving clip. Start from a sharp frame whose subject already implies motion, and describe what moves rather than the scene the frame shows. Here a frozen breakdancer powers into a full windmill while the camera orbits low and the clip generates its own scuffs and open-air ambience.

ModelKling 4.0 Image to VideoAnimate images into 3-30s 1080p video with native audio.
Image to video: a still breakdancer animates into a stable windmill with native audio.

Kling 4.0 Reference to Video

Kling 4.0 Reference to Video builds a new scene around assets you supply and keeps them recognisable. Hand it up to 10 images and 5 videos, and name each one in the prompt as @Image1 or @Video1. Give each a role to hold — a face, a product, a place or a camera move. Here a referenced dancer and a referenced glass-tower plaza both stay consistent through a fast windmill as the camera orbits.

ModelKling 4.0 Reference to VideoKeep characters and products consistent across reference-driven videos.
Reference to video: a referenced dancer and plaza held consistent through an orbiting windmill shot.

Kling 4.0 Video Edit

Kling 4.0 Video Edit rewrites a clip you already have from a text instruction. Lead with the change — a new look, weather, time of day or material — then name what must stay recognisable. Here a sunlit midday plaza becomes a dark daytime thunderstorm while the breakdancer's windmill and the locked camera framing stay identical.

ModelKling 4.0 Video EditEdit and restyle any video from a text prompt.
Video edit: a sunlit plaza restyled into a thunderstorm while the spin and framing hold.

Examples to try

Each example below ran end to end at the settings shown and came back as a finished clip. Clicking a card drops its prompt and settings back into the form.

More text-to-video shots

Spoken dialogue with lip-sync (9:16)for Kling 4.0 Text to Video
A marine biologist in a blue lab coat holds up a glass jar of glowing bioluminescent plankton and turns it toward the lens, grinning. The camera stays in a tight head-and-shoulders frame as she leans in. Cool blue light from the jar lights her face against a dark aquarium lab. She says, clearly: "Watch what happens when I shake it - the whole jar lights up." Sound: her bright voice close to the mic, a low filtration hum, and water bubbling in tanks behind her.
Try it

The marine biologist speaks her English line in sync while the jar lights up on cue, her voice foregrounded in stereo. Write the spoken line in quotes and keep the frame tight so the words land.

Long single-pass take (21:9)for Kling 4.0 Text to Video
A single unbroken shot travels alongside a green combine harvester as it cuts a wide swath through a field of ripe wheat, the rotating reel pulling in stalks and a jet of golden grain arcing into a trailer running beside it. The camera tracks level with the header, then rises on a crane move to look down the uncut rows ahead. Hazy afternoon dust hangs in the air. Sound: the deep diesel engine, the thresher's steady roar, grain hissing into the trailer, and dry stalks crackling.
Try it

One unbroken 10-second take tracks a combine harvester and rises on a crane move with no cut. Raise the duration and name one sustained camera move.

Multilingual dialogue and on-screen text (1:1)for Kling 4.0 Text to Video
A 1930s radio announcer in a pinstripe suit leans toward a chrome ribbon microphone and reads the evening news, one hand pressing a headphone to his ear. The camera pushes in from a medium shot to a close-up as he speaks. Behind him a lit glass "EN DIRECT" lamp and a painted "RADIO PARIS" placard stay sharp and readable through the move. Tungsten desk-lamp light. He says in French: "Mesdames et messieurs, voici les nouvelles de ce soir." Sound: his resonant French voice, the room's close reverb, and a faint electrical hum from the valve equipment.
Try it

The RADIO PARIS and EN DIRECT signs stay readable as the camera pushes in while the announcer reads a French line. Spell the exact on-screen words and name the spoken language.

More image-to-video shots

First-and-last-frame controlfor Kling 4.0 Image to Video
The closed bud splits and unfurls into a full open bloom, petals curling outward layer by layer, a water droplet trembling then sliding off a petal edge; the camera eases in a touch on the opening flower. A faint rustle of petals and quiet room tone.
Try it

With a last frame supplied, the clip opens on the closed bud and resolves exactly onto the open bloom, animating the transition between. Give both frames the same subject, framing and light.

Spoken dialogue with lip-syncfor Kling 4.0 Image to Video
The baker glances up from the loaves, breaks into a grin and says in English, 'Fresh out of the oven, come and try one.' The camera holds a tight head-and-shoulders shot as he gestures to the bread. His voice sits forward in clean stereo over the hum of the oven and the crackle of cooling crust.
Try it

The baker looks up and speaks his English line with matching mouth movement, his voice forward in stereo over oven ambience. Use a sharp frontal portrait and quote the exact words.

Long single-pass take (10s, 720p)for Kling 4.0 Image to Video
Dust drifts in the shafts of light as a steady forward dolly travels the length of the hall, carved shelves and arched ribs sliding past on both sides, the red runner unrolling toward a bright window at the far end, one continuous unbroken take. Quiet library ambience, faint creak of old wood.
Try it

A single 10-second forward dolly travels the length of the hall and reveals the far window, with structure holding the whole way. Raise the duration and name one continuous camera move.

More reference-to-video shots

Product and fashion consistency (9:16)for Kling 4.0 Reference to Video
@Image1 defines the model and her wax-print maxi dress; preserve the dress's bold orange-and-indigo geometric print and its exact cut. @Image2 defines the setting — a bare poured-concrete gallery. The model turns once on the spot so the skirt flares, then faces the camera; the camera pushes in from a full shot to the waist. Even overhead gallery light. Sound: quiet room tone and the soft rustle of fabric. Keep the dress's print and colours identical to @Image1 through the turn; add no other people or text.
Try it

The dress's orange-and-indigo print and cut stay identical as the model turns and the camera pushes in. Put the garment on @Image1 and the setting on @Image2.

A reference video drives the camera (16:9)for Kling 4.0 Reference to Video
Reference the camera path and pacing of @Video1 — a steady orbit around a central object. @Image1 defines the desk fan; preserve its exact shape, cobalt-blue blades, brass cage and cream enamel base. Stand the fan at the centre of a seamless pale-grey studio backdrop. The camera orbits the fan exactly as in @Video1 while the fan's blades spin and its head turns side to side. Sound: the low mechanical whir of the fan motor and the rush of moving air. Keep the fan identical to @Image1; add no text or extra objects.
Try it

The desk fan keeps its cobalt housing, brass cage and cream base while the camera borrows @Video1's orbit and the blades spin. Give @Video1 the camera move and @Image1 the product to hold.

Lip-synced dialogue from a referenced character (16:9)for Kling 4.0 Reference to Video
@Image1 defines the marine biologist; preserve her face, dark ponytail and blue lab coat. @Image2 defines the glass jar of glowing blue plankton; preserve it. She holds the jar at chest height, well below her chin so her whole face and mouth stay visible, looks straight into the lens and says in English, clearly: "Watch what happens when I shake it — the whole jar lights up." Medium shot in a dark aquarium lab, the jar's blue glow lighting her face from below. Sound: her bright voice close to the microphone and the faint bubbling of tanks behind her. Keep her face and coat matching @Image1 and keep her mouth visible; do not raise the jar in front of her mouth.
Try it

The marine biologist's face and coat stay consistent while her mouth tracks the English line and the jar glows. Write the line in quotes and keep the jar below her chin.

More video-edit shots

Artistic style restylefor Kling 4.0 Video Edit
Redraw the clip as a hand-drawn graphite pencil and charcoal sketch on textured off-white sketchbook paper: bold cross-hatching, loose construction lines, visible smudges and eraser marks, the whole frame monochrome grey on paper. Keep the breakdancer's windmill spin, his limbs and the locked camera framing exactly as in the source.
Try it

Every frame is redrawn as a cross-hatched graphite and charcoal sketch on paper, the windmill and framing unmistakable. Name the medium and the surface, and expect a monochrome result.

Material swapfor Kling 4.0 Video Edit
Gild the entire scene in polished reflective gold: the stone plaza, the paving, the glass office towers and the breakdancer all become gleaming solid gold with bright specular highlights and sharp cast shadows. Keep the breakdancer's windmill spin, his limbs and the locked camera framing exactly as in the source.
Try it

The paving, towers and dancer all turn to polished reflective gold with mirror highlights, the spin intact. Name the material plainly and review faces and hands.

Insert a reference assetfor Kling 4.0 Video Edit
@Image1: a giant cherry-red high-top sneaker sculpture. Place the sneaker sculpture from @Image1 upright on the plaza a few metres behind the breakdancer, scaled two storeys tall. Keep the breakdancer's windmill spin, his limbs, the hard midday light and the locked camera framing exactly as in the source.
Try it

A building-tall cherry-red sneaker from @Image1 stands on the plaza behind the dancer while the windmill continues. Name the reference role, and say where the asset goes and how big.

Recommended settings

SettingValueWhen
promptSubject + one action + camera move + sound, in one blockRequired for text, reference and edit modes; optional but it sharpens image to video
duration5 s (default), up to 30 s5 s for a single action beat; raise toward 10–30 s for dialogue or a multi-beat story
resolution1080p (default) or 720p1080p for hero and final clips; 720p for faster drafts
aspect_ratio16:9, 9:16, 1:1, 21:9; adaptive on reference and editSet it explicitly; image to video has no aspect setting and follows the input frame
inputfirst_frame_image, reference_images / reference_videos, or videoA sharp first frame for image to video; role-tagged references for reference to video; the source clip for video edit

Good to know

  • A prompt is an instruction, not a frame-by-frame contract, so keep one clear action per shot; dense sequences and competing camera directions are harder to honor.
  • Every mode can add or change details you did not ask for, and faces, hands, text and logos drift most on fast motion, so review each clip before you publish.
  • References guide the result but do not guarantee pixel-exact identity, and consistency slips when a single shot asks for too much at once.
  • Check the inputs: image to video needs a frame of at least 300×300 px, reference to video needs one reference or more, and video edit needs an MP4 or MOV of 3–30 s. Output caps at 1080p here; the announced 4K and 10-bit HDR are not exposed.

Use it from the API

Send a POST with the input each mode needs — a prompt, a first frame, references or a source video — and the response returns the finished clip. These are the four default examples:

APIText to videoAPI reference
# pip install "segmind>=1.1.0"
# export SEGMIND_API_KEY="YOUR_API_KEY"
import segmind

result = segmind.run(
    "kling-4-text-to-video",
    aspect_ratio="16:9",
    duration=5,
    prompt="A b-boy spins into an explosive windmill on a concrete plaza, legs scissoring overhead, then snaps into a one-handed freeze. The camera orbits him low and fast, keeping pace with the rotation. Hard midday light throws a sharp shadow across the pavement. Sound: a thumping hip-hop beat, sneaker scuffs on concrete, and his sharp exhale as he hits the freeze.",
    resolution="1080p",
)
print(result.get("output"))
# 1. Submit the request; the reply carries its request_id
REQUEST_ID=$(curl -s -X POST "https://api.segmind.com/v2/kling-4-text-to-video" \
  -H "x-api-key: YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "aspect_ratio": "16:9",
  "duration": 5,
  "prompt": "A b-boy spins into an explosive windmill on a concrete plaza, legs scissoring overhead, then snaps into a one-handed freeze. The camera orbits him low and fast, keeping pace with the rotation. Hard midday light throws a sharp shadow across the pavement. Sound: a thumping hip-hop beat, sneaker scuffs on concrete, and his sharp exhale as he hits the freeze.",
  "resolution": "1080p"
}' | jq -r .request_id)

# 2. Check its status until it is COMPLETED
curl -s "https://api.segmind.com/v2/requests/$REQUEST_ID/status" \
  -H "x-api-key: YOUR_API_KEY"

# 3. Fetch the result
curl -s "https://api.segmind.com/v2/requests/$REQUEST_ID" \
  -H "x-api-key: YOUR_API_KEY"
APIImage to videoAPI reference
# pip install "segmind>=1.1.0"
# export SEGMIND_API_KEY="YOUR_API_KEY"
import segmind

result = segmind.run(
    "kling-4-image-to-video",
    duration=5,
    first_frame_image="https://segmind-resources.s3.amazonaws.com/input/kling-4-image-to-video-firstframe.jpg",
    prompt="The breakdancer powers into a continuous windmill: his legs scissor in fast wide circles as his body spins flat across the paving stones, one hand then the other slapping down to keep the rotation going. The camera orbits low around him and keeps pace with the spin, hard midday light sweeping his sharp shadow across the ground. Scuffing sneakers, slapping palms and open-air city ambience.",
    resolution="1080p",
)
print(result.get("output"))
# 1. Submit the request; the reply carries its request_id
REQUEST_ID=$(curl -s -X POST "https://api.segmind.com/v2/kling-4-image-to-video" \
  -H "x-api-key: YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "duration": 5,
  "first_frame_image": "https://segmind-resources.s3.amazonaws.com/input/kling-4-image-to-video-firstframe.jpg",
  "prompt": "The breakdancer powers into a continuous windmill: his legs scissor in fast wide circles as his body spins flat across the paving stones, one hand then the other slapping down to keep the rotation going. The camera orbits low around him and keeps pace with the spin, hard midday light sweeping his sharp shadow across the ground. Scuffing sneakers, slapping palms and open-air city ambience.",
  "resolution": "1080p"
}' | jq -r .request_id)

# 2. Check its status until it is COMPLETED
curl -s "https://api.segmind.com/v2/requests/$REQUEST_ID/status" \
  -H "x-api-key: YOUR_API_KEY"

# 3. Fetch the result
curl -s "https://api.segmind.com/v2/requests/$REQUEST_ID" \
  -H "x-api-key: YOUR_API_KEY"
APIReference to videoAPI reference
# pip install "segmind>=1.1.0"
# export SEGMIND_API_KEY="YOUR_API_KEY"
import segmind

result = segmind.run(
    "kling-4-reference-to-video",
    aspect_ratio="16:9",
    duration=5,
    prompt="@Image1 is the breakdancer: keep his face, crimson track jacket with white sleeve stripes, yellow bandana, black cargo pants and white high-top sneakers with red laces exactly as in the reference. @Image2 is the setting: keep this sunlit plaza of blue-glass office towers with hard midday shadows on the pale stone. The breakdancer drops to the pavement and performs a fast windmill: his body spins flat and continuous over the stone, legs scissoring open in the air, hands pushing off the ground between rotations. The camera orbits low around him, the glass towers held steady behind. Hard overhead sunlight throws sharp shadows that sweep across the pavement as he turns. Single continuous shot. Sound: open-air city ambience with the scuff and whoosh of his spin on the stone. Do not change his outfit, do not change the plaza buildings, do not add other people, captions or logos.",
    reference_images=[
        "https://segmind-resources.s3.amazonaws.com/input/kling-4-ref-image1-dancer.jpg",
        "https://segmind-resources.s3.amazonaws.com/input/kling-4-ref-image2-plaza.jpg",
    ],
    resolution="1080p",
)
print(result.get("output"))
# 1. Submit the request; the reply carries its request_id
REQUEST_ID=$(curl -s -X POST "https://api.segmind.com/v2/kling-4-reference-to-video" \
  -H "x-api-key: YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "aspect_ratio": "16:9",
  "duration": 5,
  "prompt": "@Image1 is the breakdancer: keep his face, crimson track jacket with white sleeve stripes, yellow bandana, black cargo pants and white high-top sneakers with red laces exactly as in the reference. @Image2 is the setting: keep this sunlit plaza of blue-glass office towers with hard midday shadows on the pale stone. The breakdancer drops to the pavement and performs a fast windmill: his body spins flat and continuous over the stone, legs scissoring open in the air, hands pushing off the ground between rotations. The camera orbits low around him, the glass towers held steady behind. Hard overhead sunlight throws sharp shadows that sweep across the pavement as he turns. Single continuous shot. Sound: open-air city ambience with the scuff and whoosh of his spin on the stone. Do not change his outfit, do not change the plaza buildings, do not add other people, captions or logos.",
  "reference_images": [
    "https://segmind-resources.s3.amazonaws.com/input/kling-4-ref-image1-dancer.jpg",
    "https://segmind-resources.s3.amazonaws.com/input/kling-4-ref-image2-plaza.jpg"
  ],
  "resolution": "1080p"
}' | jq -r .request_id)

# 2. Check its status until it is COMPLETED
curl -s "https://api.segmind.com/v2/requests/$REQUEST_ID/status" \
  -H "x-api-key: YOUR_API_KEY"

# 3. Fetch the result
curl -s "https://api.segmind.com/v2/requests/$REQUEST_ID" \
  -H "x-api-key: YOUR_API_KEY"
APIVideo editAPI reference
# pip install "segmind>=1.1.0"
# export SEGMIND_API_KEY="YOUR_API_KEY"
import segmind

result = segmind.run(
    "kling-4-video-edit",
    aspect_ratio="adaptive",
    duration=5,
    prompt="Transform the scene into a violent daytime thunderstorm: towering slate-grey storm clouds roll over the plaza, heavy rain falls in sheets, a sharp lightning flash lights the glass towers, and the pale paving turns to a wet mirror with splashing puddles. Keep the breakdancer's windmill spin, his limbs and the locked camera framing exactly as in the source.",
    resolution="720p",
    video="https://segmind-resources.s3.amazonaws.com/input/kling-4-video-edit-source-e880568e.mp4",
)
print(result.get("output"))
# 1. Submit the request; the reply carries its request_id
REQUEST_ID=$(curl -s -X POST "https://api.segmind.com/v2/kling-4-video-edit" \
  -H "x-api-key: YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "aspect_ratio": "adaptive",
  "duration": 5,
  "prompt": "Transform the scene into a violent daytime thunderstorm: towering slate-grey storm clouds roll over the plaza, heavy rain falls in sheets, a sharp lightning flash lights the glass towers, and the pale paving turns to a wet mirror with splashing puddles. Keep the breakdancer'\''s windmill spin, his limbs and the locked camera framing exactly as in the source.",
  "resolution": "720p",
  "video": "https://segmind-resources.s3.amazonaws.com/input/kling-4-video-edit-source-e880568e.mp4"
}' | jq -r .request_id)

# 2. Check its status until it is COMPLETED
curl -s "https://api.segmind.com/v2/requests/$REQUEST_ID/status" \
  -H "x-api-key: YOUR_API_KEY"

# 3. Fetch the result
curl -s "https://api.segmind.com/v2/requests/$REQUEST_ID" \
  -H "x-api-key: YOUR_API_KEY"

Resources

  • #kling
  • #text-to-video
  • #image-to-video
  • #video-to-video
  • #model-launch
AM

Abhilash Mirji

@abhilashmirji

Developer @ Segmind

View profile

Posts

More from Abhilash Mirji

Make your own with Segmind

Run every model and Pixelflow in this post, and build your own workflows.

Start creating