Gemini Omni 1.2 Flash Reference to Video API

Turn reference images into consistent AI video with audio.

PlaygroundAPI
Pricing
~39.52s
POST /v2/gemini-omni-1.2-flash-reference-to-video · submit + poll
 1# pip install "segmind>=1.1.0"
 2# export SEGMIND_API_KEY="YOUR_API_KEY"
 3from segmind import SegmindClient, InferenceFailed, InferenceTimeout
 4
 5# Async (v2) — recommended for long-running / video models.
 6# run() blocks up to 600s; submit_async + job.wait(timeout=...) sets a longer
 7# deadline and keeps the request_id so you can re-poll later.
 8client = SegmindClient()                      # reads SEGMIND_API_KEY
 9payload = {
10    "reference_images": ["https://segmind-resources.s3.amazonaws.com/input/gemini-omni-1.2-flash-reference-to-video-ref0-e64f3190.jpg", "https://segmind-resources.s3.amazonaws.com/input/gemini-omni-1.2-flash-reference-to-video-ref1-d835922b.jpg"],
11    "prompt": "3D product-feature studio scene, no people, locked-off camera. Place the mint-green portable speaker from <IMAGE_REF_0> on a matte-black rotating podium against a deep-navy backdrop; keep its mint-green body, brass carry-loop, perforated grille and two side buttons exactly. The circular mint-and-brass brand emblem from <IMAGE_REF_1> glows on the wall behind it, unchanged. First the podium turns a quarter rotation while a thin light sweep crosses the speaker. Then a white rounded callout label slides in from the right reading '360 SOUND'. Finally a small white tag pops at the base reading 'IPX7'. Only the podium, the light sweep and the labels move; the backdrop and emblem stay still. Sound: a low studio hum throughout, a short whoosh as each label slides in, a bright synth chime when the 'IPX7' tag appears. Every word spelled exactly as given, no other text.",
12    "duration": 5,
13    "resolution": "720p",
14    "aspect_ratio": "16:9",
15}
16job = client.submit_async("gemini-omni-1.2-flash-reference-to-video", **payload)
17print(job.request_id)                         # available immediately
18try:
19    result = job.wait(timeout=900, interval=2.0)
20    print(result["status"])                  # COMPLETED
21    print(result.get("output"))              # model output (e.g. video URL)
22except InferenceTimeout as e:
23    print("still running:", e.request_id)    # re-poll later with this id
24except InferenceFailed as e:
25    print("failed:", e.detail)
26
27# Fast models (<=600s) can use the one-liner instead:
28# result = segmind.run("gemini-omni-1.2-flash-reference-to-video", **payload)

API Endpoint

POSThttps://api.segmind.com/v1/gemini-omni-1.2-flash-reference-to-video

Parameters

promptrequired
string

Describe the new scene, motion and sound. Bind each reference with <IMAGE_REF_0>, <IMAGE_REF_1>.

Default: "3D product-feature studio scene, no people, locked-off camera. Place the mint-green portable speaker from <IMAGE_REF_0> on a matte-black rotating podium against a deep-navy backdrop; keep its mint-green body, brass carry-loop, perforated grille and two side buttons exactly. The circular mint-and-brass brand emblem from <IMAGE_REF_1> glows on the wall behind it, unchanged. First the podium turns a quarter rotation while a thin light sweep crosses the speaker. Then a white rounded callout label slides in from the right reading '360 SOUND'. Finally a small white tag pops at the base reading 'IPX7'. Only the podium, the light sweep and the labels move; the backdrop and emblem stay still. Sound: a low studio hum throughout, a short whoosh as each label slides in, a bright synth chime when the 'IPX7' tag appears. Every word spelled exactly as given, no other text."
reference_imagesrequired
string[]

1 to 10 reference images carried into the clip. Use crisp, clear stills.

Default: ["https://segmind-resources.s3.amazonaws.com/input/gemini-omni-1.2-flash-reference-to-video-ref0-e64f3190.jpg","https://segmind-resources.s3.amazonaws.com/input/gemini-omni-1.2-flash-reference-to-video-ref1-d835922b.jpg"]
aspect_ratiooptional
string

16:9 landscape or 9:16 vertical. Choose 9:16 for mobile and social.

Default: "16:9"
Allowed values :
"16:9""9:16"
durationoptional
integer

Clip length, 3 to 10 seconds. Short for drafts, longer for full scenes.

Default: 5Range: 3 - 10
resolutionoptional
string

Output size: 360p, 720p, 1080p or 4k. Draft at 360p, raise for finals.

Default: "720p"
Allowed values :
"360p""720p""1080p""4k"
seedoptional
integer

Random seed; -1 randomises. Set a fixed integer to reproduce a result.

Default: -1

Response Type

Returns: Video

Asynchronous requests (v2)

Use Async for video, long-running (>~60s), or high-concurrency workloads; Sync is simplest for fast image & LLM calls. Async submits a request and you poll it to completion.

  1. 1
    POST /v2/gemini-omni-1.2-flash-reference-to-video

    Submit — returns request_id, status_url, response_url

  2. 2
    GET /v2/requests/{id}/status

    Poll — until COMPLETED or FAILED

  3. 3
    GET /v2/requests/{id}

    Result — final response body

Status states

QUEUED— Accepted, waiting for a worker
PROCESSING— Running on a worker
COMPLETED— Done — result body is ready
FAILED— Errored (incl. content/RAI blocks)
  • A FAILED request is served as HTTP 422 — the body still carries the error detail.
  • An unknown or expired request_id returns HTTP 404.
  • Results are retained for 1 hour, then expire.
  • Content / RAI blocks surface as FAILED, not a separate state.
  • Track completion by polling the status endpoint.

Common Error Codes

The API returns standard HTTP status codes. Detailed error messages are provided in the response body.

400

Bad Request

Invalid parameters or request format

401

Unauthorized

Missing or invalid API key

403

Forbidden

Insufficient permissions

404

Not Found

Model or endpoint not found

406

Insufficient Credits

Not enough credits to process request

429

Rate Limited

Too many requests

500

Server Error

Internal server error

502

Bad Gateway

Service temporarily unavailable

504

Timeout

Request timed out