Sonilo Video to Audio Serverless API
Generate video-synced music and sound effects from footage.
POST /v2/sonilo-video-to-audio · submit + poll 1# pip install "segmind>=1.1.0"
2# export SEGMIND_API_KEY="YOUR_API_KEY"
3from segmind import SegmindClient, InferenceFailed, InferenceTimeout
4
5# Async (v2) — recommended for long-running / video models.
6# run() blocks up to 600s; submit_async + job.wait(timeout=...) sets a longer
7# deadline and keeps the request_id so you can re-poll later.
8client = SegmindClient() # reads SEGMIND_API_KEY
9payload = {
10 "video_url": "https://segmind-resources.s3.amazonaws.com/input/sonilo-video-to-audio-src.mp4",
11 "sound_type": "music_and_sfx",
12 "music_prompt": "cinematic emotional orchestral score, warm swelling strings, hopeful and majestic, ocean adventure theme",
13 "sfx_prompt": "ocean waves crashing on rocks, sea spray, distant seagulls, coastal wind",
14}
15job = client.submit_async("sonilo-video-to-audio", **payload)
16print(job.request_id) # available immediately
17try:
18 result = job.wait(timeout=900, interval=2.0)
19 print(result["status"]) # COMPLETED
20 print(result.get("output")) # model output (e.g. video URL)
21except InferenceTimeout as e:
22 print("still running:", e.request_id) # re-poll later with this id
23except InferenceFailed as e:
24 print("failed:", e.detail)
25
26# Fast models (<=600s) can use the one-liner instead:
27# result = segmind.run("sonilo-video-to-audio", **payload) 1# pip install "segmind>=1.1.0"
2# export SEGMIND_API_KEY="YOUR_API_KEY"
3from segmind import SegmindClient, InferenceFailed, InferenceTimeout
4
5# Async (v2) — recommended for long-running / video models.
6# run() blocks up to 600s; submit_async + job.wait(timeout=...) sets a longer
7# deadline and keeps the request_id so you can re-poll later.
8client = SegmindClient() # reads SEGMIND_API_KEY
9payload = {
10 "video_url": "https://segmind-resources.s3.amazonaws.com/input/sonilo-video-to-audio-src.mp4",
11 "sound_type": "music_and_sfx",
12 "music_prompt": "cinematic emotional orchestral score, warm swelling strings, hopeful and majestic, ocean adventure theme",
13 "sfx_prompt": "ocean waves crashing on rocks, sea spray, distant seagulls, coastal wind",
14}
15job = client.submit_async("sonilo-video-to-audio", **payload)
16print(job.request_id) # available immediately
17try:
18 result = job.wait(timeout=900, interval=2.0)
19 print(result["status"]) # COMPLETED
20 print(result.get("output")) # model output (e.g. video URL)
21except InferenceTimeout as e:
22 print("still running:", e.request_id) # re-poll later with this id
23except InferenceFailed as e:
24 print("failed:", e.detail)
25
26# Fast models (<=600s) can use the one-liner instead:
27# result = segmind.run("sonilo-video-to-audio", **payload)API Endpoint
https://api.segmind.com/v1/sonilo-video-to-audioParameters
video_urlrequiredstring (uri)Public HTTP(S) URL of the source video.
duckingoptionalbooleanLower the music under speech. Music modes only.
truemusic_promptoptionalstringGuides the generated music. Used when sound_type is music or music_and_sfx.
music_segmentsoptionalobject[]Timed music prompts (music only). Starts must be >= 5s apart.
startrequirednumberpromptrequiredstringoutput_formatoptionalstringmusic: m4a or wav. sfx: wav, mp3, aac or flac. Not supported for music_and_sfx.
"m4a""wav""mp3""aac""flac"preserve_speechoptionalbooleanKeep speech from the source video. Music modes only.
falsesfx_promptoptionalstringGuides the generated sound effects. Used when sound_type is sfx or music_and_sfx.
sfx_segmentsoptionalobject[]Contiguous timed SFX prompts (sfx or music_and_sfx). First must start at 0.
startrequirednumberendrequirednumberpromptrequiredstringsound_typeoptionalstringWhich soundtrack to generate.
"music""music""sfx""music_and_sfx"Response Type
Returns: Video
Asynchronous requests (v2)
Use Async for video, long-running (>~60s), or high-concurrency workloads; Sync is simplest for fast image & LLM calls. Async submits a request and you poll it to completion.
- 1
POST /v2/sonilo-video-to-audioSubmit — returns request_id, status_url, response_url
- 2
GET /v2/requests/{id}/statusPoll — until COMPLETED or FAILED
- 3
GET /v2/requests/{id}Result — final response body
Status states
- A FAILED request is served as HTTP 422 — the body still carries the error detail.
- An unknown or expired request_id returns HTTP 404.
- Results are retained for 1 hour, then expire.
- Content / RAI blocks surface as FAILED, not a separate state.
- Track completion by polling the status endpoint.
Common Error Codes
The API returns standard HTTP status codes. Detailed error messages are provided in the response body.
Bad Request
Invalid parameters or request format
Unauthorized
Missing or invalid API key
Forbidden
Insufficient permissions
Not Found
Model or endpoint not found
Insufficient Credits
Not enough credits to process request
Rate Limited
Too many requests
Server Error
Internal server error
Bad Gateway
Service temporarily unavailable
Timeout
Request timed out