Sonilo Video to Audio

Sonilo Video to Audio — Video-to-Audio (Music & Sound Effects) Model

What is Sonilo Video to Audio?

Sonilo Video to Audio turns a video into a finished soundtrack. Instead of writing a text prompt and hoping the result fits, you pass a video URL and Sonilo reads the footage itself — runtime, pacing, motion, scene changes, transitions, and voice-over space — then generates audio that tracks the edit. A single sound_type switch chooses music, sfx, or music_and_sfx (a combined score plus synced sound effects). Generated audio matches the exact length of your clip and lands on a natural ending rather than an abrupt cut or loop, so it drops straight onto the timeline.

Sonilo is positioned as a professionally licensed, video-native audio model, making it a strong fit for creators and developers who need commercially usable music and sound design without searching stock libraries or manually syncing tracks.

Key Features

• •Video-conditioned generation: the visuals drive the output; text prompts are optional creative direction.
• •Three modes in one endpoint: music, sound effects, or a combined music_and_sfx soundtrack.
• •Length-matched, beat-aware audio with natural endings aligned to cuts and transitions.
• •Frame-accurate SFX — Foley, impacts, ambience, and transition effects placed to on-screen action.
• •Segment controls (music_segments, sfx_segments) for timed prompts across sections.
• •Speech handling via preserve_speech and ducking so narration stays clear in music modes.

Best Use Cases

Score 30-second product ads that lift on the reveal, generate podcast intros, outros, and sponsor beds, follow interval energy on workout and fitness reels, and add cinematic music to drone and wedding footage. In testing, a silent cinematic ocean clip returned a clean, well-leveled stereo soundtrack that layered orchestral music under synced wave and seagull effects — exactly matching the clip length. The music_and_sfx mode is ideal for AI-generated video that otherwise arrives with no usable audio.

Prompt Tips and Output Quality

Start with a finished or near-final cut so timing is accurate. Leave prompts empty to let the video lead, or add a short music_prompt (mood, genre, instruments) and sfx_prompt (on-screen events) to steer style. For dialogue, keep ducking on and enable preserve_speech. Output is production-ready stereo audio delivered as a separate track you can balance in your editor.

How to Use Sonilo Video to Audio

Sonilo Video to Audio generates a fitted soundtrack — music, sound effects, or both — directly from a video. The workflow is simple: host your clip at a public URL, pick a sound_type, and optionally steer the result with short prompts. Because the model reads the footage, timing, pacing, and scene changes are handled for you and the output matches your clip's exact length.

Step-by-step

1. •Provide video_url — a public HTTP(S) link to an MP4 or MOV. Use a finished or near-final cut so the audio aligns to the edit.
2. •Choose sound_type — music for score only, sfx for sound design only, or music_and_sfx for a combined soundtrack.
3. •Add optional direction — music_prompt for mood, genre, and instruments; sfx_prompt for the on-screen events you want emphasized.
4. •Handle dialogue — for talking-head, interview, or narrated clips, enable preserve_speech and keep ducking on so voices stay clear.

Choosing the right settings per use case

• •Ads / product reveals: music_and_sfx; describe the hook and reveal in music_prompt, and impacts or transitions in sfx_prompt.
• •Podcasts / narrated video: music; preserve_speech: true, ducking: true for a clean bed under speech.
• •Workout / social reels: music; prompt an energetic, driving mood.
• •Cinematic B-roll (drone, wedding, nature): music_and_sfx for score plus ambient effects.
• •Section changes: use music_segments (starts ≥ 5s apart) or contiguous sfx_segments (first starts at 0) for timed shifts.

Recommended Settings (tested)

Verified example on a 5-second silent cinematic ocean clip:

• •sound_type: music_and_sfx
• •music_prompt: cinematic emotional orchestral score, warm swelling strings, hopeful and majestic, ocean adventure theme
• •sfx_prompt: ocean waves crashing on rocks, sea spray, distant seagulls, coastal wind

This returned a clean, well-leveled stereo track matched to the clip length, layering the orchestral score under synced wave and seagull effects. Note: output_format is not applied for music_and_sfx (it returns WAV); use it only with music (m4a/wav) or sfx (wav/mp3/aac/flac).

Do I need a text prompt?

No. Prompts are optional; the video is the primary input. Add music_prompt or sfx_prompt only when you want specific direction.

Does the audio match my video length?

Yes. The soundtrack is generated to your clip's exact duration with a natural ending.

Can it make music and sound effects together?

Yes — set sound_type to music_and_sfx for a combined soundtrack.

Will it keep my narration or dialogue?

In music modes, enable preserve_speech and keep ducking on so speech stays audible under the music.

Does it generate video too?

No. Sonilo produces audio only; it does not create or edit footage.

What input format should I use?

Provide a public MP4 or MOV URL; a locked edit gives the best timing.