Video to Audio API — Generate Sound for Silent Video

What is a Video to Audio API?

A video-to-audio API takes a silent video clip and generates a soundtrack that matches what is happening on screen — footsteps, wind, machinery, ambience, or other foley — guided by a text prompt rather than a manual sound-design pass.

Muapi exposes MMAudio Video to Audio for that workflow, plus MMAudio Text to Audio for generating a standalone sound effect or ambient clip without video input. Both use the same submit-and-poll REST pattern used across the platform and bill by the duration of the generated audio.

Key Capabilities

Video to Audio Model Comparison

How to Generate Audio for Video via API

1. Pick a model. Use Video to Audio when you have a silent clip to score, or Text to Audio for a standalone sound effect.
2. Write a prompt. Describe the sound you want, such as heavy rain on a tin roof with distant thunder.
3. Submit the request. Call POST /api/v1/mmaudio-v2/video-to-video with prompt, video_url, and optional duration. Text to Audio uses /api/v1/mmaudio-v2/text-to-audio without video_url.
4. Poll for completion. Check GET /api/v1/predictions/{request_id}/result until status is completed, then download the audio.
5. Mux into your video. Combine the generated audio track with your original silent clip in your editing pipeline.

curl -X POST https://api.muapi.ai/api/v1/mmaudio-v2/video-to-video \
  -H "Content-Type: application/json" \
  -H "x-api-key: YOUR_API_KEY" \
  -d '{
    "prompt": "Heavy rain on a tin roof with distant thunder",
    "video_url": "https://example.com/silent-video.mp4",
    "duration": 8
  }'

import requests

response = requests.post(
    "https://api.muapi.ai/api/v1/mmaudio-v2/video-to-video",
    headers={"x-api-key": "YOUR_API_KEY"},
    json={
        "prompt": "Heavy rain on a tin roof with distant thunder",
        "video_url": "https://example.com/silent-video.mp4",
        "duration": 8,
    },
)
request_id = response.json()["request_id"]

result = requests.get(
    f"https://api.muapi.ai/api/v1/predictions/{request_id}/result",
    headers={"x-api-key": "YOUR_API_KEY"},
)
print(result.json())

Frequently Asked Questions