# volcengine-video-to-video-lip-sync

> Drive a video's lip movements to match a target audio track, producing a lip-synced video output.

## Overview

- **Endpoint**: `POST https://api.muapi.ai/api/v1/volcengine-video-to-video-lip-sync`
- **Model ID**: `volcengine-video-to-video-lip-sync`
- **Category**: video to video
- **Variant**: Volcengine Video Lip Sync
- **Family**: volcengine-lipsync
- **Cost**: 0.1 credits per call (some models compute cost dynamically based on params)

## API Usage

MuApi uses a **submit-then-poll** pattern: submit a job, get a `request_id`, then poll the predictions endpoint until `status` is `completed`. Optionally pass `?webhook=YOUR_URL` on the submit call to receive a POST callback when the job finishes (skip polling).

**Authentication**: send your MuApi key in the `x-api-key` header. Get one at https://muapi.ai/access-keys.

### 1. Submit a job

```http
POST https://api.muapi.ai/api/v1/volcengine-video-to-video-lip-sync
Content-Type: application/json
x-api-key: YOUR_API_KEY
```

**Minimum (required only):**

```json
{
  "mode": "lite",
  "video_url": "https://example.com/your-video_url",
  "audio_url": "https://example.com/your-audio_url"
}
```

**Full example (all params):**

```json
{
  "mode": "lite",
  "audio_url": "https://example.com/your-audio_url",
  "video_url": "https://example.com/your-video_url",
  "align_audio": true,
  "open_scenedet": false,
  "separate_vocal": false,
  "align_audio_reverse": false,
  "templ_start_seconds": 0
}
```

**Response:**

```json
{
  "request_id": "abc123",
  "status": "processing"
}
```

### 2. Poll for the result

```http
GET https://api.muapi.ai/api/v1/predictions/{request_id}/result
x-api-key: YOUR_API_KEY
```

Possible `status` values: `queued`, `pending`, `processing`, `completed`, `failed`, `cancelled`. Poll every 2-5 seconds until terminal. When `completed`, the result URLs are in the `outputs` array.

**Example response when `completed`:**

```json
{
  "id": "abc123",
  "status": "completed",
  "outputs": [
    "https://cdn.muapi.ai/.../output.png"
  ],
  "urls": {
    "get": "https://api.muapi.ai/api/v1/predictions/abc123/result"
  },
  "created_at": "2026-05-08T12:34:56Z",
  "has_nsfw_contents": []
}
```

### cURL

```bash
# 1. Submit
REQUEST_ID=$(curl -s -X POST https://api.muapi.ai/api/v1/volcengine-video-to-video-lip-sync \
  -H "x-api-key: $MUAPI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"mode":"lite","video_url":"https://example.com/your-video_url","audio_url":"https://example.com/your-audio_url"}' | jq -r .request_id)

# 2. Poll until completed
while :; do
  RESP=$(curl -s https://api.muapi.ai/api/v1/predictions/$REQUEST_ID/result -H "x-api-key: $MUAPI_API_KEY")
  STATUS=$(echo "$RESP" | jq -r .status)
  [ "$STATUS" = "completed" ] && echo "$RESP" | jq .outputs && break
  [ "$STATUS" = "failed" ] && echo "$RESP" && exit 1
  sleep 3
done
```

### Python

```python
import os, time, requests

API = "https://api.muapi.ai/api/v1"
headers = {"x-api-key": os.environ["MUAPI_API_KEY"]}

r = requests.post(f"{API}/volcengine-video-to-video-lip-sync", headers=headers, json={"mode":"lite","video_url":"https://example.com/your-video_url","audio_url":"https://example.com/your-audio_url"})
request_id = r.json()["request_id"]

while True:
    res = requests.get(f"{API}/predictions/{request_id}/result", headers=headers).json()
    if res["status"] == "completed":
        print(res["outputs"]); break
    if res["status"] == "failed":
        raise RuntimeError(res.get("error")); 
    time.sleep(3)
```

## Input Schema

The API accepts the following input parameters:

- **`mode`** (`string`, _required_):
  Service mode. 'lite' is for single-person frontal videos with faster processing. 'basic' is for single-person complex scenes, supporting scene segmentation and speaker identification.
  - Default: `"lite"`
  - Options: `"lite"`, `"basic"`

- **`audio_url`** (`string`, _required_):
  Target pure vocal audio URL used to drive the video's lip movements. Max file size: 10MB.

- **`video_url`** (`string`, _required_):
  Video URL. Supported resolution: 360p-1080p. Videos above 1080p are compressed to 1080p; below 360p is not supported. Supported formats: MOV, MP4, HDR. Max file size: 500MB.

- **`align_audio`** (`boolean`, _optional_):
  Supported in Lite mode. Whether to loop the video when the audio is longer than the video.
  - Default: `true`

- **`open_scenedet`** (`boolean`, _optional_):
  Enable scene segmentation and speaker identification. Only supported in Basic mode.
  - Default: `false`

- **`separate_vocal`** (`boolean`, _optional_):
  Enable vocal separation to suppress background noise.
  - Default: `false`

- **`align_audio_reverse`** (`boolean`, _optional_):
  Supported in Lite mode. Whether to loop the video in reverse (backward). Requires align_audio to be true.
  - Default: `false`

- **`templ_start_seconds`** (`int`, _optional_):
  Supported in Lite mode. Start time of the template video, in seconds.
  - Default: `0`

## Output Schema

The polling endpoint returns the following fields:

- **`id`** (`string`): The request ID.
- **`status`** (`string`): One of `queued`, `pending`, `processing`, `completed`, `failed`, `cancelled`.
- **`outputs`** (`array`): URLs to generated images/videos/audio. Empty until `status` is `completed`.
- **`urls.get`** (`string`): Self-link to re-fetch this prediction.
- **`error`** (`string` | `null`): Error message if `status` is `failed`.
- **`created_at`** (`string`): ISO-8601 timestamp of when the request was created.
- **`has_nsfw_contents`** (`array of boolean`): Per-output NSFW detection flags.

## Webhooks (optional)

Append `?webhook=https://your-server/path` to the submit URL. When the job reaches a terminal state, MuApi will POST the same shape as the polling response to your URL — no polling needed.

## Agent Integration

MuApi ships an MCP server and CLI so agents (Claude Code, Cursor, custom) can call this endpoint without writing HTTP code:

```bash
# Install the CLI
npm install -g muapi-cli

# Authenticate once
muapi auth login

# Expose all MuApi models as MCP tools to your agent
muapi mcp serve
```

The MCP server exposes tools that wrap submit + poll for every model, including `volcengine-video-to-video-lip-sync`. See `muapi --help` for category-specific shortcuts (`muapi image generate`, `muapi video from-image`, etc.).

## Related Models
- [Aleph Video to Video](https://muapi.ai/playground/runway-aleph-v2v)
- [Watermark Remover](https://muapi.ai/playground/seedance-2-watermark-remover)
- [AI Captions](https://muapi.ai/playground/ai-captions)
- [Motion Control Standard](https://muapi.ai/playground/kling-v3.0-std-motion-control)
- [Watermark Remover Pro](https://muapi.ai/playground/seedance-2-video-watermark-remover-pro)
- [AI Dance Effects](https://muapi.ai/playground/ai-dance-effects)
- [Edit Video](https://muapi.ai/playground/wan2.2-edit-video)
- [Video Upscale](https://muapi.ai/playground/topaz-video-upscale)
- [Flash Reframe V2V](https://muapi.ai/playground/luma-flash-reframe)
- [Audio to Video](https://muapi.ai/playground/infinitetalk-video-to-video)
- [Video Translate](https://muapi.ai/playground/heygen-video-translate)
- [Anime Video](https://muapi.ai/playground/wan2.2-animate)

## Resources
- [Playground Page](https://muapi.ai/playground/volcengine-video-to-video-lip-sync)
- [API Reference](https://muapi.ai/playground/volcengine-video-to-video-lip-sync?tab=2)
- [Global llms.txt](https://muapi.ai/llms.txt)