Depth Anything V2 extracts a precise per-pixel depth map from a single image or every frame of a video, producing a grayscale map where brightness encodes relative distance from the camera. For video input, frames are processed in batches on GPU and reassembled at the source resolution and frame rate, giving a temporally aligned depth sequence. This is commonly used as a motion and structure control signal for AI video generation models such as Seedance 2 and Seedance 2.5, where a driving video's depth map guides camera movement and scene geometry while the appearance is generated fresh. It is equally useful for 3D-aware compositing, relighting, background removal, and any pipeline that needs a stable geometric reference from ordinary RGB footage.
1Motion Transfer: Extract a depth video from a driving clip to control camera and scene motion in Seedance 2/2.5 video generation.
23D-Aware Compositing: Use per-pixel depth to composite, relight, or apply depth-of-field effects on ordinary footage.
3Background and Foreground Separation: Isolate subjects from backgrounds using relative depth instead of green-screen segmentation.
4Robotics and Spatial Analysis: Estimate relative scene geometry from a single camera for prototyping and research.