Node packVerificadoExterno

ComfyUI-MVNT

ComfyUI custom nodes for MVNT Motion API — AI dance choreography from music

Fontegithub.com/mvnt-app/ComfyUI-MVNT

Mantenedor@mvnt-appUnratednota

Perfil do pacote

Status: Verificado
Publicador: @mvnt-app
Fonte: GitHub

README

ComfyUI-MVNT

Music in. Choreography out.

Generate 3D dance motion from any audio file using MVNT Dance Intelligence — directly inside ComfyUI.

Registry License: MIT

Demo

https://github.com/user-attachments/assets/2fcde3de-5bd5-4fe6-8931-72198dee9ace

What It Does

ComfyUI-MVNT connects ComfyUI to the MVNT Motion API, which generates music-conditioned choreography from audio input.

Drop in a track → choose a style → get an animated GLB and reference MP4 out. Works standalone or as part of larger character pipelines (Tripo, Kling, etc.).

Nodes

Node	What it does
`MVNT Audio Segment`	Selects the audio segment to send. Duration capped at 40 seconds.
`MVNT Generate Dance`	Sends audio to MVNT, polls generation, returns an animated GLB. Optionally retargets motion to a connected character GLB.
`MVNT Preview Dance 3D`	Shows the animated GLB in ComfyUI's native 3D preview with companion audio controls.
`MVNT Image to T-Pose`	Converts a character image into a front-facing T-pose via MVNT preprocessing — for use as a retargeting reference.
`MVNT Render Dance Video`	Downloads a server-rendered MP4 from the generated dance. Two profiles: `pretty` (toon studio look) and `kling` (mannequin reference for motion transfer).

Main Flow

Load Audio
  → MVNT Audio Segment
  → MVNT Generate Dance
  → MVNT Preview Dance 3D          ← fast 3D review
  → MVNT Render Dance Video        ← optional MP4

Optional character flow:

character image → MVNT Image to T-Pose
character GLB   → MVNT Generate Dance (retargeted output)

Example Workflows

Drag any .json from workflows/ into ComfyUI to load it.

Workflow	Description
`MVNT4.2 - music_to_3d_dance.json`	Core flow: audio → animated GLB → 3D preview + optional MP4.
`mvnt_audio_to_dance.json`	Minimal test: audio → dance output.
`mvnt_image_to_tpose.json`	Character image → T-pose image.

Installation

ComfyUI Manager (recommended)

Search MVNT in ComfyUI Manager → Install.

Comfy Registry

comfy node registry-install comfyui-mvnt

Manual

cd ComfyUI/custom_nodes
git clone https://github.com/mvnt-app/ComfyUI-MVNT.git comfyui-mvnt
cd comfyui-mvnt
pip install -r requirements.txt

Restart ComfyUI after installation.

API Key

Get your API key at mvnt.studio.

Set it as an environment variable before launching ComfyUI:

export MVNT_API_KEY=mvnt_live_xxxxxxxxxxxxx

Or paste it directly into the api_key field on any node that exposes it.

Never commit API keys in workflow JSON. If a key is accidentally committed, revoke it immediately from your MVNT dashboard.

Quick Start

Add an audio file to ComfyUI/input/
Load workflows/MVNT4.2 - music_to_3d_dance.json
In MVNT Audio Segment, set start time and duration (max 40s)
In MVNT Generate Dance, choose a dance style
Queue — outputs land in ComfyUI/output/:

mvnt_<id>.motion.glb
mvnt_<id>.dance.fetch.mp4   # only when MVNT Render Dance Video is connected

Character Retargeting

Connect a rigged GLB to character_glb on MVNT Generate Dance. MVNT generates the base motion, then retargets it to your character automatically. The dance_3d output becomes the retargeted animated GLB.

Works with Tripo-style GLB assets.