LongCat Video Avatar 1.5 BF16

--- license: mit library_name: mlx pipeline_tag: text-to-video tags: - mlx - apple-silicon - video-generation - audio-driven-video - longcat - flow-matching base_model: - meituan-longcat/LongCat-Video-Avatar-1.5 language: - en - zh --- Part of the [LongCat-Video-Avatar 1.5 — MLX](https://huggingface.co/collections/mlx-community/longcat-video-avatar-15-mlx-6a185d1af4a43074d882e375) collection. # LongCat-Video-Avatar-1.5-bf16 (MLX) Apple MLX bf16 weights for [LongCat-Video-Avatar-1.5](https://github.com/meituan-longcat/LongCat-Video) — Meituan's audio-driven video diffusion model — with the DMD step-distillation LoRA published **as a separate file** for runtime merging. Use this variant if you want to switch between the 50-step base inference path and the 8-step DMD distilled path at runtime, or to experiment with custom LoRA strengths. For the simpler default (DMD pre-merged, 8-step only) see [mlx-community/LongCat-Video-Avatar-1.5-bf16-dmd-merged](https://huggingface.co/mlx-community/LongCat-Video-Avatar-1.5-bf16-dmd-merged). ## TL;DR | | | |---|---| | **Architecture** | Wan 2.1 VAE + umT5-XXL + Whisper-Large-v3 + 48-block Avatar DiT + separate DMD LoRA | | **Params** | ~13.6 B DiT + ~11 B umT5 + ~0.6 B Whisper encoder + 0.5 B VAE + 0.6 B LoRA | | **Format** | bf16, sharded safetensors (HF-style per-component subdirs) | | **Disk** | ~46 GB (43 GB base + 2.5 GB LoRA) | | **Hardware** | Apple Silicon M-series, 64 GB+ unified memory recommended for 480p | | **Inference** | 50-step base OR 8-step with on-demand DMD LoRA merge | | **License** | MIT (matches upstream Meituan) | ## Quick start ```bash # 1. Pull weights (~46 GB) hf download mlx-community/LongCat-Video-Avatar-1.5-bf16 \ --local-dir ./weights # 2. Set up inference (Python 3.12) git clone https://github.com/xocialize/longcat-avatar-mlx cd longcat-avatar-mlx python3.12 -m venv .venv .venv/bin/pip install -e ".[parity]" .venv/bin/pip install librosa Pillow imageio imageio-ffmpeg # 3. Run end-to-end (base variant: pipeline merges LoRA on load) .venv/bin/python scripts/run_inference.py \ --weights ./weights/.. \ --variant base \ --num-frames 93 \ --out output.mp4 ``` Programmatic LoRA merge: ```python from longcat_video_avatar.pipeline_mlx import LongCatAvatarPipeline pipeline = LongCatAvatarPipeline(...) # standard 4-component load # Optionally merge DMD LoRA at any strength...

Source context: 0 downloads · 0 likes · Pipeline text-to-video · Library mlx · Repo mlx-community/LongCat-Video-Avatar-1.5-bf16