LingBot-Video-MoE-30B-A3B — GGUF (8GB-VRAM ready) ## WARNING: Requires encoder and vae from 1.3b repo: GGUF quantizations of — a 128-expert Mixture-of-Experts text-to-video model — packaged to run on via . Tested on an . ## How a 30B runs on 8GB MoE "A3B" means ~3B active params per token, but a diffusion forward touches essentially all experts each step — so the win isn't compute, it's that . The node loader keeps the quantized bytes in system RAM (memmap-backed) and dequantizes on demand: regular linears per forward, and the 128-expert fused stacks one expert matrix at a time, only for routed experts. Peak VRAM stays within 8GB; system RAM (as page cache) is what carries the model. Because of this, — you pick a tier by how much RAM you have, not VRAM. ## Files # DiT GGUF GOES IN DIFFUSION MODELS FOLDER! | File | Size | Notes | |---|---|---| | | ~13 GB | Fits a 16GB machine's page cache → steps at RAM speed. Recommended for 16GB RAM. | | | ~17 GB | Best quality/size for 32GB-RAM machines. | | higher tiers (Q5/Q6/Q8) | 20–32 GB | Only worthwhile with large RAM. | The expert tensors are quantized (not passed through at F16) — the fused 3D stacks are split to per-expert 2D matrices during conversion so the quantizer compresses them properly. Also required (from the base repo / companion 1.3B repo): , a Qwen3-VL text encoder, and the 30B (placed in the node pack's as ). ## Usage Load with the node; the rest of the graph (Structured Prompt → Text Encode → Sampler → Video Combine) is identical to the 1.3B workflow. , not prose — use the Structured Prompt node and always set lighting, or output drifts dark. See the GitHub pack for the full workflow. Expect the first chunk to be slow (weights streaming from disk, page cache cold); it speeds up as the cache warms. ## License — inherits the upstream LingBot-Video license from ; see that repo's LICENSE before redistribution or commercial use. Quantization is a format conversion only. Quants & nodes by .
