OSP Next

--- license: apache-2.0 library_name: pytorch pipeline_tag: text-to-video language: - en - zh tags: - text-to-video - video-generation - diffusion - flow-matching - sparse-attention - skiparse - sequence-parallel - mix-grpo - lora - hif8 - quantization - npu - ascend - open-sora-plan - ospnext base_model: - Wan-AI/Wan2.1-T2V-14B --- <div align="center"> <img src="https://raw.githubusercontent.com/PKU-YuanGroup/OSP-Next/main/assets/logo.png" alt="OSP-Next" width="220"> **Efficient High-Quality Video Generation with Sparse Sequence Parallelism, HiF8 Quantization, and Reinforcement Learning** **Open-Sora Plan · Next Generation** A scalable **sparse** text-to-video diffusion model, introducing **Skiparse-2D Attention**, **Sparse Sequence Parallelism (SSP)**, **HiF8 quantization**, and **Mix-GRPO + LoRA** RL post-training. </div> <h5 align="center"> [](https://arxiv.org/abs/2605.28691) [](https://github.com/PKU-YuanGroup/OSP-Next) </h5> --- ## 🧠 Model Summary OSP-Next is a 14B-parameter **text-to-video diffusion** model built on top of the **Wan 2.1** text encoder / VAE backbone, with four tightly co-designed contributions: | | What it is | Why it matters | |---|---|---| | 🧩 **Skiparse-2D Attention** | Fixed-rule 2D sparse attention applied along H/W. | Approaches 3D full attention in quality, **natively FlashAttention compatible**. | | 🔗 **Sparse Sequence Parallelism (SSP)** | A parallel strategy natively co-designed with Skiparse-2D. | **−75% inter-rank comm**, per-block comm rounds **4 → 1**. | | 🪶 **HiF8 Quantization** *(NPU only)* | Dynamic-precision 8-bit (exponent / mantissa allocation). | First joint **8-bit + sparse fine-tuning** — up to **2.27× speedup** on a single Ascend 950PR with only **−0.4 pt** on VBench. | | 🎯 **Mix-GRPO + LoRA RL** | RL post-training on top of the sparse model. | First RL pipeline for **sparse** video diffusion. | ### 📊 End-to-end speed-ups (vs. Wan 2.1 baseline, 5 s · 81-frame video) | Hardware | 720P (padded) | 768P (native) | |---|---|---| | ⚡ NVIDIA H200 (BF16 · FA3 · `torch.compile`) | **1.53×** / 1.42× (1× / 8× GPU) | **1.64×** / 1.52× | | 🟣 Ascend 950PR (BF16 · SDPA) | 1.27× (1× NPU) | 1.76× | | 🪶 Ascend 950PR (HiF8 · 8-bit ·...

Source context: 0 downloads · 2 likes · Pipeline text-to-video · Library pytorch · Repo yunyangge/OSP-Next