Omnistep 12a3b

--- license: apache-2.0 tags: - multimodal - voice-assistant - vibe-coach - note-taker - conversational - background-music - music-generation - darwin-family - evolutionary-merging - weight-space-recombination - arxiv-2605.14386 - southpawin - senter - gpt-4o library_name: transformers pipeline_tag: any-to-any base_model: - sovthpaw/omnistep-12a3b --- # OmniStep 12A3B  # Genetically Evolving Omnimodal Real Time Voice to Streaming Voice and Music Assistant > **A multimodal voice-and-music AI, born from generational Darwin family evolution.** OmniStep 12A3B is a personal AI companion — a **vibe coach** that takes notes for you, keeps up the conversation, and plays background music that matches your mood. All the while it self-evolves to become a better assistant to you, via the **Darwin Family** weight-space recombination methodology (arXiv:2605.14386). Built as a paper-exact 2-parent merge of Qwen2.5-Omni-3B (multimodal) and ACE-Step v1.5 XL SFT 4B (text-to-music). The text body of the model was produced by a paper-exact Darwin 2-parent weight-space recombination of the Qwen2.5-Omni thinker and the ACE-Step text encoder, with the Architecture Mapper's "skip on dim mismatch" behavior preserving the Omni text body intact across the Qwen2.5/Qwen3 cross-architecture boundary. The diffusion (music) head sits at F16 (unquantized) for maximum audio quality. The transformer (text/multimodal) head is shipped in 4 quantized GGUF deployments (F16, Q8_0, Q4_K_M, Q4_0) for llama.cpp users. The **OmniStep Evolutionary Radio** is the operational version of "infinitely generate its own background music" — a 4-loop pipeline (playback + queue fill + GEPA prompt evolution + Darwin weight evolution) wired up in the `evolutionary-radio` skill. ## 🎧 Listen to the examples ### 1. 🎵 Lo-Fi — chill lofi beats for late-night coding > `chill lofi beats, mellow hip-hop, soft piano keys, vinyl crackle, late-night study vibes, 75 bpm, instrumental` **🎤 Voice intro** (text generated by OmniStep 12A3B, speech by Soprano 80M) <audio controls src="https://huggingface.co/sovthpaw/omnistep-12a3b/resolve/main/01_lofi_chill_voice.wav"></audio> **🎵 The track** <audio controls src="https://huggingface.co/sovthpaw/omnistep-12a3b/resolve/main/01_lofi_chill.wav"></audio> ### 2. 🎬 Movie Orchestra — epic cinematic...

Source context: 251 downloads · 7 likes · Pipeline any-to-any · Library transformers · Repo sovthpaw/omnistep-12a3b