Voxtral 4B TTS 2603

--- library_name: vllm language: - en - fr - es - pt - it - nl - de - ar - hi license: cc-by-nc-4.0 inference: false base_model: - mistralai/Ministral-3-3B-Base-2512 extra_gated_description: >- If you want to learn more about how we process your personal data, please read our <a href="https://mistral.ai/terms/">Privacy Policy</a>. tags: - mistral-common pipeline_tag: text-to-speech --- # Voxtral 4B TTS 2603 Voxtral TTS is a frontier, open-weights text-to-speech model that’s fast, instantly adaptable, and produces lifelike speech for voice agents. The model is released with BF16 weights and a set of reference voices. These voices are licensed under CC BY-NC 4, which is the license that the model inherits. For more details, see our: - [🔊 Demo](https://console.mistral.ai/build/audio/text-to-speech) - [✍️ Blog post](https://mistral.ai/news/voxtral-tts) - [🔬 Research Paper](https://arxiv.org/abs/2603.25551) ## Key Features Voxtral TTS delivers enterprise-grade text-to-speech for production voice agents, with the following capabilities: - **Realistic, expressive speech** with natural prosody and emotional range across 9 major languages, with support for diverse dialects - **Text-to-Speech generation** with 20 preset voices and easy adaptation to new voices - **Multilingual support**: English, French, Spanish, German, Italian, Portuguese, Dutch, Arabic, and Hindi - **Very low latency** with fast time-to-first-audio, plus streaming and batch inference support - **24 kHz audio output** in WAV, PCM, FLAC, MP3, AAC, and Opus formats - **Production-ready performance** for high-throughput, real-time voice agent workflows > [!Tip] > For voice customization, visit our [AI Studio](https://console.mistral.ai/build/audio/text-to-speech). ### Use Cases - Customer support and call center infrastructure. - Financial services. _-- with video demo on banking KYC voice agents._ - Manufacturing and industrial operations. - Public services and government. - Compliance and risk. - Supply chain and logistics. - Automotive and in-vehicle systems. - Sales and marketing. - Real-time translation. > [!Warning] > Responsible Use - > You are responsible for complying with applicable laws and avoiding misuse. ## Benchmark Results - Measured using [vllm_omni/examples/offline_inference/voxtral_tts/end2end.py](https://github.com/vllm-project/vllm-omni/tree/main/examples/offlin...