Neutts Nano

--- license: apache-2.0 tags: - audio - text-to-speech - tts - gguf - neutts pipeline_tag: text-to-speech library_name: gguf language: - en --- # NeuTTS-Nano (BF16 GGUF) This repository contains the official `bf16` GGUF quantization of the **NeuTTS-Nano** acoustic inference model. Optimized specifically for low-latency, high-efficiency edge execution using `llama.cpp` or compatible GGUF runtimes. ## Model Details * **Architecture:** NeuTTS-Nano * **Format:** GGUF (`outtype: bf16`) * **File Size:** 446 MB * **Precision:** Brain Floating Point 16-bit (`bf16`) * **Primary Use Case:** Real-time acoustic processing, voice generation, low-latency edge speech pipelines. ## Deployment & Inference To run this model locally via the CLI or spin up a local inference server using `llama.cpp`, utilize the following configurations. ### CLI Benchmark ```bash llama-cli -m neutts-nano-bf16.gguf -p "Your input text prompt here" --threads 4 ``` ### Local Inference Server ```bash llama-server -m neutts-nano-bf16.gguf --port 8080 --host 0.0.0.0 ``` ## Language Variants If you are looking for specific regional acoustic profiles, distinct variants are isolated in their own standalone repositories: * Core/English: [undefinelabs/neutts-nano](https://www.google.com/search?q=https://huggingface.co/undefinelabs/neutts-nano) * French: [undefinelabs/neutts-nano-french](https://www.google.com/search?q=https://huggingface.co/undefinelabs/neutts-nano-french) * German: [undefinelabs/neutts-nano-german](https://www.google.com/search?q=https://huggingface.co/undefinelabs/neutts-nano-german) * Spanish: [undefinelabs/neutts-nano-spanish](https://www.google.com/search?q=https://huggingface.co/undefinelabs/neutts-nano-spanish)

Source context: 15 downloads · 0 likes · Pipeline text-to-speech · Library gguf · Repo undefinelabs/neutts-nano