Whisper Tiny 24lang
A plain openai/whisper-tiny (unmodified architecture) fine-tuned on the 24 languages of the CC0 Whispered corpus. This is the matched scientific control for burakaydinofficial/whisper-tiny-mla-24lang — trained...
Fonte do modelo
- Tipo
- Text model
- Tamanho do arquivo
- 72,0 MB
- Modelo base
- openai/whisper-tiny
- Versão
- vmodel
- Atualizado
- 27 de set. de 2026
- Downloads
- 9
- Fonte
- Hugging Face
Descrição da fonte
Whisper-Tiny-24Lang — 24 languages fine-tune, standard architecture (scientific control)
A plain openai/whisper-tiny (unmodified architecture) fine-tuned on the 24 languages of the CC0
Whispered corpus. This is the
matched scientific control for burakaydinofficial/whisper-tiny-mla-24lang —
trained identically, minus the MHA→MLA conversion — published so the MLA conversion cost is
independently reproducible. No custom code: loads directly in transformers, and — being a plain unmodified Whisper — is convertible for faster-whisper / CTranslate2 / whisper.cpp via their standard converters.
from transformers import AutoModelForSpeechSeq2Seq, AutoProcessor
model = AutoModelForSpeechSeq2Seq.from_pretrained("burakaydinofficial/whisper-tiny-24lang") # no trust_remote_code
processor = AutoProcessor.from_pretrained("burakaydinofficial/whisper-tiny-24lang")
Reproduce the conversion cost
Evaluate this control and whisper-tiny-mla-24lang on CommonVoice-17 (scripts/validate.py in the
code repo); the per-language difference is the
conversion cost reported on the MLA card and in docs/results/.
Results (CommonVoice-17 test, greedy, Whisper normalization + Arabic folding; CER for th/zh/ja)
Reconstructed numbers. This control's per-language WER/CER in the table are reconstructed as (the MLA model's absolute score − the measured paired conversion cost), not from a separate evaluation of this checkpoint; an independent re-eval may differ by a few tenths. The paired conversion cost is the directly measured quantity.
| Lang | this control |
|---|---|
| en | 28.1 WER |
| de | 42.1 WER |
| es | 29.5 WER |
| fr | 44.8 WER |
| it | 43.8 WER |
| pt | 43.1 WER |
| ru | 40.6 WER |
| nl | 38.8 WER |
| pl | 47.3 WER |
| id | 53.0 WER |
| tr | 52.1 WER |
| hi | 45.9 WER |
| ms | 49.5 WER |
| sv-SE | 57.9 WER |
| th | 32.0 CER |
| zh-CN | 34.7 CER |
| cs | 67.2 WER |
| vi | 54.4 WER |
| fi | 66.9 WER |
| el | 63.7 WER |
| da | 73.7 WER |
| ja | 48.8 CER |
| nn-NO | 93.1 WER |
| ko | 71.3 WER |
Encoder frozen during fine-tuning; 15,000 steps, warmup+cosine, fp16. Read-speech domain (CommonVoice + FLEURS-validated). "Compression cost" does not apply to this unconverted control.
Fontes
1 fonte
Fontes
1 fonteVerificado 30 de ago.
Artefatos de modelo
1 artefato
Artefatos de modelo
1 artefatoTrechos de fonte
2 trechos
Trechos de fonte
2 trechos--- license: apache-2.0 base_model: openai/whisper-tiny datasets: - burakaydinofficial/Whispered language: [en, de, es, fr, it, pt, ru, nl, pl, id, tr, hi, ms, sv, th, zh, cs, vi, fi, el, da, ja, "no", ko] pipeline_tag: automatic-speech-recognition library_name: transformers tags: [whisper, multilingual, speech-recognition, fine-tuned, control] --- # Whisper-Tiny-24Lang — 24 languages fine-tune, standard architecture (scientific control) A **plain `openai/whisper-tiny`** (unmodified architecture) fine-tuned on the 24 languages of the CC0 [Whispered](https://huggingface.co/datasets/burakaydinofficial/Whispered) corpus. This is the **matched scientific control** for [`burakaydinofficial/whisper-tiny-mla-24lang`](https://huggingface.co/burakaydinofficial/whisper-tiny-mla-24lang) — trained identically, minus the MHA→MLA conversion — published so the MLA **conversion cost is independently reproducible**. No custom code: loads directly in transformers, and — being a plain unmodified Whisper — is convertible for faster-whisper / CTranslate2 / whisper.cpp via their standard converters. ```python from transformers import AutoModelForSpeechSeq2Seq, AutoProcessor model = AutoModelForSpeechSeq2Seq.from_pretrained("burakaydinofficial/whisper-tiny-24lang") # no trust_remote_code processor = AutoProcessor.from_pretrained("burakaydinofficial/whisper-tiny-24lang") ``` ## Reproduce the conversion cost Evaluate this control **and** `whisper-tiny-mla-24lang` on CommonVoice-17 (`scripts/validate.py` in the [code repo](https://github.com/burakaydinofficial/Whispered)); the per-language difference is the conversion cost reported on the MLA card and in `docs/results/`. ## Results (CommonVoice-17 test, greedy, Whisper normalization + Arabic folding; CER for th/zh/ja) > **Reconstructed numbers.** This control's per-language WER/CER in the table are reconstructed as (the MLA model's absolute score − the measured paired conversion cost), not from a separate evaluation of this checkpoint; an independent re-eval may differ by a few tenths. The paired conversion cost is the directly measured quantity. | Lang | this control | |---|---| | en | 28.1 WER | | de | 42.1 WER | | es | 29.5 WER | | fr | 44.8 WER | | it | 43.8 WER | | pt | 43.1 WER | | ru | 40.6 WER | | nl | 38.8 WER | | pl | 47.3 WER | | id | 53.0 WER | | tr | 52.1 WER | | hi | 45.9 WER |...
Source context: 9 downloads · 0 likes · Pipeline automatic-speech-recognition · Library transformers · Repo burakaydinofficial/whisper-tiny-24lang
