Whisper Medium Coraal Gclora
Whisper-medium adapted to the CORAAL dataset with GC-LoRA (Gated Convolutional LoRA), from the paper "GC-LoRA: Gated Convolutional LoRA for Parameter-Efficient Acoustic Adaptation" (Interspeech 2026).
Fuente del modelo
- Tipo
- Checkpoint, LoRA
- Tamaño del archivo
- 2,85 GB
- Versión
- vRevision 7b26bbd
- Actualizado
- 3 oct 2026
- Publicador
- @balaji1312
- Descargas
- 11
- Fuente
- Hugging Face
Descripción de la fuente
Whisper-medium CORAAL (GC-LoRA)
Whisper-medium adapted to the CORAAL dataset with GC-LoRA (Gated Convolutional LoRA), from the paper "GC-LoRA: Gated Convolutional LoRA for Parameter-Efficient Acoustic Adaptation" (Interspeech 2026).
- Base model:
openai/whisper-medium.en - Method: GC-LoRA adapter on the encoder attention output projections (rank 8, kernel 31, scaling 16)
- CORAAL test WER: 9.9%
- Code: https://github.com/balaji1312/gc_lora
Usage
The checkpoint bundles the frozen Whisper backbone together with the trained GC-LoRA adapter.
Loading requires the custom modeling code in the gc_lora repository; see src/bin/decode_asr.py
there for loading and decoding.
Citation
@inproceedings{shankar2026gclora,
author = {Shankar, Natarajan Balaji and Wang, Zilai and Zhang, Kaiyuan and Shi, Mohan and Alwan, Abeer},
title = {{GC-LoRA}: Gated Convolutional {LoRA} for Parameter-Efficient Acoustic Adaptation},
booktitle = {Interspeech 2026},
year = {2026},
}
Fuentes
1 fuente
Fuentes
1 fuenteVerificado 3 oct
Artefactos del modelo
1 artefacto
Artefactos del modelo
1 artefactoExtractos de fuentes
3 extractos
Extractos de fuentes
3 extractos--- license: apache-2.0 language: en library_name: transformers pipeline_tag: automatic-speech-recognition tags: - whisper - automatic-speech-recognition - peft - lora - gc-lora - coraal --- # Whisper-medium CORAAL (GC-LoRA) Whisper-medium adapted to the **CORAAL** dataset with **GC-LoRA** (Gated Convolutional LoRA), from the paper *"GC-LoRA: Gated Convolutional LoRA for Parameter-Efficient Acoustic Adaptation"* (Interspeech 2026). - **Base model:** `openai/whisper-medium.en` - **Method:** GC-LoRA adapter on the encoder attention output projections (rank 8, kernel 31, scaling 16) - **CORAAL test WER:** **9.9%** - **Code:** https://github.com/balaji1312/gc_lora ## Usage The checkpoint bundles the frozen Whisper backbone together with the trained GC-LoRA adapter. Loading requires the custom modeling code in the [gc_lora repository](https://github.com/balaji1312/gc_lora); see `src/bin/decode_asr.py` there for loading and decoding. ## Citation ```bibtex @inproceedings{shankar2026gclora, author = {Shankar, Natarajan Balaji and Wang, Zilai and Zhang, Kaiyuan and Shi, Mohan and Alwan, Abeer}, title = {{GC-LoRA}: Gated Convolutional {LoRA} for Parameter-Efficient Acoustic Adaptation}, booktitle = {Interspeech 2026}, year = {2026}, } ```
Source context: 11 downloads · 0 likes · Pipeline automatic-speech-recognition · Library transformers · Repo balaji1312/whisper-medium-coraal-gclora
Source context: 1 downloads · 0 likes · Pipeline automatic-speech-recognition · Library transformers · Repo balaji1312/whisper-medium-coraal-gclora
