Ir para o conteúdo
ModelVerificadoExterno
Baixar

Whisper Medium Ami Gclora

Whisper-medium adapted to the AMI dataset with GC-LoRA (Gated Convolutional LoRA), from the paper "GC-LoRA: Gated Convolutional LoRA for Parameter-Efficient Acoustic Adaptation" (Interspeech 2026).

TipoOtherVersãoRevision 34f27d1Publicador@balaji1312Cnota

Fonte do modelo

Tipo
Other
Tamanho do arquivo
2,85 GB
Versão
vRevision 34f27d1
Atualizado
23 de out. de 2026
Publicador
@balaji1312
Downloads
2
Fonte
Hugging Face

Descrição da fonte

Whisper-medium AMI (GC-LoRA)

Whisper-medium adapted to the AMI dataset with GC-LoRA (Gated Convolutional LoRA), from the paper "GC-LoRA: Gated Convolutional LoRA for Parameter-Efficient Acoustic Adaptation" (Interspeech 2026).

  • Base model: openai/whisper-medium.en
  • Method: GC-LoRA adapter on the encoder attention output projections (rank 8, kernel 31, scaling 16)
  • AMI test WER: 11.6%
  • Code: https://github.com/balaji1312/gc_lora

Usage

The checkpoint bundles the frozen Whisper backbone together with the trained GC-LoRA adapter. Loading requires the custom modeling code in the gc_lora repository; see src/bin/decode_asr.py there for loading and decoding.

Citation

@inproceedings{shankar2026gclora,
  author    = {Shankar, Natarajan Balaji and Wang, Zilai and Zhang, Kaiyuan and Shi, Mohan and Alwan, Abeer},
  title     = {{GC-LoRA}: Gated Convolutional {LoRA} for Parameter-Efficient Acoustic Adaptation},
  booktitle = {Interspeech 2026},
  year      = {2026},
}

Fontes

1 fonte
Hugging FacePrimárioVersão 34f27d14c3c1b9e474eb32d1ba21817676c47bf8
huggingface.co/balaji1312/whisper-medium-ami-gclora/tree/34f27d14c3c1b9e474eb32d1ba21817676c47bf8

Verificado 23 de out.

Artefatos de modelo

1 artefato

model.safetensors

safetensors · 2,85 GB · SHA-256 09a8fe3ec243…6ef6 · Hugging Face

Download file

Trechos de fonte

3 trechos

--- license: apache-2.0 language: en library_name: transformers pipeline_tag: automatic-speech-recognition tags: - whisper - automatic-speech-recognition - peft - lora - gc-lora - ami --- # Whisper-medium AMI (GC-LoRA) Whisper-medium adapted to the **AMI** dataset with **GC-LoRA** (Gated Convolutional LoRA), from the paper *"GC-LoRA: Gated Convolutional LoRA for Parameter-Efficient Acoustic Adaptation"* (Interspeech 2026). - **Base model:** `openai/whisper-medium.en` - **Method:** GC-LoRA adapter on the encoder attention output projections (rank 8, kernel 31, scaling 16) - **AMI test WER:** **11.6%** - **Code:** https://github.com/balaji1312/gc_lora ## Usage The checkpoint bundles the frozen Whisper backbone together with the trained GC-LoRA adapter. Loading requires the custom modeling code in the [gc_lora repository](https://github.com/balaji1312/gc_lora); see `src/bin/decode_asr.py` there for loading and decoding. ## Citation ```bibtex @inproceedings{shankar2026gclora, author = {Shankar, Natarajan Balaji and Wang, Zilai and Zhang, Kaiyuan and Shi, Mohan and Alwan, Abeer}, title = {{GC-LoRA}: Gated Convolutional {LoRA} for Parameter-Efficient Acoustic Adaptation}, booktitle = {Interspeech 2026}, year = {2026}, } ```

Source context: 3 downloads · 0 likes · Pipeline automatic-speech-recognition · Library transformers · Repo balaji1312/whisper-medium-ami-gclora

Source context: 2 downloads · 0 likes · Pipeline automatic-speech-recognition · Library transformers · Repo balaji1312/whisper-medium-ami-gclora