Videomae Tennis Shottype
Fine-tuned VideoMAE-base (86M params) for 5-class tennis shot classification from 16-frame video clips.
Fonte do modelo
- Tipo
- Other
- Tamanho do arquivo
- 329 MB
- Modelo base
- MCG-NJU/videomae-base
- Versão
- vRevision 23c812e
- Atualizado
- 24 de out. de 2026
- Downloads
- 259
- Fonte
- Hugging Face
Descrição da fonte
VideoMAE Tennis Shot Type Classifier
Fine-tuned VideoMAE-base (86M params) for 5-class tennis shot classification from 16-frame video clips.
Classes
| Label | ID |
|---|---|
| Topspin | 0 |
| Slice | 1 |
| Volley | 2 |
| Flat | 3 |
| Smash | 4 |
Training Details
- Dataset: 2,436 annotated hit events from TenniSet (videos V006-V010)
- Input: 16 frames x 224x224, sampled around each hit timestamp
- Accuracy: 88-90% on held-out test split
- Hardware: Apple M4 Pro (48GB, MPS)
- Framework: HuggingFace Transformers
Usage
from transformers import VideoMAEImageProcessor, VideoMAEForVideoClassification
processor = VideoMAEImageProcessor.from_pretrained("vishnushenoy09/videomae-tennis-shottype")
model = VideoMAEForVideoClassification.from_pretrained("vishnushenoy09/videomae-tennis-shottype")
Credits
- VideoMAE by Zhan Tong, Yibing Song, Jue Wang, Limin Wang (MCG-NJU). Paper: VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training (NeurIPS 2022).
- TenniSet dataset by Kacper Wozniak. Used for training data annotation.
- Ball tracking and bounce detection adapted from yastrebksv/TrackNet and yastrebksv/TennisProject.
Part of
This model is part of the Sports Commentator from Video project — an automated tennis commentary pipeline using TrackNet, CatBoost, VideoMAE, Qwen2.5, RF-DETR, and F5-TTS.
Fontes
1 fonte
Fontes
1 fonteVerificado 24 de out.
Artefatos de modelo
1 artefato
Artefatos de modelo
1 artefatoTrechos de fonte
3 trechos
Trechos de fonte
3 trechos--- license: cc-by-4.0 language: - en tags: - video-classification - videomae - tennis - sports - shot-type - fine-tuned base_model: MCG-NJU/videomae-base pipeline_tag: video-classification --- # VideoMAE Tennis Shot Type Classifier Fine-tuned [VideoMAE-base](https://huggingface.co/MCG-NJU/videomae-base) (86M params) for **5-class tennis shot classification** from 16-frame video clips. ## Classes | Label | ID | |-------|-----| | Topspin | 0 | | Slice | 1 | | Volley | 2 | | Flat | 3 | | Smash | 4 | ## Training Details - **Dataset:** 2,436 annotated hit events from TenniSet (videos V006-V010) - **Input:** 16 frames x 224x224, sampled around each hit timestamp - **Accuracy:** 88-90% on held-out test split - **Hardware:** Apple M4 Pro (48GB, MPS) - **Framework:** HuggingFace Transformers ## Usage ```python from transformers import VideoMAEImageProcessor, VideoMAEForVideoClassification processor = VideoMAEImageProcessor.from_pretrained("vishnushenoy09/videomae-tennis-shottype") model = VideoMAEForVideoClassification.from_pretrained("vishnushenoy09/videomae-tennis-shottype") ``` ## Credits - **VideoMAE** by Zhan Tong, Yibing Song, Jue Wang, Limin Wang (MCG-NJU). Paper: [VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training](https://arxiv.org/abs/2203.12602) (NeurIPS 2022). - **TenniSet** dataset by Kacper Wozniak. Used for training data annotation. - **Ball tracking and bounce detection** adapted from [yastrebksv/TrackNet](https://github.com/yastrebksv/TrackNet) and [yastrebksv/TennisProject](https://github.com/yastrebksv/TennisProject). ## Part of This model is part of the **Sports Commentator from Video** project — an automated tennis commentary pipeline using TrackNet, CatBoost, VideoMAE, Qwen2.5, RF-DETR, and F5-TTS.
Source context: 259 downloads · 0 likes · Pipeline video-classification · Repo vishnushenoy09/videomae-tennis-shottype
Source context: 16 downloads · 0 likes · Pipeline video-classification · Repo vishnushenoy09/videomae-tennis-shottype
