Phonebabylm Phone Deu Eng Sequential Interleaved
Trained with trainclm.py, a Hugging Face Accelerate causal-LM training script (no Trainer).
Fuente del modelo
- Tipo
- Other
- Tamaño del archivo
- 326 MB
- Versión
- vRevision 4570ba0
- Actualizado
- 26 sept 2026
- Descargas
- 72
- Tareas
- Generación de texto
- Fuente
- Hugging Face
Descripción de la fuente
nikitastheo/phonebabylm-phone-deu-eng-sequential_interleaved
Trained with train_clm.py, a Hugging Face Accelerate causal-LM training script (no Trainer).
Training details
- Base config:
gpt_base_config.json - Tokenizer:
nikitastheo/phonelm-phone-deu-eng-tokenizer - Max steps: 30000
- Learning rate: 0.0001
- LR scheduler: linear
- Warmup steps: 3000
- Batch size (per device): 32
- Gradient accumulation steps: 1
- Total train batch size: 32
- Language switch steps: 10000
Fuentes
1 fuente
Fuentes
1 fuenteVerificado 26 sept
Artefactos del modelo
1 artefacto
Artefactos del modelo
1 artefactoExtractos de fuentes
2 extractos
Extractos de fuentes
2 extractos--- tags: - causal-lm - text-generation library_name: transformers --- # nikitastheo/phonebabylm-phone-deu-eng-sequential_interleaved Trained with train_clm.py, a Hugging Face Accelerate causal-LM training script (no `Trainer`). ## Training details - **Base config**: `gpt_base_config.json` - **Tokenizer**: `nikitastheo/phonelm-phone-deu-eng-tokenizer` - **Max steps**: 30000 - **Learning rate**: 0.0001 - **LR scheduler**: linear - **Warmup steps**: 3000 - **Batch size (per device)**: 32 - **Gradient accumulation steps**: 1 - **Total train batch size**: 32 - **Language switch steps**: 10000
Source context: 72 downloads · 0 likes · Pipeline text-generation · Library transformers · Repo nikitastheo/phonebabylm-phone-deu-eng-sequential_interleaved
