Saltar al contenido
ModelPublicadoExterno
Descargar

Phonebabylm Text Deu Eng Sequential Interleaved

Trained with trainclm.py, a Hugging Face Accelerate causal-LM training script (no Trainer).

Fuentehuggingface.co/nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved/tree/1b20ff891d042a08d0f0be5a72658c58ee8d6766
TipoOtherVersiónRevision 1b20ff8Dcalidad

Fuente del modelo

Tipo
Other
Tamaño del archivo
414 MB
Versión
vRevision 1b20ff8
Actualizado
20 oct 2026
Descargas
24
Fuente
Hugging Face

Descripción de la fuente

nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved

Trained with train_clm.py, a Hugging Face Accelerate causal-LM training script (no Trainer).

Training details

  • Base config: gpt_base_config.json
  • Tokenizer: nikitastheo/phonelm-text-deu-eng-tokenizer
  • Max steps: 30000
  • Learning rate: 0.0001
  • LR scheduler: linear
  • Warmup steps: 3000
  • Batch size (per device): 32
  • Gradient accumulation steps: 1
  • Total train batch size: 32
  • Language switch steps: 10000

Fuentes

1 fuente
Hugging FacePrincipalVersión 1b20ff891d042a08d0f0be5a72658c58ee8d6766
huggingface.co/nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved/tree/1b20ff891d042a08d0f0be5a72658c58ee8d6766

Verificado 20 oct

Artefactos del modelo

1 artefacto

model.safetensors

safetensors · 414 MB · SHA-256 f034347bee2f…d669 · Hugging Face

Descargar

Extractos de fuentes

3 extractos
Readme4 agohuggingface.co/nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved

--- tags: - causal-lm - text-generation library_name: transformers --- # nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved Trained with train_clm.py, a Hugging Face Accelerate causal-LM training script (no `Trainer`). ## Training details - **Base config**: `gpt_base_config.json` - **Tokenizer**: `nikitastheo/phonelm-text-deu-eng-tokenizer` - **Max steps**: 30000 - **Learning rate**: 0.0001 - **LR scheduler**: linear - **Warmup steps**: 3000 - **Batch size (per device)**: 32 - **Gradient accumulation steps**: 1 - **Total train batch size**: 32 - **Language switch steps**: 10000

Note20 octhuggingface.co/nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved

Source context: 24 downloads · 0 likes · Pipeline text-generation · Library transformers · Repo nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved

Note4 agohuggingface.co/nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved

Source context: 3232 downloads · 0 likes · Pipeline text-generation · Library transformers · Repo nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved