Skip to content
ModelListedExternal
Download

Phonebabylm Phone Deu Eng Sequential Interleaved

Trained with trainclm.py, a Hugging Face Accelerate causal-LM training script (no Trainer).

Sourcehuggingface.co/nikitastheo/phonebabylm-phone-deu-eng-sequential_interleaved/tree/4570ba0cb69f35cdc6a7ffc4dd151a3581e20c51
KindOtherVersionRevision 4570ba0Dgrade

Model source

Kind
Other
File size
326 MB
Version
vRevision 4570ba0
Updated
Sep 26, 2026
Downloads
72
Tasks
Text generation
Source
Hugging Face

Source description

nikitastheo/phonebabylm-phone-deu-eng-sequential_interleaved

Trained with train_clm.py, a Hugging Face Accelerate causal-LM training script (no Trainer).

Training details

  • Base config: gpt_base_config.json
  • Tokenizer: nikitastheo/phonelm-phone-deu-eng-tokenizer
  • Max steps: 30000
  • Learning rate: 0.0001
  • LR scheduler: linear
  • Warmup steps: 3000
  • Batch size (per device): 32
  • Gradient accumulation steps: 1
  • Total train batch size: 32
  • Language switch steps: 10000

Sources

1 source
Hugging FacePrimaryVersion 4570ba0cb69f35cdc6a7ffc4dd151a3581e20c51
huggingface.co/nikitastheo/phonebabylm-phone-deu-eng-sequential_interleaved/tree/4570ba0cb69f35cdc6a7ffc4dd151a3581e20c51

Verified Sep 26

Model artifacts

1 artifact

model.safetensors

safetensors · 326 MB · SHA-256 a4ac61b4935c…f61f · Hugging Face

Download

Source excerpts

2 excerpts
ReadmeSep 26huggingface.co/nikitastheo/phonebabylm-phone-deu-eng-sequential_interleaved

--- tags: - causal-lm - text-generation library_name: transformers --- # nikitastheo/phonebabylm-phone-deu-eng-sequential_interleaved Trained with train_clm.py, a Hugging Face Accelerate causal-LM training script (no `Trainer`). ## Training details - **Base config**: `gpt_base_config.json` - **Tokenizer**: `nikitastheo/phonelm-phone-deu-eng-tokenizer` - **Max steps**: 30000 - **Learning rate**: 0.0001 - **LR scheduler**: linear - **Warmup steps**: 3000 - **Batch size (per device)**: 32 - **Gradient accumulation steps**: 1 - **Total train batch size**: 32 - **Language switch steps**: 10000

NoteSep 26huggingface.co/nikitastheo/phonebabylm-phone-deu-eng-sequential_interleaved

Source context: 72 downloads · 0 likes · Pipeline text-generation · Library transformers · Repo nikitastheo/phonebabylm-phone-deu-eng-sequential_interleaved