ModelAufgelistetExtern

Phonebabylm Text Deu Eng Sequential Interleaved

Trained with trainclm.py, a Hugging Face Accelerate causal-LM training script (no Trainer).

Quellehuggingface.co/nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved/tree/1b20ff891d042a08d0f0be5a72658c58ee8d6766

ArtOtherVersionRevision 1b20ff8DBewertung

Modellquelle

Art: Other
Dateigröße: 414 MB
Version: vRevision 1b20ff8
Aktualisiert: 20. Okt. 2026
Downloads: 24
Quelle: Hugging Face

Quellenbeschreibung

nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved

Trained with train_clm.py, a Hugging Face Accelerate causal-LM training script (no Trainer).

Training details

Base config: gpt_base_config.json
Tokenizer: nikitastheo/phonelm-text-deu-eng-tokenizer
Max steps: 30000
Learning rate: 0.0001
LR scheduler: linear
Warmup steps: 3000
Batch size (per device): 32
Gradient accumulation steps: 1
Total train batch size: 32
Language switch steps: 10000

Quellen

1 Quelle

Hugging FacePrimärVersion 1b20ff891d042a08d0f0be5a72658c58ee8d6766

huggingface.co/nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved/tree/1b20ff891d042a08d0f0be5a72658c58ee8d6766

Verifiziert 20. Okt.

Modellartefakte

1 Artefakt

model.safetensors

safetensors · 414 MB · SHA-256 f034347bee2f…d669 · Hugging Face

Herunterladen

Quellenauszüge

3 Auszüge

Readme4. Aug.huggingface.co/nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved

--- tags: - causal-lm - text-generation library_name: transformers --- # nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved Trained with train_clm.py, a Hugging Face Accelerate causal-LM training script (no `Trainer`). ## Training details - **Base config**: `gpt_base_config.json` - **Tokenizer**: `nikitastheo/phonelm-text-deu-eng-tokenizer` - **Max steps**: 30000 - **Learning rate**: 0.0001 - **LR scheduler**: linear - **Warmup steps**: 3000 - **Batch size (per device)**: 32 - **Gradient accumulation steps**: 1 - **Total train batch size**: 32 - **Language switch steps**: 10000

Note20. Okt.huggingface.co/nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved

Source context: 24 downloads · 0 likes · Pipeline text-generation · Library transformers · Repo nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved

Note4. Aug.huggingface.co/nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved

Source context: 3232 downloads · 0 likes · Pipeline text-generation · Library transformers · Repo nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved