Ir para o conteúdo
ModelListadosExterno
Baixar

Phonebabylm Text Deu Eng Sequential Interleaved

Trained with trainclm.py, a Hugging Face Accelerate causal-LM training script (no Trainer).

Fontehuggingface.co/nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved/tree/1b20ff891d042a08d0f0be5a72658c58ee8d6766
TipoOtherVersãoRevision 1b20ff8Dnota

Fonte do modelo

Tipo
Other
Tamanho do arquivo
414 MB
Versão
vRevision 1b20ff8
Atualizado
20 de out. de 2026
Downloads
24
Fonte
Hugging Face

Descrição da fonte

nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved

Trained with train_clm.py, a Hugging Face Accelerate causal-LM training script (no Trainer).

Training details

  • Base config: gpt_base_config.json
  • Tokenizer: nikitastheo/phonelm-text-deu-eng-tokenizer
  • Max steps: 30000
  • Learning rate: 0.0001
  • LR scheduler: linear
  • Warmup steps: 3000
  • Batch size (per device): 32
  • Gradient accumulation steps: 1
  • Total train batch size: 32
  • Language switch steps: 10000

Fontes

1 fonte
Hugging FacePrimárioVersão 1b20ff891d042a08d0f0be5a72658c58ee8d6766
huggingface.co/nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved/tree/1b20ff891d042a08d0f0be5a72658c58ee8d6766

Verificado 20 de out.

Artefatos de modelo

1 artefato

model.safetensors

safetensors · 414 MB · SHA-256 f034347bee2f…d669 · Hugging Face

Baixar

Trechos de fonte

3 trechos
Readme4 de ago.huggingface.co/nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved

--- tags: - causal-lm - text-generation library_name: transformers --- # nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved Trained with train_clm.py, a Hugging Face Accelerate causal-LM training script (no `Trainer`). ## Training details - **Base config**: `gpt_base_config.json` - **Tokenizer**: `nikitastheo/phonelm-text-deu-eng-tokenizer` - **Max steps**: 30000 - **Learning rate**: 0.0001 - **LR scheduler**: linear - **Warmup steps**: 3000 - **Batch size (per device)**: 32 - **Gradient accumulation steps**: 1 - **Total train batch size**: 32 - **Language switch steps**: 10000

Note20 de out.huggingface.co/nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved

Source context: 24 downloads · 0 likes · Pipeline text-generation · Library transformers · Repo nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved

Note4 de ago.huggingface.co/nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved

Source context: 3232 downloads · 0 likes · Pipeline text-generation · Library transformers · Repo nikitastheo/phonebabylm-text-deu-eng-sequential_interleaved