Skip to content
ModelVerifiedExternal
Download

Mini Llm

A small GPT-style language model built completely from scratch using PyTorch.

KindText modelVersionRevision 67c89f5Publisher@yut23387Cgrade

Model source

Kind
Text model
File size
723 MB
Version
vRevision 67c89f5
Updated
Oct 2, 2026
Publisher
@yut23387
Downloads
0
Source
Hugging Face

Source description

Mini LLM

A small GPT-style language model built completely from scratch using PyTorch.

Features

  • Transformer Architecture
  • Multi-Head Self Attention
  • Token + Positional Embeddings
  • Text Generation
  • Custom Tokenizer
  • Training Pipeline
  • Inference Chat System

Project Structure

mini_llm/

├── configs/

├── data/

├── tokenizer/

├── model/

├── training/

├── inference/

├── checkpoints/

├── utils/

├── train.py

├── requirements.txt

└── README.md


Installation

pip install -r requirements.txt

Sources

1 source
Hugging FacePrimaryVersion 67c89f59378cf952b5bcc40e66fa6df8f7532f11
huggingface.co/yut23387/mini-llm/tree/67c89f59378cf952b5bcc40e66fa6df8f7532f11

Verified Oct 2

Model artifacts

7 artifacts

checkpoints/archive/epoch_1.pt

pt · 723 MB · SHA-256 334469b86bdf…6209 · Hugging Face

Download

checkpoints/archive/epoch_2.pt

pt · 723 MB · SHA-256 044d9a01ed65…346a · Hugging Face

Download

checkpoints/archive/epoch_3.pt

pt · 723 MB · SHA-256 6fe9eaaf90e9…9c4a · Hugging Face

Download

checkpoints/archive/epoch_4.pt

pt · 723 MB · SHA-256 f2b53b42d31b…dd1e · Hugging Face

Download

checkpoints/archive/epoch_5.pt

pt · 723 MB · SHA-256 fb03f75c5b74…318c · Hugging Face

Download

checkpoints/final/mini_llm.pt

pt · 723 MB · SHA-256 9a18dad64a4f…2c56 · Hugging Face

Download

checkpoints/latest/latest.pt

pt · 723 MB · SHA-256 2a0e20812b3a…3ecd · Hugging Face

Download

Source excerpts

3 excerpts

# Mini LLM A small GPT-style language model built completely from scratch using PyTorch. ## Features - Transformer Architecture - Multi-Head Self Attention - Token + Positional Embeddings - Text Generation - Custom Tokenizer - Training Pipeline - Inference Chat System --- # Project Structure mini_llm/ ├── configs/ ├── data/ ├── tokenizer/ ├── model/ ├── training/ ├── inference/ ├── checkpoints/ ├── utils/ ├── train.py ├── requirements.txt └── README.md --- # Installation ```bash pip install -r requirements.txt

Source context: 0 downloads · 0 likes · Repo yut23387/mini-llm

Source context: 0 downloads · 0 likes · Repo yut23387/mini-llm