A small GPT-style language model built completely from scratch using PyTorch. Features Transformer Architecture Multi-Head Self Attention Token + Positional Embeddings Text Generation Custom Tokenizer Training Pipeline Inference Chat System Installation
A small GPT-style language model built completely from scratch using PyTorch. Features Transformer Architecture Multi-Head Self Attention Token + Positional Embeddings Text Generation Custom Tokenizer Training Pipeline Inference Chat System Installation