OpenArch: PyTorch implementations of modern LLM architectures from scratch

OpenArch – PyTorch implementations of modern LLM architectures

OpenArch is an open-source repo that implements modern LLM architectures (Llama, Qwen, DeepSeek, Gemma, etc.) in PyTorch from scratch. Based on Sebastian Raschka's LLM Architecture Gallery, it prioritizes readability and learning. Currently 20 stars on GitHub, ideal for engineers who want to understand model internals.