A complete GPT language model in ~600 lines of C#, zero dependencies (github.com) AI

The GitHub project “AutoGrad-Engine” provides a compact, dependency-free C# implementation of the core GPT training and text-generation pipeline, using a small character-level GPT trained on names. It includes a minimal automatic differentiation (“autograd”) engine, tokenizer, and transformer blocks (RMSNorm, multi-head causal attention, and an MLP), along with numerical gradient-checking tests. The repository is positioned as an educational port of Karpathy’s microGPT rather than production-ready ML software.