Five Years Of Tinygrad
George Hotz reflects on five years of building tinygrad, a minimal deep learning framework that now stands at 18,935 lines of code with a team of 6 people. He argues that the path to competing with NVIDIA is through software sovereignty, not hardware—pointing out that AMD, Amazon, Tesla, and Groq have all made good chips but failed at training because they lack the software stack. Tinygrad is working toward zero dependencies and LLVM removal to drive AMD GPUs with pure Python. Hotz critiques mainstream software development as 98% workarounds for other code, advocating for Elon's principle that 'the best part is no part.' The tiny corp operates as a 'deconstructed company' with public Discord, GitHub, AMD contracts negotiated on Twitter, and a mission to commoditize the petaflop.
Dec 29, 2025 tinygradHardware