Building an Autograd Library for Neural Net in C++ from Scratch: My Journey and Lessons
Aditya Chaturvedi
Introduction Creating an Autograd library and Neural nets in C++ from scratch has been one of the most fun and challenging side projects I’ve undertaken recently. Inspired by Andrej Karpathy’s micrograd in Python, I wanted to explore the same idea in C++. The goal was not to replicate Karpathy’s...