In this lecture and module, I went through all the mathematical derivations and also showed how to implement everything from scratch. No libraries used at all. Backpropagation, gradients, everything ...