What 3 Weeks of Deep Learning Have Taught Me
I've almost completed the FastAI course for deep learning, and here's a list of things I've learnt: Deep learning is far from magic . So far I was convinced there was more to deep learning than just matrix multiplications and 11th-grade math. 3 weeks haven't shown me the signs. It's hard, or it feels like magic because humans struggle to visualize beyond 3D space . And so, for my first project, I made a simple classifier that predicts the maximum number from a list of 2 numbers. This can be visualized in 3D. More on why I did this in another blogpost, but in 3 lines here's what I learnt: [activation(input x weights + bias)] many times = output loss = how off the output is from what it should have been, differentiate loss with the weights, and keep fixing the weights, until you're happy. The truth is, you'll never really know if you should be happy with your output. That's because don't