Jupyter Notebook to compare different gradient-based optimization algorithms, implemented from scratch in Python.
This is the code I used to create the figures in my article about Advanced Gradient Descent algorithms and the workflow is explained in my tutorial about creating a gradient descent animation in Python.
