What is gradient descent?
Gradient descent is a method for mathematical optimization. It is used to train neural networks, which lie at the heart of modern machine learning
An approach to AI in which, instead of designing an algorithm directly, we have the system search through possible algorithms based on how well they do on some training data.
3Blue1Brown’s videos offer a good illustration of the functioning of a neural network A simulated network of nodes (‘neurons’) and their connections (weights). Neural networks are the core component of deep learning, the leading AI paradigm.