Back to Home
Gradient Descent Pro
Iterative optimization algorithm for machine learning
Configuration
Controls the step size in each iteration (typical: 0.001 - 0.1)
How many times to update the weights
Dataset (5 samples, 2 features)
| # | Intercept | X1 | Y (Target) | Actions |
|---|---|---|---|---|
| 1 | ||||
| 2 | ||||
| 3 | ||||
| 4 | ||||
| 5 |
Related Topics & Algorithms
Explore these related algorithms and concepts to deepen your understanding and discover complementary techniques.
Regression
Linear Regression
Apply gradient descent to linear models
Classification
Logistic Regression
Optimize classification models
Deep Learning
Neural Networks
Backpropagation uses gradient descent
Ensemble Learning
XGBoost
Gradient boosting for ensemble models
Optimization
Hyperparameter Tuning
Optimize learning rate and parameters
Fundamentals
Statistics
Mathematical foundations of optimization