几种梯度算法（Gradient Method）

最新推荐文章于 2024-10-01 22:09:41 发布

sincerehz

最新推荐文章于 2024-10-01 22:09:41 发布

阅读量2.7k

点赞数

CC 4.0 BY-SA版权

分类专栏：数学

本文链接：https://blog.csdn.net/sincerehz/article/details/108336063

数学专栏收录该内容

12 篇文章

订阅专栏

本文详细介绍了多种梯度下降法，包括BGD、SGD、MBGD、MGD、NAG、AGD、Adadelta、RMSprop、Adam等，解析了它们的工作原理和应用场景。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

BGD (Batch Gradient Descent) 批梯度下降法

SGD (Stochastic Gradient Descent) 随机梯度下降法

MBGD (Mini-batch Gradient Descent) 小批梯度下降法

MGD (Momentum Gradient Descent) 动量梯度下降法

NAG (Nesterov Accelerated Gradient) 涅斯捷罗夫加速梯度下降法

AGD (Adaptive Gradient Descent) 自适应梯度下降法

Adadelta (Adadelta Gradient Descent) 自适应 $Δ\Delta$ 梯度下降法

RMSprop (Root Mean Square propagation Gradient Descent) 均方根传递梯度下降法

Adam (Adaptive Moment Estimation Gradient Descent) 自适应矩估计梯度下降算法

相关链接
[1] https://drivingc.com/p/5bdfa51fd249870dca3afe22
[2] https://www.cnblogs.com/guoyaohua/p/8542554.html
[3] https://blog.csdn.net/wfei101/article/details/79938305?utm_medium=distribute.pc_relevant.none-task-blog-BlogCommendFromMachineLearnPai2-6.channel_param&depth_1-utm_source=distribute.pc_relevant.none-task-blog-BlogCommendFromMachineLearnPai2-6.channel_param
[4] https://www.cnblogs.com/tabatabaye/articles/1112475.html
[5] https://blog.csdn.net/u012328159/article/details/80311892
[6] http://www.atyun.com/2257.html
[7] https://blog.csdn.net/u011497262/article/details/88787905?utm_medium=distribute.pc_relevant.none-task-blog-title-1&spm=1001.2101.3001.4242
[8] https://www.cnblogs.com/yifdu25/p/8183587.html