Topic: gradient descent

Ars Technica has been separating the signal from the noise for over 25 years. With our unique combination of technical ...
Hacker

Backprop — The Russian Algorithm the West Claimed as Its Own

Your browser does not support the audio element. The backpropagation algorithm is the cornerstone of modern artificial intelligence. Its significance goes far beyond ...
Visual Studio Magazine

Kernel Ridge Regression with Stochastic Gradient Descent Training Using JavaScript

Dr. James McCaffrey presents a complete end-to-end demonstration of the kernel ridge regression technique to predict a single numeric value. The demo uses stochastic gradient descent, one of two ...
IEEE

Modeling and Online SOC Estimation Method Using Back Propagation Neural Network with Momentum Gradient Descent Algorithm of Batteries

Abstract: To improve the estimation accuracy of the state of charge (SOC) in power batteries for electric vehicles, this study proposes a novel modeling and online SOC estimation method using Back ...
IEEE

The weighted iterative algorithms for state of health estimation using Volterra series model: least squares algorithm and gradient descent algorithm

Abstract: The state of health (SOH) can usually be described by an exponential model. Traditional least squares and gradient descent algorithms are inefficient for such a special model. In this paper, ...
Scientific Research Publishing

Solodov, M. (2007) An Explicit Descent Method for Bilevel Convex Optimization. Journal of Convex Analysis, 14, 227-237.

ABSTRACT: In this paper, we consider a more general bi-level optimization problem, where the inner objective function is consisted of three convex functions, involving a smooth and two non-smooth ...
insideHPC

RMSprop Optimization Algorithm for Gradient Descent with Neural Networks

A big part of AI and Deep Learning these days is the tuning/optimizing of the algorithms for speed and accuracy. Much of today’s deep learning algorithms involve the use of the gradient descent ...