English
Related papers

Related papers: Stochastic Gradient Sampling for Enhancing Neural …

200 papers

We introduce Gravity, another algorithm for gradient-based optimization. In this paper, we explain how our novel idea change parameters to reduce the deep learning model's loss. It has three intuitive hyper-parameters that the best values…

Machine Learning · Computer Science 2021-01-25 Dariush Bahrami , Sadegh Pouriyan Zadeh

Stochastic methods with coordinate-wise adaptive stepsize (such as RMSprop and Adam) have been widely used in training deep neural networks. Despite their fast convergence, they can generalize worse than stochastic gradient descent. In this…

Machine Learning · Computer Science 2019-05-27 Shuai Zheng , James T. Kwok

A number of recent adaptive optimizers improve the generalisation performance of Adam by essentially reducing the variance of adaptive stepsizes to get closer to SGD with momentum. Following the above motivation, we suppress the range of…

Machine Learning · Computer Science 2024-07-15 Guoqiang Zhang

Adaptive moment methods have been remarkably successful in deep learning optimization, particularly in the presence of noisy and/or sparse gradients. We further the advantages of adaptive moment techniques by proposing a family of double…

Machine Learning · Statistics 2018-11-07 Kin Gutierrez , Jin Li , Cristian Challu , Artur Dubrawski

Deep learning networks are typically trained by Stochastic Gradient Descent (SGD) methods that iteratively improve the model parameters by estimating a gradient on a very small fraction of the training data. A major roadblock faced when…

Machine Learning · Computer Science 2020-06-11 Tao Lin , Lingjing Kong , Sebastian U. Stich , Martin Jaggi

Adam is applied widely to train neural networks. Different kinds of Adam methods with different features pop out. Recently two new adam optimizers, AdaBelief and Padam are introduced among the community. We analyze these two adam optimizers…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Zhaoyang Zhu , Haozhe Sun , Chi Zhang

We propose a population-based Evolutionary Stochastic Gradient Descent (ESGD) framework for optimizing deep neural networks. ESGD combines SGD and gradient-free evolutionary algorithms as complementary algorithms in one framework in which…

Machine Learning · Computer Science 2018-10-17 Xiaodong Cui , Wei Zhang , Zoltán Tüske , Michael Picheny

Optimizers like Adam and AdaGrad have been very successful in training large-scale neural networks. Yet, the performance of these methods is heavily dependent on a carefully tuned learning rate schedule. We show that in many large-scale…

Machine Learning · Computer Science 2022-02-02 Ehsan Amid , Rohan Anil , Christopher Fifty , Manfred K. Warmuth

The adaptive moment estimation (Adam) optimizer proposed by Kingma & Ba (2014) is presumably the most popular stochastic gradient descent (SGD) optimization method for the training of deep neural networks (DNNs) in artificial intelligence…

Machine Learning · Computer Science 2026-03-20 Steffen Dereich , Thang Do , Arnulf Jentzen

Distribution-based search algorithms are an effective approach for evolutionary reinforcement learning of neural network controllers. In these algorithms, gradients of the total reward with respect to the policy parameters are estimated…

Neural and Evolutionary Computing · Computer Science 2020-12-09 Nihat Engin Toklu , Paweł Liskowski , Rupesh Kumar Srivastava

In quantum control, the robustness with respect to uncertainties in the system's parameters or driving field characteristics is of paramount importance and has been studied theoretically, numerically and experimentally. We test in this…

Numerical Analysis · Mathematics 2019-12-04 Gabriel Turinici

Uncertainty computation in deep learning is essential to design robust and reliable systems. Variational inference (VI) is a promising approach for such computation, but requires more effort to implement and execute compared to…

Machine Learning · Statistics 2018-08-03 Mohammad Emtiyaz Khan , Didrik Nielsen , Voot Tangkaratt , Wu Lin , Yarin Gal , Akash Srivastava

As an adaptive, interpretable, robust, and accurate meta-algorithm for arbitrary differentiable loss functions, gradient tree boosting is one of the most popular machine learning techniques, though the computational expensiveness severely…

Machine Learning · Computer Science 2019-11-21 Daniel Chao Zhou , Zhongming Jin , Tong Zhang

Adaptive gradient-based optimization methods such as \textsc{Adagrad}, \textsc{Rmsprop}, and \textsc{Adam} are widely used in solving large-scale machine learning problems including deep learning. A number of schemes have been proposed in…

Machine Learning · Computer Science 2019-05-30 Parvin Nazari , Davoud Ataee Tarzanagh , George Michailidis

A number of optimization approaches have been proposed for optimizing nonconvex objectives (e.g. deep learning models), such as batch gradient descent, stochastic gradient descent and stochastic variance reduced gradient descent. Theory…

Machine Learning · Computer Science 2019-05-15 Jia Bi , Steve R. Gunn

Stochastic compositional optimization generalizes classic (non-compositional) stochastic optimization to the minimization of compositions of functions. Each composition may introduce an additional expectation. The series of expectations may…

Optimization and Control · Mathematics 2021-09-29 Tianyi Chen , Yuejiao Sun , Wotao Yin

The choice of step-size used in Stochastic Gradient Descent (SGD) optimization is empirically selected in most training procedures. Moreover, the use of scheduled learning techniques such as Step-Decaying, Cyclical-Learning, and Warmup to…

Machine Learning · Computer Science 2020-06-12 Mahdi S. Hosseini , Konstantinos N. Plataniotis

In the setting of nonparametric regression, we propose and study a combination of stochastic gradient methods with Nystr\"om subsampling, allowing multiple passes over the data and mini-batches. Generalization error bounds for the studied…

Machine Learning · Statistics 2017-10-24 Junhong Lin , Lorenzo Rosasco

The success of the Adam optimizer on a wide array of architectures has made it the default in settings where stochastic gradient descent (SGD) performs poorly. However, our theoretical understanding of this discrepancy is lagging,…

Machine Learning · Computer Science 2023-04-28 Frederik Kunstner , Jacques Chen , Jonathan Wilder Lavington , Mark Schmidt

We introduce a novel framework for the estimation of the posterior distribution over the weights of a neural network, based on a new probabilistic interpretation of adaptive optimisation algorithms such as AdaGrad and Adam. We demonstrate…

Machine Learning · Statistics 2020-07-21 Samuel Kessler , Arnold Salas , Vincent W. C. Tan , Stefan Zohren , Stephen Roberts