English
Related papers

Related papers: Adam with Bandit Sampling for Deep Learning

200 papers

Active learning methods have shown great promise in reducing the number of samples necessary for learning. As automated learning systems are adopted into real-time, real-world decision-making pipelines, it is increasingly important that…

Machine Learning · Computer Science 2022-06-23 Romain Camilleri , Andrew Wagenmaker , Jamie Morgenstern , Lalit Jain , Kevin Jamieson

Stochastic gradient descent (SGD) is an inherently sequential training algorithm--computing the gradient at batch $i$ depends on the model parameters learned from batch $i-1$. Prior approaches that break this dependence do not honor them…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-05 Saeed Maleki , Madan Musuvathi , Todd Mytkowicz , Olli Saarikivi , Tianju Xu , Vadim Eksarevskiy , Jaliya Ekanayake , Emad Barsoum

Adam is a popular variant of stochastic gradient descent for finding a local minimizer of a function. In the constant stepsize regime, assuming that the objective function is differentiable and non-convex, we establish the convergence in…

Machine Learning · Statistics 2020-05-15 Anas Barakat , Pascal Bianchi

Adam has become one of the most favored optimizers in deep learning problems. Despite its success in practice, numerous mysteries persist regarding its theoretical understanding. In this paper, we study the implicit bias of Adam in linear…

Machine Learning · Statistics 2024-06-18 Chenyang Zhang , Difan Zou , Yuan Cao

The Adam optimizer remains one of the most widely used optimizers in deep learning, and effectively tuning its hyperparameters is key to optimizing performance. However, tuning can be tedious and costly. Freeze-thaw Bayesian Optimization…

Machine Learning · Computer Science 2025-08-29 Theodoros Athanasiadis , Steven Adriaensen , Samuel Müller , Frank Hutter

A number of recent adaptive optimizers improve the generalisation performance of Adam by essentially reducing the variance of adaptive stepsizes to get closer to SGD with momentum. Following the above motivation, we suppress the range of…

Machine Learning · Computer Science 2024-07-15 Guoqiang Zhang

The adaptive moment estimation (Adam) optimizer proposed by Kingma & Ba (2014) is presumably the most popular stochastic gradient descent (SGD) optimization method for the training of deep neural networks (DNNs) in artificial intelligence…

Machine Learning · Computer Science 2026-03-20 Steffen Dereich , Thang Do , Arnulf Jentzen

Performance of machine learning algorithms depends critically on identifying a good set of hyperparameters. While recent approaches use Bayesian optimization to adaptively select configurations, we focus on speeding up random search through…

Machine Learning · Computer Science 2018-06-20 Lisha Li , Kevin Jamieson , Giulia DeSalvo , Afshin Rostamizadeh , Ameet Talwalkar

We propose a batch size invariant version of Adam, for use in large-scale, distributed settings, in which the mini-batch is divided into micro-batches which are distributed among worker nodes. For the v term, standard Adam first computes…

Machine Learning · Computer Science 2024-03-01 Xi Wang , Laurence Aitchison

The Adam optimizer is a cornerstone of modern deep learning, yet the empirical necessity of each of its individual components is often taken for granted. This paper presents a focused investigation into the role of bias-correction, a…

Machine Learning · Computer Science 2025-11-27 Sam Laing , Antonio Orvieto

Distributed data mining is an emerging research topic to effectively and efficiently address hard data mining tasks using big data, which are partitioned and computed on different worker nodes, instead of one centralized server.…

Machine Learning · Computer Science 2022-10-17 Wenhan Xian , Feihu Huang , Heng Huang

Despite the wide applications of Adam in reinforcement learning (RL), the theoretical convergence of Adam-type RL algorithms has not been established. This paper provides the first such convergence analysis for two fundamental RL algorithms…

Machine Learning · Computer Science 2020-08-18 Huaqing Xiong , Tengyu Xu , Yingbin Liang , Wei Zhang

We present an approach to Intelligent Tutoring Systems which adaptively personalizes sequences of learning activities to maximize skills acquired by students, taking into account the limited time and motivational resources. At a given point…

Artificial Intelligence · Computer Science 2019-07-17 Benjamin Clement , Didier Roy , Pierre-Yves Oudeyer , Manuel Lopes

Adam is a widely used optimization algorithm in deep learning, yet the specific class of objective functions where it exhibits inherent advantages remains underexplored. Unlike prior studies requiring external schedulers and $\beta_2$ near…

Machine Learning · Computer Science 2026-05-26 Zhiwei Bai , Jiajie Zhao , Zhangchen Zhou , Zhi-Qin John Xu , Yaoyu Zhang

Extracting actionable intelligence from distributed, heterogeneous, correlated and high-dimensional data sources requires run-time processing and learning both locally and globally. In the last decade, a large number of meta-learning…

Machine Learning · Computer Science 2016-11-01 Cem Tekin , Jinsung Yoon , Mihaela van der Schaar

Database activity monitoring (DAM) systems are commonly used by organizations to protect the organizational data, knowledge and intellectual properties. In order to protect organizations database DAM systems have two main roles, monitoring…

Machine Learning · Computer Science 2019-10-25 Hagit Grushka-Cohen , Ofer Biller , Oded Sofer , Lior Rokach , Bracha Shapira

Running out of GPU memory has become a main bottleneck for large-scale DNN training. How to reduce the memory footprint during training has received intensive research attention. We find that previous gradient accumulation reduces…

Machine Learning · Computer Science 2023-06-01 Yijia Zhang , Yibo Han , Shijie Cao , Guohao Dai , Youshan Miao , Ting Cao , Fan Yang , Ningyi Xu

This paper deals with nonconvex stochastic optimization problems in deep learning and provides appropriate learning rates with which adaptive learning rate optimization algorithms, such as Adam and AMSGrad, can approximate a stationary…

Optimization and Control · Mathematics 2020-11-24 Hideaki Iiduka

Decentralized training of deep neural networks has attracted significant attention for its theoretically superior scalability over synchronous data-parallel methods like All-Reduce. However, realizing this potential in multi-node training…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-17 Zesen Wang , Jiaojiao Zhang , Xuyang Wu , Mikael Johansson

It has been shown (Amuru et al. 2015) that online learning algorithms can be effectively used to select optimal physical layer parameters for jamming against digital modulation schemes without a priori knowledge of the victim's transmission…

Machine Learning · Computer Science 2022-07-07 Charles E. Thornton , R. Michael Buehrer