English
Related papers

Related papers: How neural networks find generalizable solutions: …

200 papers

Stochastic gradient descent (SGD), a widely used algorithm in deep-learning neural networks has attracted continuing studies for the theoretical principles behind its success. A recent work reports an anomaly (inverse) relation between the…

Adaptation and Self-Organizing Systems · Physics 2023-08-16 Xia Xiong , Yong-Cong Chen , Chunxiao Shi , Ping Ao

Generalization is one of the most important problems in deep learning (DL). In the overparameterized regime in neural networks, there exist many low-loss solutions that fit the training data equally well. The key question is which solution…

Disordered Systems and Neural Networks · Physics 2023-06-21 Ning Yang , Chao Tang , Yuhai Tu

Stochastic gradient descent (SGD) is central to deep learning, yet the dynamical origin of its preference for flatter, more generalizable solutions remains unclear. Here, by analyzing SGD learning dynamics, we identify a nonequilibrium…

Machine Learning · Computer Science 2026-01-19 Ning Yang , Yikuan Zhang , Qi Ouyang , Chao Tang , Yuhai Tu

Neural networks are trained by optimizing multi-dimensional sets of fitting parameters on non-convex loss landscapes. Low-loss regions of the landscapes correspond to the parameter sets that perform well on the training data. A key issue in…

Machine Learning · Computer Science 2026-02-26 Jianneng Yu , Alexandre V. Morozov

The stochastic gradient descent (SGD) algorithm is the algorithm we use to train neural networks. However, it remains poorly understood how the SGD navigates the highly nonlinear and degenerate loss landscape of a neural network. In this…

Machine Learning · Computer Science 2025-06-13 Liu Ziyin , Hongchao Li , Masahito Ueda

Stochastic gradient descent (SGD) is one of the most popular algorithms in modern machine learning. The noise encountered in these applications is different from that in many theoretical analyses of stochastic gradient algorithms. In this…

Machine Learning · Statistics 2021-09-16 Stephan Wojtowytsch

Stochastic gradient descent (SGD) and its variants enable modern artificial intelligence. However, theoretical understanding lags far behind their empirical success. It is widely believed that SGD has a curious ability to avoid sharp local…

Machine Learning · Computer Science 2025-10-27 Xingyu Wang , Chang-Han Rhee

This paper proposes a new optimization algorithm called Entropy-SGD for training deep neural networks that is motivated by the local geometry of the energy landscape. Local extrema with low generalization error have a large proportion of…

We introduce "AnnealSGD", a regularized stochastic gradient descent algorithm motivated by an analysis of the energy landscape of a particular class of deep networks with sparse random weights. The loss function of such networks can be…

Machine Learning · Computer Science 2017-04-25 Pratik Chaudhari , Stefano Soatto

Stochastic gradient algorithms are the main focus of large-scale optimization problems and led to important successes in the recent advancement of the deep learning algorithms. The convergence of SGD depends on the careful choice of…

Machine Learning · Computer Science 2017-03-03 Caglar Gulcehre , Jose Sotelo , Marcin Moczulski , Yoshua Bengio

Stochastic gradient descent (SGD) is widely used in deep learning due to its computational efficiency, but a complete understanding of why SGD performs so well remains a major challenge. It has been observed empirically that most…

Machine Learning · Statistics 2022-06-20 Carmina Fjellström , Kaj Nyström

Stochastic gradient descent (SGD) is widely used in machine learning. Although being commonly viewed as a fast but not accurate version of gradient descent (GD), it always finds better solutions than GD for modern neural networks. In order…

Machine Learning · Computer Science 2018-08-17 Robert Kleinberg , Yuanzhi Li , Yang Yuan

Learning in deep neural networks (DNNs) is implemented through minimizing a highly non-convex loss function, typically by a stochastic gradient descent (SGD) method. This learning process can effectively find good wide minima without being…

Machine Learning · Computer Science 2021-07-27 Guozhang Chen , Cheng Kevin Qu , Pulin Gong

Stochastic Gradient Descent (SGD) is an out-of-equilibrium algorithm used extensively to train artificial neural networks. However very little is known on to what extent SGD is crucial for to the success of this technology and, in…

Machine Learning · Computer Science 2023-12-19 Persia Jana Kamali , Pierfrancesco Urbani

A large body of theory and empirical work hypothesizes a connection between the flatness of a neural network's loss landscape during training and its performance. However, there have been conceptually opposite pieces of evidence regarding…

Machine Learning · Computer Science 2026-02-06 Yizhou Xu , Pierfrancesco Beneventano , Isaac Chuang , Liu Ziyin

Previous works on stochastic gradient descent (SGD) often focus on its success. In this work, we construct worst-case optimization problems illustrating that, when not in the regimes that the previous works often assume, SGD can exhibit…

Machine Learning · Computer Science 2023-05-30 Liu Ziyin , Botao Li , James B. Simon , Masahito Ueda

Multi-layer neural networks are among the most powerful models in machine learning, yet the fundamental reasons for this success defy mathematical understanding. Learning a neural network requires to optimize a non-convex high-dimensional…

Machine Learning · Statistics 2022-06-08 Song Mei , Andrea Montanari , Phan-Minh Nguyen

Deep unfolding networks have recently gained popularity in the context of solving imaging inverse problems. However, the computational and memory complexity of data-consistency layers within traditional deep unfolding networks scales with…

Image and Video Processing · Electrical Eng. & Systems 2021-06-04 Jiaming Liu , Yu Sun , Weijie Gan , Xiaojian Xu , Brendt Wohlberg , Ulugbek S. Kamilov

Gradient descent algorithm is the most utilized method when optimizing machine learning issues. However, there exists many local minimums and saddle points in the loss function, especially for high dimensional non-convex optimization…

Machine Learning · Computer Science 2021-07-19 Zhicheng Cai

Distributed Deep Learning (DDL) is essential for large-scale Deep Learning (DL) training. Synchronous Stochastic Gradient Descent (SSGD) 1 is the de facto DDL optimization method. Using a sufficiently large batch size is critical to…

Machine Learning · Computer Science 2021-12-03 Wei Zhang , Mingrui Liu , Yu Feng , Xiaodong Cui , Brian Kingsbury , Yuhai Tu
‹ Prev 1 2 3 10 Next ›