English
Related papers

Related papers: Optimizing Information-theoretical Generalization …

200 papers

Heavy-tailed noise in nonconvex stochastic optimization has garnered increasing research interest, as empirical studies, including those on training attention models, suggest it is a more realistic gradient noise condition. This paper…

Optimization and Control · Mathematics 2026-04-17 Shuhua Yu , Dusan Jakovetic , Soummya Kar

Data analysis in modern science using extensive experimental and observational facilities, such as a gravitational wave detector, is essential in the search for novel scientific discoveries. Accordingly, various techniques and mathematical…

Instrumentation and Methods for Astrophysics · Physics 2022-06-14 Piljong Jung , Sang Hoon Oh , Young-Min Kim , Edwin J. Son , John J. Oh

We consider stochastic approximations of sampling algorithms, such as Stochastic Gradient Langevin Dynamics (SGLD) and the Random Batch Method (RBM) for Interacting Particle Dynamcs (IPD). We observe that the noise introduced by the…

Probability · Mathematics 2023-10-10 Aniket Das , Dheeraj Nagaraj , Anant Raj

We consider statistics for stochastic evolution equations in Hilbert space with emphasis on stochastic partial differential equations (SPDEs). We observe a solution process under additional measurement errors and want to estimate a real or…

Statistics Theory · Mathematics 2025-05-21 Gregor Pasemann , Markus Reiß

In this paper we develop a Stochastic Gradient Langevin Dynamics (SGLD) algorithm tailored for solving a certain class of non-convex distributionally robust optimisation (DRO) problems. By deriving non-asymptotic convergence bounds, we…

Optimization and Control · Mathematics 2026-05-08 Ariel Neufeld , Matthew Ng Cheng En , Ying Zhang

Continual learning (CL) has emerged as a dominant paradigm for acquiring knowledge from sequential tasks while avoiding catastrophic forgetting. Although many CL methods have been proposed to show impressive empirical performance, the…

Machine Learning · Computer Science 2026-01-07 Wen Wen , Tieliang Gong , Zeyu Gao , Yunjiao Zhang , Weizhan Zhang , Yong-Jin Liu

Assessing data informativity, determining whether the measured data contains sufficient information for a specific control objective, is a fundamental challenge in data-driven control. In noisy scenarios, existing studies deal with system…

Optimization and Control · Mathematics 2026-04-02 Taira Kaminaga , Hampei Sasahara

We study high-probability convergence guarantees of learning on streaming data in the presence of heavy-tailed noise. In the proposed scenario, the model is updated in an online fashion, as new information is observed, without storing any…

Machine Learning · Computer Science 2024-05-02 Aleksandar Armacki , Pranay Sharma , Gauri Joshi , Dragana Bajovic , Dusan Jakovetic , Soummya Kar

In this paper, we characterize the noise of stochastic gradients and analyze the noise-induced dynamics during training deep neural networks by gradient-based optimizers. Specifically, we firstly show that the stochastic gradient noise…

Machine Learning · Computer Science 2021-09-22 Yixin Wu , Rui Luo , Chen Zhang , Jun Wang , Yaodong Yang

We consider a prototypical problem of Bayesian inference for a structured spiked model: a low-rank signal is corrupted by additive noise. While both information-theoretic and algorithmic limits are well understood when the noise is a…

Information Theory · Computer Science 2024-07-09 Jean Barbier , Francesco Camilli , Marco Mondelli , Yizhou Xu

Adaptive gradient methods, such as AdaGrad, are among the most successful optimization algorithms for neural network training. While these methods are known to achieve better dimensional dependence than stochastic gradient descent (SGD) for…

Optimization and Control · Mathematics 2025-06-09 Ruichen Jiang , Devyani Maladkar , Aryan Mokhtari

Recently there are a considerable amount of work devoted to the study of the algorithmic stability and generalization for stochastic gradient descent (SGD). However, the existing stability analysis requires to impose restrictive assumptions…

Machine Learning · Computer Science 2020-06-16 Yunwen Lei , Yiming Ying

The noise in stochastic gradient descent (SGD) provides a crucial implicit regularization effect for training overparameterized models. Prior theoretical work largely focuses on spherical Gaussian noise, whereas empirical studies…

Machine Learning · Computer Science 2020-06-19 Jeff Z. HaoChen , Colin Wei , Jason D. Lee , Tengyu Ma

We consider information-theoretic bounds on expected generalization error for statistical learning problems in a networked setting. In this setting, there are $K$ nodes, each with its own independent dataset, and the models from each node…

Information Theory · Computer Science 2024-01-17 L. P. Barnes , Alex Dytso , H. V. Poor

Stochastic Gradient Descent (SGD) is a widely deployed optimization procedure throughout data-driven and simulation-driven disciplines, which has drawn a substantial interest in understanding its global behavior across a broad class of…

Optimization and Control · Mathematics 2021-04-02 Vivak Patel , Shushu Zhang

The ability of machine learning (ML) algorithms to generalize well to unseen data has been studied through the lens of information theory, by bounding the generalization error with the input-output mutual information (MI), i.e., the MI…

Machine Learning · Statistics 2024-06-07 Kimia Nadjahi , Kristjan Greenewald , Rickard Brüel Gabrielsson , Justin Solomon

The injection of heavy-tailed noise into the iterates of stochastic gradient descent (SGD) has garnered growing interest in recent years due to its theoretical and empirical benefits for optimization and generalization. However, its…

Machine Learning · Statistics 2025-05-13 Umut Şimşekli , Mert Gürbüzbalaban , Sinan Yıldırım , Lingjiong Zhu

The success of deep learning has led to a rising interest in the generalization property of the stochastic gradient descent (SGD) method, and stability is one popular approach to study it. Existing works based on stability have studied…

Machine Learning · Statistics 2019-03-08 Yi Zhou , Yingbin Liang , Huishuai Zhang

Studying the properties of stochastic noise to optimize complex non-convex functions has been an active area of research in the field of machine learning. Prior work has shown that the noise of stochastic gradient descent improves…

Optimization and Control · Mathematics 2022-09-20 Aurelien Lucchi , Frank Proske , Antonio Orvieto , Francis Bach , Hans Kersting

Stochastic Gradient Descent (SGD) introduces anisotropic noise that is correlated with the local curvature of the loss landscape, thereby biasing optimization toward flat minima. Prior work often assumes an equivalence between the Fisher…

Machine Learning · Computer Science 2026-02-06 Yikuan Zhang , Ning Yang , Yuhai Tu