English
Related papers

Related papers: Optimizing Information-theoretical Generalization …

200 papers

Modeling and control of dynamical systems rely on measured data, which contains information about the system. Finite data measurements typically lead to a set of system models that are unfalsified, i.e., that explain the data. The problem…

Optimization and Control · Mathematics 2022-02-21 Tom R. V. Steentjes , Mircea Lazar , Paul M. J. Van den Hof

Recent studies have provided both empirical and theoretical evidence illustrating that heavy tails can emerge in stochastic gradient descent (SGD) in various scenarios. Such heavy tails potentially result in iterates with diverging…

Optimization and Control · Mathematics 2021-02-23 Hongjian Wang , Mert Gürbüzbalaban , Lingjiong Zhu , Umut Şimşekli , Murat A. Erdogdu

Identification of latent binary sequences from a pool of noisy observations has a wide range of applications in both statistical learning and population genetics. Each observed sequence is the result of passing one of the latent…

Statistics Theory · Mathematics 2018-11-28 Khashayar Gatmiry , Seyed Abolfazl Motahari

Graduated optimization is a global optimization technique that is used to minimize a multimodal nonconvex function by smoothing the objective function with noise and gradually refining the solution. This paper experimentally evaluates the…

Machine Learning · Computer Science 2024-12-17 Naoki Sato , Hideaki Iiduka

Stochastic gradient descent (SGD) is perhaps the most prevalent optimization method in modern machine learning. Contrary to the empirical practice of sampling from the datasets without replacement and with (possible) reshuffling at each…

Optimization and Control · Mathematics 2024-02-08 Xufeng Cai , Cheuk Yin Lin , Jelena Diakonikolas

Algorithmic stability is an important notion that has proven powerful for deriving generalization bounds for practical algorithms. The last decade has witnessed an increasing number of stability bounds for different algorithms applied on…

Machine Learning · Statistics 2023-10-31 Lingjiong Zhu , Mert Gurbuzbalaban , Anant Raj , Umut Simsekli

The privacy preserving properties of Langevin dynamics with additive isotropic noise have been extensively studied. However, the isotropic noise assumption is very restrictive: (a) when adding noise to existing learning algorithms to…

Machine Learning · Computer Science 2023-07-13 Anastasia Borovykh , Nikolas Kantas , Panos Parpas , Greg Pavliotis

We interpret the variational inference of the Stochastic Gradient Descent (SGD) as minimizing a new potential function named the \textit{quasi-potential}. We analytically construct the quasi-potential function in the case when the loss…

Machine Learning · Computer Science 2019-01-21 Wenqing Hu , Zhanxing Zhu , Haoyi Xiong , Jun Huan

One of the fundamental challenges in the deep learning community is to theoretically understand how well a deep neural network generalizes to unseen data. However, current approaches often yield generalization bounds that are either too…

Machine Learning · Computer Science 2024-07-23 Chengli Tan , Jiangshe Zhang , Junmin Liu

A new approach in stochastic optimization via the use of stochastic gradient Langevin dynamics (SGLD) algorithms, which is a variant of stochastic gradient decent (SGD) methods, allows us to efficiently approximate global minimizers of…

Portfolio Management · Quantitative Finance 2020-07-06 Sotirios Sabanis , Ying Zhang

The non-asymptotic analysis of Stochastic Gradient Descent (SGD) typically yields bounds that decompose into a bias term and a variance term. In this work, we focus on the bias component and study the extent to which SGD can match the…

Optimization and Control · Mathematics 2026-02-02 Daniel Cortild , Lucas Ketels , Juan Peypouquet , Guillaume Garrigos

Most modern learning problems are over-parameterized, where the number of learnable parameters is much greater than the number of training data points. In this over-parameterized regime, the training loss typically has infinitely many…

Machine Learning · Computer Science 2025-06-23 Kanumuri Nithin Varma , Babak Hassibi

In this work, we describe a generic approach to show convergence with high probability for both stochastic convex and non-convex optimization with sub-Gaussian noise. In previous works for convex optimization, either the convergence is only…

Optimization and Control · Mathematics 2023-03-01 Zijian Liu , Ta Duy Nguyen , Thien Hang Nguyen , Alina Ene , Huy Lê Nguyen

Generalization error bounds for deep neural networks trained by stochastic gradient descent (SGD) are derived by combining a dynamical control of an appropriate parameter norm and the Rademacher complexity estimate based on parameter norms.…

Machine Learning · Computer Science 2023-05-30 Mingze Wang , Chao Ma

The cross-entropy loss commonly used in deep learning is closely related to the defining properties of optimal representations, but does not enforce some of the key properties. We show that this can be solved by adding a regularization…

Machine Learning · Statistics 2017-02-14 Alessandro Achille , Stefano Soatto

Bounded agents are limited by intrinsic constraints on their ability to process information that is available in their sensors and memory and choose actions and memory updates. In this dissertation, we model these constraints as…

Machine Learning · Computer Science 2017-03-31 Roy Fox

This paper examines learning the optimal filtering policy, known as the Kalman gain, for a linear system with unknown noise covariance matrices using noisy output data. The learning problem is formulated as a stochastic policy optimization…

Systems and Control · Electrical Eng. & Systems 2023-10-27 Shahriar Talebi , Amirhossein Taghvaei , Mehran Mesbahi

Proving algorithm-dependent generalization error bounds for gradient-type optimization methods has attracted significant attention recently in learning theory. However, most existing trajectory-based analyses require either restrictive…

Machine Learning · Computer Science 2022-10-12 Xuanyuan Luo , Luo Bei , Jian Li

Overparametrized neural networks trained by gradient descent (GD) can provably overfit any training data. However, the generalization guarantee may not hold for noisy data. From a nonparametric perspective, this paper studies how well…

Machine Learning · Statistics 2021-09-28 Tianyang Hu , Wenjia Wang , Cong Lin , Guang Cheng

In this paper, we propose a new accelerated stochastic first-order method called clipped-SSTM for smooth convex stochastic optimization with heavy-tailed distributed noise in stochastic gradients and derive the first high-probability…

Optimization and Control · Mathematics 2020-10-26 Eduard Gorbunov , Marina Danilova , Alexander Gasnikov
‹ Prev 1 3 4 5 6 7 10 Next ›