English
Related papers

Related papers: Information-theoretic analysis of generalization c…

200 papers

We consider approximation problems for tensor product and additive random fields based on standard information in the average case setting. We also study the probabilistic setting of the mentioned problem for tensor products. The main…

Probability · Mathematics 2019-07-04 Mikhail Lifshits , Marguerite Zani

We consider bounds on the generalization performance of the least-norm linear regressor, in the over-parameterized regime where it can interpolate the data. We describe a sense in which any generalization bound of a type that is commonly…

Machine Learning · Statistics 2021-10-19 Peter L. Bartlett , Philip M. Long

We consider the minimum error entropy (MEE) criterion and an empirical risk minimization learning algorithm in a regression setting. A learning theory approach is presented for this MEE algorithm and explicit error bounds are provided in…

Machine Learning · Computer Science 2013-02-26 Ting Hu , Jun Fan , Qiang Wu , Ding-Xuan Zhou

Deep learning models have lately shown great performance in various fields such as computer vision, speech recognition, speech translation, and natural language processing. However, alongside their state-of-the-art performance, it is still…

Machine Learning · Computer Science 2019-04-09 Daniel Jakubovitz , Raja Giryes , Miguel R. D. Rodrigues

In this paper we show that the expected generalisation performance of a learning machine is determined by the distribution of risks or equivalently its logarithm -- a quantity we term the risk entropy -- and the fluctuations in a quantity…

Machine Learning · Computer Science 2022-02-16 Dominic Belcher , Antonia Marcu , Adam Prügel-Bennett

We propose a novel framework for the analysis of learning algorithms that allows us to say when such algorithms can and cannot generalize certain patterns from training data to test data. In particular we focus on situations where the rule…

Computation and Language · Computer Science 2016-05-16 Paul Tupper , Bobak Shahriari

A popular assumption for out-of-distribution generalization is that the training data comprises sub-datasets, each drawn from a distinct distribution; the goal is then to "interpolate" these distributions and "extrapolate" beyond them --…

Machine Learning · Computer Science 2021-11-19 Elan Rosenfeld , Pradeep Ravikumar , Andrej Risteski

We are interested in learning data-driven representations that can generalize well, even when trained on inherently biased data. In particular, we face the case where some attributes (bias) of the data, if learned by the model, can severely…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Ruggero Ragonesi , Riccardo Volpi , Jacopo Cavazza , Vittorio Murino

Optimization and generalization are two essential aspects of statistical machine learning. In this paper, we propose a framework to connect optimization with generalization by analyzing the generalization error based on the optimization…

Machine Learning · Statistics 2022-10-13 Fusheng Liu , Haizhao Yang , Soufiane Hayou , Qianxiao Li

We provide an information-theoretic analysis of Thompson sampling that applies across a broad range of online optimization problems in which a decision-maker must learn from partial feedback. This analysis inherits the simplicity and…

Machine Learning · Computer Science 2015-06-09 Daniel Russo , Benjamin Van Roy

Tackling output sampling noise due to finite shots of quantum measurement is an unavoidable challenge when extracting information in machine learning with physical systems. A technique called Eigentask Learning was developed recently as a…

Quantum Physics · Physics 2024-10-30 Fangjun Hu , Xun Gao

At the heart of machine learning lies the question of generalizability of learned rules over previously unseen data. While over-parameterized models based on neural networks are now ubiquitous in machine learning applications, our…

Machine Learning · Computer Science 2020-05-04 Melikasadat Emami , Mojtaba Sahraee-Ardakan , Parthe Pandit , Sundeep Rangan , Alyson K. Fletcher

In this article, we study rates of convergence of the generalization error of multi-class margin classifiers. In particular, we develop an upper bound theory quantifying the generalization error of various large margin classifiers. The…

Statistics Theory · Mathematics 2011-11-10 Xiaotong Shen , Lifeng Wang

This dissertation studies a fundamental open challenge in deep learning theory: why do deep networks generalize well even while being overparameterized, unregularized and fitting the training data to zero error? In the first part of the…

Machine Learning · Computer Science 2021-10-19 Vaishnavh Nagarajan

Deep neural networks (DNNs) exhibit an exceptional capacity for generalization in practical applications. This work aims to capture the effect and benefits of depth for supervised learning via information-theoretic generalization bounds. We…

Machine Learning · Computer Science 2025-05-09 Haiyun He , Ziv Goldfeld

We identify fundamental issues with discretization when estimating information-theoretic quantities in the analysis of data. These difficulties are theoretical in nature and arise with discrete datasets carrying significant implications for…

Quantitative Methods · Quantitative Biology 2014-06-24 Venkateshan Kannan , Jesper Tegnèr

We derive upper bounds on the generalization error of learning algorithms based on their \emph{algorithmic transport cost}: the expected Wasserstein distance between the output hypothesis and the output hypothesis conditioned on an input…

Machine Learning · Statistics 2018-11-09 Jingwei Zhang , Tongliang Liu , Dacheng Tao

We consider distributed iterative algorithms for the averaging problem over time-varying topologies. Our focus is on the convergence time of such algorithms when complete (unquantized) information is available, and on the degradation of…

Optimization and Control · Mathematics 2009-01-14 Angelia Nedić , Alex Olshevsky , Asuman Ozdaglar , John Tsitsiklis

Music summarization allows for higher efficiency in processing, storage, and sharing of datasets. Machine-oriented approaches, being agnostic to human consumption, optimize these aspects even further. Such summaries have already been…

Information Retrieval · Computer Science 2021-12-13 Francisco Raposo , David Martins de Matos , Ricardo Ribeiro

We study the notion of a generalization bound being uniformly tight, meaning that the difference between the bound and the population loss is small for all learning algorithms and all population distributions. Numerous generalization bounds…

Machine Learning · Computer Science 2023-11-29 Michael Gastpar , Ido Nachum , Jonathan Shafer , Thomas Weinberger