English
Related papers

Related papers: Improved Information Theoretic Generalization Boun…

200 papers

Empirical studies show that gradient-based methods can learn deep neural networks (DNNs) with very good generalization performance in the over-parameterization regime, where DNNs can easily fit a random labeling of the training data. Very…

Machine Learning · Computer Science 2019-11-28 Yuan Cao , Quanquan Gu

We derive information-theoretic lower bounds on the Bayes risk and generalization error of realizable machine learning models. In particular, we employ an analysis in which the rate-distortion function of the model parameters bounds the…

Machine Learning · Computer Science 2021-11-09 Matthew Nokleby , Ahmad Beirami

There is intense interest in applying machine learning to problems of causal inference in fields such as healthcare, economics and education. In particular, individual-level causal inference has important applications such as precision…

Machine Learning · Statistics 2017-05-17 Uri Shalit , Fredrik D. Johansson , David Sontag

Generalization bounds which assess the difference between the true risk and the empirical risk have been studied extensively. However, to obtain bounds, current techniques use strict assumptions such as a uniformly bounded or a Lipschitz…

Machine Learning · Computer Science 2020-02-25 Yossi Adi , Yaniv Nemcovsky , Alex Schwing , Tamir Hazan

We study the training and generalization of deep neural networks (DNNs) in the over-parameterized regime, where the network width (i.e., number of hidden nodes per layer) is much larger than the number of training data points. We show that,…

Machine Learning · Computer Science 2019-11-13 Yuan Cao , Quanquan Gu

We study in this paper lower bounds for the generalization error of models derived from multi-layer neural networks, in the regime where the size of the layers is commensurate with the number of samples in the training data. We show that…

Machine Learning · Statistics 2022-07-08 Inbar Seroussi , Ofer Zeitouni

This paper explores the connection between learning trajectories of Deep Neural Networks (DNNs) and their generalization capabilities when optimized using (stochastic) gradient descent algorithms. Instead of concentrating solely on the…

Machine Learning · Computer Science 2023-11-01 Jingwen Fu , Zhizheng Zhang , Dacheng Yin , Yan Lu , Nanning Zheng

Convergence bounds are one of the main tools to obtain information on the performance of a distributed machine learning task, before running the task itself. In this work, we perform a set of experiments to assess to which extent, and in…

Networking and Internet Architecture · Computer Science 2022-12-06 Francesco Malandrino , Carla Fabiana Chiasserini

Due to the inherent imbalance in real-world datasets, na\"ive Empirical Risk Minimization (ERM) tends to bias the learning process towards the majority classes, hindering generalization to minority classes. To rebalance the learning…

Machine Learning · Computer Science 2025-12-09 Zitai Wang , Qianqian Xu , Zhiyong Yang , Zhikang Xu , Linchao Zhang , Xiaochun Cao , Qingming Huang

The paper establishes generalization bounds for multitask deep neural networks using operator-theoretic techniques. The authors propose a tighter bound than those derived from conventional norm based methods by leveraging small condition…

Machine Learning · Computer Science 2026-05-29 Mahdi Mohammadigohari , Giuseppe Di Fatta , Giuseppe Nicosia , Panos M. Pardalos

We prove new probabilistic upper bounds on generalization error of complex classifiers that are combinations of simple classifiers. Such combinations could be implemented by neural networks or by voting methods of combining the classifiers,…

Probability · Mathematics 2007-05-23 Vladimir Koltchinskii , Dmitry Panchenko

Deep learning models have lately shown great performance in various fields such as computer vision, speech recognition, speech translation, and natural language processing. However, alongside their state-of-the-art performance, it is still…

Machine Learning · Computer Science 2019-04-09 Daniel Jakubovitz , Raja Giryes , Miguel R. D. Rodrigues

We consider the problem of training a machine learning model over a network of nodes in a fully decentralized framework. The nodes take a Bayesian-like approach via the introduction of a belief over the model parameter space. We propose a…

Machine Learning · Computer Science 2019-02-01 Anusha Lalitha , Osman Cihan Kilinc , Tara Javidi , Farinaz Koushanfar

We study learning algorithms when there is a mismatch between the distributions of the training and test datasets of a learning algorithm. The effect of this mismatch on the generalization error and model misspecification are quantified.…

Information Theory · Computer Science 2022-08-11 Saeed Masiha , Amin Gohari , Mohammad Hossein Yassaee , Mohammad Reza Aref

Statistical learning theory has largely focused on learning and generalization given independent and identically distributed (i.i.d.) samples. Motivated by applications involving time-series data, there has been a growing literature on…

Machine Learning · Computer Science 2019-06-24 Yuval Dagan , Constantinos Daskalakis , Nishanth Dikkala , Siddhartha Jayanti

There has been considerable effort to better understand the generalization capabilities of deep neural networks both as a means to unlock a theoretical understanding of their success as well as providing directions for further improvements.…

Machine Learning · Statistics 2024-05-30 Michael Munn , Benoit Dherin , Javier Gonzalvo

Margin enlargement over training data has been an important strategy since perceptrons in machine learning for the purpose of boosting the robustness of classifiers toward a good generalization ability. Yet Breiman (1999) showed a dilemma…

Machine Learning · Computer Science 2021-01-05 Weizhi Zhu , Yifei Huang , Yuan Yao

Graph Neural Networks (GNNs) have become the standard method for learning from networks across fields ranging from biology to social systems, yet a principled understanding of what enables them to extract meaningful representations, or why…

Machine Learning · Statistics 2026-03-19 Nil Ayday , Mahalakshmi Sabanayagam , Debarghya Ghoshdastidar

This paper considers the subject of information losses arising from the finite datasets used in the training of neural classifiers. It proves a relationship between such losses as the product of the expected total variation of the estimated…

Machine Learning · Computer Science 2020-01-09 Brandon Foggo , Nanpeng Yu , Jie Shi , Yuanqi Gao

We propose graph-dependent implicit regularisation strategies for distributed stochastic subgradient descent (Distributed SGD) for convex problems in multi-agent learning. Under the standard assumptions of convexity, Lipschitz continuity,…

Machine Learning · Computer Science 2018-09-20 Dominic Richards , Patrick Rebeschini