English
Related papers

Related papers: Quantifying Overfitting along the Regularization P…

200 papers

A recent line of research has shown that gradient-based algorithms with random initialization can converge to the global minima of the training loss for over-parameterized (i.e., sufficiently wide) deep neural networks. However, the…

Machine Learning · Computer Science 2019-06-12 Difan Zou , Quanquan Gu

We investigate the learning dynamics of classifiers in scenarios where classes are separable or classifiers are over-parameterized. In both cases, Empirical Risk Minimization (ERM) results in zero training error. However, there are many…

Machine Learning · Computer Science 2024-10-23 Julius Martinetz , Christoph Linse , Thomas Martinetz

This paper investigates, from information theoretic grounds, a learning problem based on the principle that any regularity in a given dataset can be exploited to extract compact features from data, i.e., using fewer bits than needed to…

Machine Learning · Statistics 2018-11-14 Matías Vera , Leonardo Rey Vega , Pablo Piantanida

In this paper, we propose a machine learning (ML) method to learn how to solve a generic constrained continuous optimization problem. To the best of our knowledge, the generic methods that learn to optimize, focus on unconstrained…

Machine Learning · Computer Science 2021-01-05 Seyedrazieh Bayati , Faramarz Jabbarvaziri

We analyze differences between two information-theoretically motivated approaches to statistical inference and model selection: the Minimum Description Length (MDL) principle, and the Minimum Message Length (MML) principle. Based on this…

Machine Learning · Computer Science 2013-02-01 Peter D Grunwald , Petri Kontkanen , Petri Myllymaki , Tomi Silander , Henry Tirri

Linear regression is a widely used technique to fit linear models and finds widespread applications across different areas such as machine learning and statistics. In most real-world scenarios, however, linear regression problems are often…

Quantum Physics · Physics 2023-05-02 Shantanav Chakraborty , Aditya Morolia , Anurudh Peduri

Deep neural networks (DNNs) are notorious for making more mistakes for the classes that have substantially fewer samples than the others during training. Such class imbalance is ubiquitous in clinical applications and very crucial to handle…

Machine Learning · Computer Science 2022-01-06 Sara Sangalli , Ertunc Erdil , Andreas Hoetker , Olivio Donati , Ender Konukoglu

Fundamental machine learning theory shows that different samples contribute unequally both in learning and testing processes. Contemporary studies on DNN imply that such sample difference is rooted on the distribution of intrinsic pattern…

Machine Learning · Computer Science 2021-08-19 Chi Zhang , Xiaoning Ma , Yu Liu , Le Wang , Yuanqi Su , Yuehu Liu

The concept of overfitting in model selection is explained and demonstrated with an example. After providing some background information on information theory and Kolmogorov complexity, we provide a short explanation of Minimum Description…

Machine Learning · Computer Science 2010-05-17 Volker Nannen

The double descent (DD) paradox, where over-parameterized models see generalization improve past the interpolation point, remains largely unexplored in the non-stationary domain of Deep Reinforcement Learning (DRL). We present preliminary…

Machine Learning · Computer Science 2025-11-11 Viktor Veselý , Aleksandar Todorov , Matthia Sabatelli

In this chapter we provide a theoretically founded investigation of state-of-the-art learning approaches for inverse problems from the point of view of spectral reconstruction operators. We give an extended definition of regularization…

Numerical Analysis · Mathematics 2024-06-05 Martin Burger , Samira Kabri

Quantization, a commonly used technique to reduce the memory footprint of a neural network for edge computing, entails reducing the precision of the floating-point representation used for the parameters of the network. The impact of such…

Machine Learning · Computer Science 2019-03-27 Abhishek Murthy , Himel Das , Md Ariful Islam

We study the convergence rates of the EM algorithm for learning two-component mixed linear regression under all regimes of signal-to-noise ratio (SNR). We resolve a long-standing question that many recent results have attempted to tackle:…

Machine Learning · Statistics 2021-02-08 Jeongyeol Kwon , Nhat Ho , Constantine Caramanis

Modern challenges of robustness, fairness, and decision-making in machine learning have led to the formulation of multi-distribution learning (MDL) frameworks in which a predictor is optimized across multiple distributions. We study the…

Machine Learning · Computer Science 2024-12-19 Rajeev Verma , Volker Fischer , Eric Nalisnick

Complementary-Label Learning (CLL) is a weakly-supervised learning problem that aims to learn a multi-class classifier from only complementary labels, which indicate a class to which an instance does not belong. Existing approaches mainly…

Machine Learning · Computer Science 2023-04-12 Wei-I Lin , Hsuan-Tien Lin

Recent works have cast some light on the mystery of why deep nets fit any data and generalize despite being very overparametrized. This paper analyzes training and generalization for a simple 2-layer ReLU net with random initialization, and…

Machine Learning · Computer Science 2019-05-28 Sanjeev Arora , Simon S. Du , Wei Hu , Zhiyuan Li , Ruosong Wang

We deal with the problem of numerically computing the dual norm, which is important to study sparsity-inducing regularizations (Jenatton et al. 2011,Bach et al. 2012). The dual norms find application in optimization and statistical…

Computation · Statistics 2022-04-15 Bernardi Mauro , Marco Stefanucci , Antonio Canale

With too few samples or too many model parameters, overfitting can inhibit the ability to generalise predictions to new data. Within medical imaging, this can occur when features are incorrectly assigned importance such as distinct hospital…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Becks Simpson , Francis Dutil , Yoshua Bengio , Joseph Paul Cohen

We study neural network compressibility by using singular learning theory to extend the minimum description length (MDL) principle to singular models like neural networks. Through extensive experiments on the Pythia suite with quantization,…

Machine Learning · Statistics 2025-10-15 Einar Urdshals , Edmund Lau , Jesse Hoogland , Stan van Wingerden , Daniel Murfet

Two important goals of high-dimensional modeling are prediction and variable selection. In this article, we consider regularization with combined $L_1$ and concave penalties, and study the sampling properties of the global optimum of the…

Methodology · Statistics 2016-05-12 Yingying Fan , Jinchi Lv