English
Related papers

Related papers: DSD$^2$: Can We Dodge Sparse Double Descent and Co…

200 papers

We study feature selection in high-dimensional regression under two distinct sources of instability: sampling variability and measurement error in the design matrix. Stability Selection addresses the former through sub-sampling and…

Methodology · Statistics 2026-05-05 Mahdi Nouraie , Houying Zhu , Samuel Muller

Deep learning has become a crucial technology for making breakthroughs in many fields. Nevertheless, it still faces two important challenges in theoretical and applied aspects. The first lies in the shortcomings of gradient descent based…

Machine Learning · Computer Science 2024-07-09 Binghong Liu , Ziqi Zhao , Shupan Li , Ke Wang

The generalization mystery in deep learning is the following: Why do over-parameterized neural networks trained with gradient descent (GD) generalize well on real datasets even though they are capable of fitting random datasets of…

Machine Learning · Computer Science 2022-06-07 Satrajit Chatterjee , Piotr Zielinski

When applied to training deep neural networks, stochastic gradient descent (SGD) often incurs steady progression phases, interrupted by catastrophic episodes in which loss and gradient norm explode. A possible mitigation of such events is…

Machine Learning · Statistics 2017-09-06 Alice Schoenauer-Sebag , Marc Schoenauer , Michèle Sebag

It is widely believed that sparse supervision is worse than dense supervision in the field of depth completion, but the underlying reasons for this are rarely discussed. To this end, we revisit the task of radar-camera depth completion and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Huadong Li , Minhao Jing , Jiajun Liang , Haoqiang Fan , Renhe Ji

Standard gradient descent methods yield point estimates with no measure of confidence. This limitation is acute in overparameterized and low-data regimes, where models have many parameters relative to available data and can easily overfit.…

Machine Learning · Computer Science 2025-08-22 Carlos Stein Brito

Short fixed-length inputs are the main bottleneck of deep learning methods in long time-series forecasting tasks. Prolonging input length causes overfitting, rapidly deteriorating accuracy. Our research indicates that the overfitting is a…

Machine Learning · Computer Science 2025-09-05 Chao Ma , Yikai Hou , Xiang Li , Yinggang Sun , Haining Yu

We propose that learning in deep neural networks proceeds in two phases: a rapid curve fitting phase followed by a slower compression or coarse graining phase. This view is supported by the shared temporal structure of three phenomena:…

High Energy Physics - Theory · Physics 2025-07-28 Robert de Mello Koch , Animik Ghosh

Sparse neural networks are highly desirable in deep learning in reducing its complexity. The goal of this paper is to study how choices of regularization parameters influence the sparsity level of learned neural networks. We first derive…

Machine Learning · Computer Science 2024-08-07 Lixin Shen , Rui Wang , Yuesheng Xu , Mingsong Yan

This paper presents meta-sparsity, a framework for learning model sparsity, basically learning the parameter that controls the degree of sparsity, that allows deep neural networks (DNNs) to inherently generate optimal sparse shared…

Machine Learning · Computer Science 2025-01-22 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

Large deep networks have demonstrated competitive performance in single image super-resolution (SISR), with a huge volume of data involved. However, in real-world scenarios, due to the limited accessible training pairs, large models exhibit…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Ruicheng Feng , Jinjin Gu , Yu Qiao , Chao Dong

Sparse events, such as malign attacks in real-time network traffic, have caused big organisations an immense hike in revenue loss. This is due to the excessive growth of the network and its exposure to a plethora of people. The standard…

Cryptography and Security · Computer Science 2021-12-08 Nasreen Fathima , Akshara Pramod , Yash Srivastava , Anusha Maria Thomas , Syed Ibrahim S P , Chandran K R

It is well known that direct training of deep neural networks will generally lead to poor results. A major progress in recent years is the invention of various pretraining methods to initialize network parameters and it was shown that such…

Machine Learning · Computer Science 2014-06-10 Jun Li , Wei Luo , Jian Yang , Xiaotong Yuan

In recommender systems, users always choose the favorite items to rate, which leads to data missing not at random and poses a great challenge for unbiased evaluation and learning of prediction models. Currently, the doubly robust (DR)…

Machine Learning · Computer Science 2023-08-25 Haoxuan Li , Chunyuan Zheng , Peng Wu

Continual learning, focused on sequentially learning multiple tasks, has gained significant attention recently. Despite the tremendous progress made in the past, the theoretical understanding, especially factors contributing to catastrophic…

Machine Learning · Computer Science 2024-05-29 Meng Ding , Kaiyi Ji , Di Wang , Jinhui Xu

We showcase important features of the dynamics of the Stochastic Gradient Descent (SGD) in the training of neural networks. We present empirical observations that commonly used large step sizes (i) lead the iterates to jump from one side of…

Machine Learning · Computer Science 2023-06-08 Maksym Andriushchenko , Aditya Varre , Loucas Pillaud-Vivien , Nicolas Flammarion

Very large deep learning models trained using gradient descent are remarkably resistant to memorization given their huge capacity, but are at the same time capable of fitting large datasets of pure noise. Here methods are introduced by…

Machine Learning · Computer Science 2022-12-22 Benjamin L. Badger

A common way to avoid overfitting in supervised learning is early stopping, where a held-out set is used for iterative evaluation during training to find a sweet spot in the number of training steps that gives maximum generalization.…

Machine Learning · Computer Science 2022-08-23 Ali Vardasbi , Maarten de Rijke , Mostafa Dehghani

In deep learning, it is common to use more network parameters than training points. In such scenarioof over-parameterization, there are usually multiple networks that achieve zero training error so that thetraining algorithm induces an…

Machine Learning · Computer Science 2023-08-22 Hung-Hsu Chou , Carsten Gieshoff , Johannes Maly , Holger Rauhut

In this thesis we discuss machine learning methods performing automated variable selection for learning sparse predictive models. There are multiple reasons for promoting sparsity in the predictive models. By relying on a limited set of…

Machine Learning · Computer Science 2019-03-27 Magda Gregorova