English
Related papers

Related papers: High-dimensional Asymptotics of Generalization Per…

200 papers

We study ridge estimation of the precision matrix in the high-dimensional setting where the number of variables is large relative to the sample size. We first review two archetypal ridge estimators and note that their utilized penalties do…

Methodology · Statistics 2016-06-17 Wessel N. van Wieringen , Carel F. W. Peeters

We consider statistical inference in high-dimensional regression problems under affine constraints on the parameter space. The theoretical study of this is motivated by the study of genetic determinants of diseases, such as diabetes, using…

We perform an average case analysis of the generalization dynamics of large neural networks trained using gradient descent. We study the practically-relevant "high-dimensional" regime where the number of free parameters in the network is on…

Machine Learning · Statistics 2017-10-11 Madhu S. Advani , Andrew M. Saxe

We propose statistical inferential procedures for panel data models with interactive fixed effects in a kernel ridge regression framework.Compared with traditional sieve methods, our method is automatic in the sense that it does not require…

Statistics Theory · Mathematics 2017-03-10 Shunan Zhao , Ruiqi Liu , Zuofeng Shang

We study the theoretical behavior of denoising score matching--the learning task associated to diffusion models--when the data distribution is supported on a low-dimensional manifold and the score is parameterized using a random feature…

Machine Learning · Computer Science 2026-04-14 Anand Jerry George , Nicolas Macris

In continual and lifelong learning, good representation learning can help increase performance and reduce sample complexity when learning new tasks. There is evidence that representations do not suffer from "catastrophic forgetting" even in…

Machine Learning · Computer Science 2022-05-27 Xiao Zhang , Dejing Dou , Ji Wu

In many, if not most, machine learning applications the training data is naturally heterogeneous (e.g. federated learning, adversarial attacks and domain adaptation in neural net training). Data heterogeneity is identified as one of the…

Machine Learning · Statistics 2025-04-30 Harsh Vardhan , Avishek Ghosh , Arya Mazumdar

Many applied settings in empirical economics involve simultaneous estimation of a large number of parameters. In particular, applied economists are often interested in estimating the effects of many-valued treatments (like teacher effects…

Machine Learning · Statistics 2017-04-03 Alberto Abadie , Maximilian Kasy

The asymptotically precise estimation of the generalization of kernel methods has recently received attention due to the parallels between neural networks and their associated kernels. However, prior works derive such estimates for training…

Machine Learning · Computer Science 2024-03-19 Maksim Velikanov , Maxim Panov , Dmitry Yarotsky

It is becoming increasingly common in regression to train neural networks that model the entire distribution even if only the mean is required for prediction. This additional modeling often comes with performance gain and the reasons behind…

Machine Learning · Computer Science 2024-10-22 Ehsan Imani , Kai Luedemann , Sam Scholnick-Hughes , Esraa Elelimy , Martha White

Information criteria, such as Akaike's information criterion and Bayesian information criterion are often applied in model selection. However, their asymptotic behaviors for selecting geostatistical regression models have not been well…

Statistics Theory · Mathematics 2014-12-03 Chih-Hao Chang , Hsin-Cheng Huang , Ching-Kang Ing

Learning to generalise from limited data is a fundamental challenge for both artificial and biological systems. A common strategy is to extract reusable structure from abundant unlabelled data, enabling efficient adaptation to new tasks…

Machine Learning · Computer Science 2026-05-20 Valentina Njaradi , Clémentine Dominé , Rachel Swanson , Marco Mondelli , Andrew Saxe

High-dimensional sparse modeling via regularization provides a powerful tool for analyzing large-scale data sets and obtaining meaningful, interpretable models. The use of nonconvex penalty functions shows advantage in selecting important…

Methodology · Statistics 2016-05-12 Zemin Zheng , Yingying Fan , Jinchi Lv

This paper studies the generalization performance of iterates obtained by Gradient Descent (GD), Stochastic Gradient Descent (SGD) and their proximal variants in high-dimensional robust regression problems. The number of features is…

Statistics Theory · Mathematics 2024-11-05 Kai Tan , Pierre C. Bellec

This work examines risk bounds for nonparametric distributional regression estimators. For convex-constrained distributional regression, general upper bounds are established for the continuous ranked probability score (CRPS) and the…

Deep neural networks often generalize well despite heavy over-parameterization, challenging classical parameter-based analyses. We study generalization from a representation-centric perspective and analyze how the geometry of learned…

Machine Learning · Computer Science 2026-02-02 Junjie Yu , Zhuoli Ouyang , Haotian Deng , Chen Wei , Wenxiao Ma , Jianyu Zhang , Zihan Deng , Quanying Liu

Continual learning (CL) has emerged as a dominant paradigm for acquiring knowledge from sequential tasks while avoiding catastrophic forgetting. Although many CL methods have been proposed to show impressive empirical performance, the…

Machine Learning · Computer Science 2026-01-07 Wen Wen , Tieliang Gong , Zeyu Gao , Yunjiao Zhang , Weizhan Zhang , Yong-Jin Liu

Existing theory suggests that for linear regression problems categorized by capacity and source conditions, gradient descent (GD) is always minimax optimal, while both ridge regression and online stochastic gradient descent (SGD) are…

Machine Learning · Statistics 2025-09-23 Jingfeng Wu , Peter L. Bartlett , Jason D. Lee , Sham M. Kakade , Bin Yu

A Two-Stage approach is described that literally "straighten outs" any potentially nonlinear relationship between a y-outcome variable and each of p = 2 or more potential x-predictor variables. The y-outcome is then predicted from all p of…

Methodology · Statistics 2023-10-03 Robert L. Obenchain

In recent years, model collapse has become a critical issue in language model training, making it essential to understand the underlying mechanisms driving this phenomenon. In this paper, we investigate recursive parametric model training…

Machine Learning · Statistics 2025-05-23 Shirong Xu , Hengzhi He , Guang Cheng