English
Related papers

Related papers: High-Dimensional Kernel Methods under Covariate Sh…

200 papers

Distributed learning is an effective way to analyze big data. In distributed regression, a typical approach is to divide the big data into multiple blocks, apply a base regression algorithm on each of them, and then simply average the…

Machine Learning · Computer Science 2017-08-08 Zhengchu Guo , Lei Shi , Qiang Wu

In the covariate shift learning scenario, the training and test covariate distributions differ, so that a predictor's average loss over the training and test distributions also differ. In this work, we explore the potential of extreme…

Machine Learning · Computer Science 2018-03-13 Fulton Wang , Cynthia Rudin

Random matrix theory has become a widely useful tool in high-dimensional statistics and theoretical machine learning. However, random matrix theory is largely focused on the proportional asymptotics in which the number of columns grows…

Statistics Theory · Mathematics 2025-06-23 Chen Cheng , Andrea Montanari

Lossy data transformations by definition lose information. Yet, in modern machine learning, methods like data pruning and lossy data augmentation can help improve generalization performance. We study this paradox using a solvable model of…

Statistical Mechanics · Physics 2025-09-19 Alex Nguyen , David J. Schwab , Vudtiwat Ngampruetikorn

The estimation of large covariance matrices has a high dimensional bias. Correcting for this bias can be reformulated via the tool of Free Probability Theory as a free deconvolution. The goal of this work is a computational and statistical…

Probability · Mathematics 2023-05-10 Reda Chhaibi , Fabrice Gamboa , Slim Kammoun , Mauricio Velasco

Kernel methods for deconvolution have attractive features, and prevail in the literature. However, they have disadvantages, which include the fact that they are usually suitable only for cases where the error distribution is infinitely…

Statistics Theory · Mathematics 2009-09-29 Peter Hall , Alexander Meister

This paper investigates the critical role of eigenalignments between the kernel matrix and learning targets in achieving robust generalization in learning problems. We establish a direct connection between generalization performance in…

Machine Learning · Statistics 2026-05-18 Yang Liu , Ernest Fokoue , Richard Lange , Daniel Krutz

Data exhibiting heavy-tails in one or more dimensions is often studied using the framework of regular variation. In a multivariate setting this requires identifying specific forms of dependence in the data; this means identifying that the…

Statistics Theory · Mathematics 2017-02-02 Bikramjit Das , Sidney I. Resnick

Regularization is an essential element of virtually all kernel methods for nonparametric regression problems. A critical factor in the effectiveness of a given kernel method is the type of regularization that is employed. This article…

Statistics Theory · Mathematics 2016-05-31 Lee H. Dicker , Dean P. Foster , Daniel Hsu

Random feature ridge regression is often analyzed in the high-dimensional regime under the homogeneous sampling model $x_i=\Sigma^{1/2}x_i'$, where the vectors $x_i'$ have iid entries and the same covariance matrix $\Sigma$ is shared by all…

Machine Learning · Statistics 2026-05-19 Issa-Mbenard Dabo , Jérémie Bigot

Kernel estimation techniques, such as mean shift, suffer from one major drawback: the kernel bandwidth selection. The bandwidth can be fixed for all the data set or can vary at each points. Automatic bandwidth selection becomes a real…

Computer Vision and Pattern Recognition · Computer Science 2011-11-10 Aurelie Bugeau , Patrick Pérez

In many important statistical analyses, the number of covariates $p$ often exceeds the data size $n$, a regime commonly referred to as high-dimensional. While considerable progress has been made in high-dimensional regression under the…

Methodology · Statistics 2026-05-29 Herman Tesso , Georges Nguefack-Tsague

Spectral algorithms leverage spectral regularization techniques to analyze and process data, providing a flexible framework for addressing supervised learning problems. To deepen our understanding of their performance in real-world…

Machine Learning · Statistics 2025-07-23 Jun Fan , Zheng-Chu Guo , Lei Shi

This paper investigates when the importance weighting (IW) correction is needed to address covariate shift, a common situation in supervised learning where the input distributions of training and test data differ. Classic results show that…

Machine Learning · Statistics 2023-03-08 Davit Gogolashvili , Matteo Zecchin , Motonobu Kanagawa , Marios Kountouris , Maurizio Filippone

Polynomial kernel regression is one of the standard and state-of-the-art learning strategies. However, as is well known, the choices of the degree of polynomial kernel and the regularization parameter are still open in the realm of model…

Machine Learning · Computer Science 2023-06-14 Shaobo Lin , Xingping Sun , Zongben Xu , Jinshan Zeng

Reduced modeling in high-dimensional reproducing kernel Hilbert spaces offers the opportunity to approximate efficiently non-linear dynamics. In this work, we devise an algorithm based on low rank constraint optimization and kernel-based…

Machine Learning · Computer Science 2020-02-23 Patrick Heas , Cedric Herzet , Benoit Combes

High-dimensional linear regression has been thoroughly studied in the context of independent and identically distributed data. We propose to investigate high-dimensional regression models for independent but non-identically distributed…

Statistics Theory · Mathematics 2026-05-20 Jérémie Bigot , Issa-Mbenard Dabo , Camille Male

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

Modern regression problems often involve high-dimensional data and a careful tuning of the regularization hyperparameters is crucial to avoid overly complex models that may overfit the training data while guaranteeing desirable properties…

Machine Learning · Computer Science 2026-04-08 Maria-Florina Balcan , Saumya Goyal , Dravyansh Sharma

Consider a scenario where we have access to train data with both covariates and outcomes while test data only contains covariates. In this scenario, our primary aim is to predict the missing outcomes of the test data. With this objective in…

Methodology · Statistics 2024-10-29 Masahiro Kato , Kota Matsui , Ryo Inokuchi