English
Related papers

Related papers: Universality in block dependent linear models with…

200 papers

Maximum margin binary classification is one of the most fundamental algorithms in machine learning, yet the role of featurization maps and the high-dimensional asymptotics of the misclassification error for non-Gaussian features are still…

Statistics Theory · Mathematics 2023-10-03 Andrea Montanari , Feng Ruan , Basil Saeed , Youngtak Sohn

Meta-learning involves training models on a variety of training tasks in a way that enables them to generalize well on new, unseen test tasks. In this work, we consider meta-learning within the framework of high-dimensional multivariate…

Statistics Theory · Mathematics 2024-04-01 Yanhao Jin , Krishnakumar Balasubramanian , Debashis Paul

Gibbs-ERM learning is a natural idealized model of learning with stochastic optimization algorithms (such as Stochastic Gradient Langevin Dynamics and ---to some extent--- Stochastic Gradient Descent), while it also arises in other…

Machine Learning · Computer Science 2019-02-06 Ilja Kuzborskij , Nicolò Cesa-Bianchi , Csaba Szepesvári

Let $X=C+\mathrm{E}$ with a deterministic matrix $C\in\R^{M\times M}$ and $\mathrm{E}$ some centered Gaussian $M\times M$-matrix whose entries are independent with variance $\sigma^2$. In the present work, the accuracy of reduced-rank…

Probability · Mathematics 2012-05-08 Angelika Rohde

In the setting of high-dimensional linear models with Gaussian noise, we investigate the possibility of confidence statements connected to model selection. Although there exist numerous procedures for adaptive point estimation, the…

Statistics Theory · Mathematics 2009-10-07 Angelika Rohde , Lutz Duembgen

Optimal transport and Wasserstein distances are flourishing in many scientific fields as a means for comparing and connecting random structures. Here we pioneer the use of an optimal transport distance between L\'{e}vy measures to solve a…

Statistics Theory · Mathematics 2023-09-18 Marta Catalano , Hugo Lavenant , Antonio Lijoi , Igor Prünster

Uniform asymptotic confidence bands for a multivariate regression function in an inverse regression model with a convolution-type operator are constructed. The results are derived using strong approximation methods and a limit theorem for…

Statistics Theory · Mathematics 2015-04-08 Katharina Proksch , Nicolai Bissantz , Holger Dette

We propose a general method for constructing confidence intervals and statistical tests for single or low-dimensional components of a large parameter vector in a high-dimensional model. It can be easily adjusted for multiplicity taking…

Statistics Theory · Mathematics 2014-06-24 Sara van de Geer , Peter Bühlmann , Ya'acov Ritov , Ruben Dezeure

This paper considers the estimation of treatment effects in randomized experiments with complex experimental designs, including cases with interference between units. We develop a design-based estimation theory for arbitrary experimental…

Econometrics · Economics 2025-05-27 Haoge Chang

This paper introduces an econometric framework for analyzing cross-sectional dependence in the idiosyncratic volatilities of assets using high frequency data. We first consider the estimation of standard measures of dependence in the…

Econometrics · Economics 2025-05-08 Ilze Kalnina , Kokouvi Tewou

Graphical models are widely used in scienti fic and engineering research to represent conditional independence structures between random variables. In many controlled experiments, environmental changes or external stimuli can often alter…

Machine Learning · Computer Science 2012-03-19 Bai Zhang , Yue Wang

Crossover designs randomly assign each unit to receive a sequence of treatments. By comparing outcomes within the same unit, these designs can effectively eliminate between-unit variation and facilitate the identification of both…

Methodology · Statistics 2026-04-21 Zhichao Jiang , Peng Ding

The method of instrumental variables provides a fundamental and practical tool for causal inference in many empirical studies where unmeasured confounding between the treatments and the outcome is present. Modern data such as the genetical…

Methodology · Statistics 2022-10-28 Ziang Niu , Yuwen Gu , Wei Li

The paper introduces robust independence tests with non-asymptotically guaranteed significance levels for stochastic linear time-invariant systems, assuming that the observed outputs are synchronous, which means that the systems are driven…

Machine Learning · Statistics 2023-08-07 Ambrus Tamás , Dániel Ágoston Bálint , Balázs Csanád Csáji

We prove a universality theorem for learning with random features. Our result shows that, in terms of training and generalization errors, a random feature model with a nonlinear activation function is asymptotically equivalent to a…

Information Theory · Computer Science 2022-11-01 Hong Hu , Yue M. Lu

The regression discontinuity (RD) design is a popular approach to causal inference in non-randomized studies. This is because it can be used to identify and estimate causal effects under mild conditions. Specifically, for each subject, the…

Methodology · Statistics 2014-02-11 George Karabatsos , Stephen G. Walker

Primordial non-Gaussianity introduces a scale-dependent variation in the clustering of density peaks corresponding to rare objects. This variation, parametrized by the bias, is investigated on scales where a linear perturbation theory is…

Cosmology and Nongalactic Astrophysics · Physics 2011-04-22 Sirichai Chongchitnan , Joseph Silk

Most high-dimensional estimation and prediction methods propose to minimize a cost function (empirical risk) that is written as a sum of losses associated to each data point. In this paper we focus on the case of non-convex losses, which is…

Machine Learning · Statistics 2017-01-17 Song Mei , Yu Bai , Andrea Montanari

This paper studies inference for the mean vector of a high-dimensional $U$-statistic. In the era of Big Data, the dimension $d$ of the $U$-statistic and the sample size $n$ of the observations tend to be both large, and the computation of…

Statistics Theory · Mathematics 2019-01-29 Xiaohui Chen , Kengo Kato

In this article, we investigate the asymptotic properties of Bayesian multiple testing procedures under general dependent setup, when the sample size and the number of hypotheses both tend to infinity. Specifically, we investigate strong…

Statistics Theory · Mathematics 2020-05-14 Noirrit Kiran Chandra , Sourabh Bhattacharya
‹ Prev 1 3 4 5 6 7 10 Next ›