English
Related papers

Related papers: Multiscale Asymptotic Normality in Quantile Regres…

200 papers

The composite quantile regression (CQR) was introduced by Zou and Yuan [Ann. Statist. 36 (2008) 1108--1126] as a robust regression method for linear models with heavy-tailed errors while achieving high efficiency. Its penalized counterpart…

Methodology · Statistics 2023-10-16 Haeseong Moon , Wen-Xin Zhou

Causal inference from observational datasets often relies on measuring and adjusting for covariates. In practice, measurements of the covariates can often be noisy and/or biased, or only measurements of their proxies may be available.…

Machine Learning · Computer Science 2022-02-23 Wenshuo Guo , Mingzhang Yin , Yixin Wang , Michael I. Jordan

In real medical data, training samples typically show long-tailed distributions with multiple labels. Class distribution of the medical data has a long-tailed shape, in which the incidence of different diseases is quite varied, and at the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Wongi Park , Inhyuk Park , Sungeun Kim , Jongbin Ryu

We provide a unified analysis of the predictive risk of ridge regression and regularized discriminant analysis in a dense random effects model. We work in a high-dimensional asymptotic regime where $p, n \to \infty$ and $p/n \to \gamma \in…

Statistics Theory · Mathematics 2015-11-05 Edgar Dobriban , Stefan Wager

The subject of robust estimation in time series is widely discussed in literature. One of the approaches is to use GM-estimation. This method incorporates a broad class of nonparametric estimators which under suitable conditions includes…

Statistics Theory · Mathematics 2007-06-13 Alexander Alekseev

Consider sensitivity analysis for estimating average treatment effects under unmeasured confounding, assumed to satisfy a marginal sensitivity model. At the population level, we provide new representations for the sharp population bounds…

Methodology · Statistics 2022-09-26 Zhiqiang Tan

This paper considers a linear regression model with an endogenous regressor which arises from a nonlinear transformation of a latent variable. It is shown that the corresponding coefficient can be consistently estimated without external…

Econometrics · Economics 2023-11-08 Jörg Breitung , Alexander Mayer , Dominik Wied

For $k,m,n\in \mathbb{N}$, we consider $n^k\times n^k$ random matrices of the form $$ \mathcal{M}_{n,m,k}(\mathbf{y})=\sum_{\alpha=1}^m\tau_\alpha {Y_\alpha}Y_\alpha^T,\quad…

Probability · Mathematics 2017-01-27 Anna Lytova

$\ell_1$-penalized quantile regression is widely used for analyzing high-dimensional data with heterogeneity. It is now recognized that the $\ell_1$-penalty introduces non-negligible estimation bias, while a proper use of concave…

Methodology · Statistics 2021-09-14 Kean Ming Tan , Lan Wang , Wen-Xin Zhou

In the present paper we consider Laplace deconvolution for discrete noisy data observed on the interval whose length may increase with a sample size. Although this problem arises in a variety of applications, to the best of our knowledge,…

Statistics Theory · Mathematics 2013-01-15 Felix Abramovich , Marianna Pensky , Yves Rozenholc

We derived the closed-form asymptotic optimism of linear regression models under random designs, and generalizes it to kernel ridge regression. Using scaled asymptotic optimism as a generic predictive model complexity measure, we studied…

Machine Learning · Statistics 2025-08-19 Hengrui Luo , Yunzhang Zhu

We consider a regression framework where the design points are deterministic and the errors possibly non-i.i.d. and heavy-tailed (with a moment of order $p$ in $[1,2]$). Given a class of candidate regression functions, we propose a…

Statistics Theory · Mathematics 2025-06-03 Yannick Baraud , Guillaume Maillard

There is a recent and growing literature on large-width asymptotic and non-asymptotic properties of deep Gaussian neural networks (NNs), namely NNs with weights initialized as Gaussian distributions. For a Gaussian NN of depth $L\geq1$ and…

Machine Learning · Computer Science 2025-06-24 Alberto Bordino , Stefano Favaro , Sandra Fortini

The Central Limit Theorem (CLT) establishes that sufficiently large sequences of independent and identically distributed random variables converge in probability to a normal distribution. This makes the CLT a fundamental building block of…

Logic in Computer Science · Computer Science 2026-03-10 Henning Basold , Oisín Flynn-Connolly , Chase Ford , Hao Wang

Machine learning methods, particularly the double machine learning (DML) estimator (Chernozhukov et al., 2018), are increasingly popular for the estimation of the average treatment effect (ATE). However, datasets often exhibit unbalanced…

Econometrics · Economics 2024-06-12 Daniele Ballinari

This paper develops asymptotic theory for estimation of parameters in regression models for binomial response time series where serial dependence is present through a latent process. Use of generalized linear model (GLM) estimating…

Statistics Theory · Mathematics 2016-06-06 W. T. M. Dunsmuir , J. Y. He

We construct a family of estimators for a regression function based on a sample following a qdistribution. Our approach is nonparametric, using kernel methods built from operations that leverage the properties of q-calculus. Furthermore,…

Statistics Theory · Mathematics 2025-03-11 Emmanuel De Dieu Nkou , Fridolin Melong

As a competitive alternative to least squares regression, quantile regression is popular in analyzing heterogenous data. For quantile regression model specified for one single quantile level $\tau$, major difficulties of semiparametric…

Methodology · Statistics 2017-05-29 Kani Chen , Yuanyuan Lin , Zhanfeng Wang , Zhiliang Ying

This paper studies the multi-task high-dimensional linear regression models where the noise among different tasks is correlated, in the moderately high dimensional regime where sample size $n$ and dimension $p$ are of the same order. Our…

Statistics Theory · Mathematics 2022-06-16 Kai Tan , Gabriel Romon , Pierre C Bellec

Estimation of the average treatment effect (ATE) is a central problem in causal inference. In recent times, inference for the ATE in the presence of high-dimensional covariates has been extensively studied. Among the diverse approaches that…

Statistics Theory · Mathematics 2022-11-01 Kuanhao Jiang , Rajarshi Mukherjee , Subhabrata Sen , Pragya Sur