English
Related papers

Related papers: The bias of isotonic regression

200 papers

We consider a linear regression problem in a high dimensional setting where the number of covariates $p$ can be much larger than the sample size $n$. In such a situation, one often assumes sparsity of the regression vector, \textit i.e.,…

Statistics Theory · Mathematics 2011-10-12 Mohamed Hebiri , Sara A. Van De Geer

We study the linear ill-posed inverse problem with noisy data in the statistical learning setting. Approximate reconstructions from random noisy data are sought with general regularization schemes in Hilbert scale. We discuss the rates of…

Statistics Theory · Mathematics 2024-04-09 Abhishake Rastogi , Peter Mathé

Analysis of non-asymptotic estimation error and structured statistical recovery based on norm regularized regression, such as Lasso, needs to consider four aspects: the norm, the loss function, the design matrix, and the noise model. This…

Machine Learning · Statistics 2015-12-01 Arindam Banerjee , Sheng Chen , Farideh Fazayeli , Vidyashankar Sivakumar

Scaling describes how a given quantity $Y$ that characterizes a system varies with its size $P$. For most complex systems it is of the form $Y\sim P^\beta$ with a nontrivial value of the exponent $\beta$, usually determined by regression…

Physics and Society · Physics 2019-10-16 Marc Barthelemy

We study the matrix denoising problem of estimating the singular vectors of a rank-$1$ signal corrupted by noise with both column and row correlations. Existing works are either unable to pinpoint the exact asymptotic estimation error or,…

Statistics Theory · Mathematics 2024-10-29 Yihan Zhang , Marco Mondelli

It has been suggested that an information geometric view of statistical mechanics in which a metric is introduced onto the space of parameters provides an interesting alternative characterisation of the phase structure, particularly in the…

Statistical Mechanics · Physics 2009-11-07 W. Janke , D. A. Johnston , Ranasinghe P. K. C. Malmini

Consider the multiple linear regression model $y_{i} = \boldsymbol{x}'_{i} \boldsymbol{\beta} + \epsilon_{i}$, where $\epsilon_i$'s are independent and identically distributed random variables, $\mathbf{x}_i$'s are known design vectors and…

Statistics Theory · Mathematics 2017-12-19 Debraj Das , Soumendra Nath Lahiri

This paper is concerned with inference about low-dimensional components of a high-dimensional parameter vector $\beta^0$ which is identified through instrumental variables. We allow for eigenvalues of the expected outer product of included…

Econometrics · Economics 2020-08-05 Christoph Breunig , Enno Mammen , Anna Simoni

In various statistical settings, the goal is to estimate a function which is restricted by the statistical model only through a conditional moment restriction. Prominent examples include the nonparametric instrumental variable framework for…

Methodology · Statistics 2025-05-28 AmirEmad Ghassami , James M. Robins , Andrea Rotnitzky

We study the fundamental problem of estimating the mean of a $d$-dimensional distribution with covariance $\Sigma \preccurlyeq \sigma^2 I_d$ given $n$ samples. When $d = 1$, \cite{catoni} showed an estimator with error $(1+o(1)) \cdot…

Statistics Theory · Mathematics 2024-02-20 Shivam Gupta , Samuel B. Hopkins , Eric Price

Insurance pricing systems should fulfill the auto-calibration property to ensure that there is no systematic cross-financing between different price cohorts. Often, regression models are not auto-calibrated. We propose to apply isotonic…

Methodology · Statistics 2023-01-10 Mario V. Wüthrich , Johanna Ziegel

Recent algebraic parametric estimation techniques led to point-wise derivative estimates by using only the iterated integral of a noisy observation signal. In this paper, we extend such differentiation methods by providing a larger choice…

Numerical Analysis · Mathematics 2011-03-04 Da-Yan Liu , Olivier Gibaru , Wilfrid Perruquetti

We consider the estimation of an n-dimensional vector s from the noisy element-wise measurements of $\mathbf{s}\mathbf{s}^T$, a generic problem that arises in statistics and machine learning. We study a mismatched Bayesian inference…

Information Theory · Computer Science 2021-09-14 Farzad Pourkamali , Nicolas Macris

We consider the problem of estimating the mean of a normal distribution under the following constraint: the estimator can access only a single bit from each sample from this distribution. We study the squared error risk in this estimation…

Statistics Theory · Mathematics 2017-10-12 Alon Kipnis , John C. Duchi

There has been substantial recent work on methods for estimating the slope function in linear regression for functional data analysis. However, as in the case of more conventional finite-dimensional regression, much of the practical…

Statistics Theory · Mathematics 2007-06-13 T. Tony Cai , Peter Hall

We study the high-dimensional linear model with noise distribution known up to a scale parameter. With an $\ell_1$-penalty on the regression coefficients, we show that a transformation of the log-likelihood allows for a choice of the tuning…

Statistics Theory · Mathematics 2025-12-23 Sara van de Geer , Sylvain Sardy , Maximę van Cutsem

This paper investigates tradeoffs among optimization errors, statistical rates of convergence and the effect of heavy-tailed errors for high-dimensional robust regression with nonconvex regularization. When the additive errors in linear…

Statistics Theory · Mathematics 2021-01-01 Xiaoou Pan , Qiang Sun , Wen-Xin Zhou

We abstract the concept of a randomized controlled trial (RCT) as a triple (beta,b,s), where beta is the primary efficacy parameter, b the estimate and s the standard error (s>0). The parameter beta is either a difference of means, a log…

Methodology · Statistics 2020-12-01 Erik van Zwet , Simon Schwab , Stephen Senn

The Hoover index is a widely used measure of inequality with an intuitive interpretation, yet little is known about the finite-sample properties of its empirical estimator. In this paper, we derive a simple expression for the expected value…

Methodology · Statistics 2026-03-03 Roberto Vila , Helton Saulo

We consider the problem of linear fitting of noisy data in the case of broad (say $\alpha$-stable) distributions of random impacts ("noise"), which can lack even the first moment. This situation, common in statistical physics of small…

Data Analysis, Statistics and Probability · Physics 2015-05-27 Eugene B. Postnikov , Igor M. Sokolov