English
Related papers

Related papers: Provable More Data Hurt in High Dimensional Least …

200 papers

Estimation is the computational task of recovering a hidden parameter $x$ associated with a distribution $D_x$, given a measurement $y$ sampled from the distribution. High dimensional estimation problems arise naturally in statistics,…

Data Structures and Algorithms · Computer Science 2019-08-07 Prasad Raghavendra , Tselil Schramm , David Steurer

In multivariate or spatial extremes, inference for max-stable processes observed at a large collection of locations is among the most challenging problems in computational statistics, and current approaches typically rely on less expensive…

Computation · Statistics 2015-08-20 Stefano Castruccio , Raphaël Huser , Marc Genton

Recent advances in statistics introduced versions of the central limit theorem for high-dimensional vectors, allowing for the construction of confidence regions for high-dimensional parameters. In this note, $s$-sparsely convex…

Statistics Theory · Mathematics 2021-05-20 Sven Klaassen

High-dimensional multivariate longitudinal data, which arise when many outcome variables are measured repeatedly over time, are becoming increasingly common in social, behavioral and health sciences. We propose a latent variable model for…

Methodology · Statistics 2025-12-09 Sze Ming Lee , Yunxiao Chen , Tony Sit

We study square loss in a realizable time-series framework with martingale difference noise. Our main result is a fast rate excess risk bound which shows that whenever a trajectory hypercontractivity condition holds, the risk of the…

Machine Learning · Computer Science 2024-06-14 Ingvar Ziemann , Stephen Tu

We show through case studies that it is easier to estimate the fundamental limits of data processing than to construct explicit algorithms to achieve those limits. Focusing on binary classification, data compression, and prediction under…

Information Theory · Computer Science 2017-10-03 Jiantao Jiao , Yanjun Han , Irena Fischer-Hwang , Tsachy Weissman

The purpose of this paper is to explain the interest and importance of (approximate) models and model selection in Statistics. Starting from the very elementary example of histograms we present a general notion of finite dimensional model…

Statistics Theory · Mathematics 2007-06-13 Lucien Birgé

In a previous article, a least square regression estimation procedure was proposed: first, we condiser a family of functions and study the properties of an estimator in every unidimensionnal model defined by one of these functions; we then…

Statistics Theory · Mathematics 2007-06-13 Pierre Alquier

Recently emerging large-scale biomedical data pose exciting opportunities for scientific discoveries. However, the ultrahigh dimensionality and non-negligible measurement errors in the data may create difficulties in estimation. There are…

Methodology · Statistics 2022-10-28 Xin Ma , Suprateek Kundu

We investigate the theoretical foundations of a recently introduced entropy-based formulation of weighted least squares for the approximation of overdetermined linear systems, motivated by robust data fitting in the presence of sparse gross…

Numerical Analysis · Mathematics 2026-03-17 Felice Iavernaro , Monica Lazzo , Lorenzo Pisani

We study the problem of estimating an unknown deterministic signal that is observed through an unknown deterministic data matrix under additive noise. In particular, we present a minimax optimization framework to the least squares problems,…

Systems and Control · Computer Science 2014-04-28 N. Denizcan Vanli , Mehmet A. Donmez , Suleyman S. Kozat

We study the problem of list-decodable linear regression, where an adversary can corrupt a majority of the examples. Specifically, we are given a set $T$ of labeled examples $(x, y) \in \mathbb{R}^d \times \mathbb{R}$ and a parameter $0<…

Data Structures and Algorithms · Computer Science 2021-06-18 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia , Thanasis Pittas , Alistair Stewart

Central limit theorems play an important role in the study of statistical inference for stochastic processes. However, when the nonparametric local polynomial threshold estimator, especially local linear case, is employed to estimate the…

Probability · Mathematics 2017-02-06 Yuping Song , Hanchao Wang

As a specific proportional hazard rates model, sequential order statistics can be used to describe the lifetimes of load-sharing systems. Inference for these systems needs to account for small sample sizes, which are prevalent in…

Methodology · Statistics 2019-09-17 Fabian Mies , Stefan Bedbur

We develop a new approach for the estimation of a multivariate function based on the economic axioms of quasiconvexity (and monotonicity). On the computational side, we prove the existence of the quasiconvex constrained least squares…

Methodology · Statistics 2023-10-24 Somabha Mukherjee , Rohit K. Patra , Andrew L. Johnson , Hiroshi Morita

We describe stochastic Newton and stochastic quasi-Newton approaches to efficiently solve large linear least-squares problems where the very large data sets present a significant computational burden (e.g., the size may exceed computer…

Numerical Analysis · Mathematics 2017-02-27 Julianne Chung , Matthias Chung , J. Tanner Slagel , Luis Tenorio

In linear regression we wish to estimate the optimum linear least squares predictor for a distribution over $d$-dimensional input points and real-valued responses, based on a small sample. Under standard random design analysis, where the…

Machine Learning · Statistics 2022-06-08 Michał Dereziński , Manfred K. Warmuth , Daniel Hsu

This paper considers a finite sample perspective on the problem of identifying an LTI system from a finite set of possible systems using trajectory data. To this end, we use the maximum likelihood estimator to identify the true system and…

Systems and Control · Electrical Eng. & Systems 2024-12-03 Nicolas Chatzikiriakos , Andrea Iannelli

We prove an almost sure weak limit theorem for simple linear rank statistics for samples with continuous distributions functions. As a corollary the result extends to samples with ties, and the vector version of an a.s. central limit…

Methodology · Statistics 2013-05-13 Manfred Denker , Lucia Tabacu

For the class of stationary Gaussian long memory processes, we study some properties of the least-squares predictor of X_{n+1} based on (X_n, ..., X_1). The predictor is obtained by projecting X_{n+1} onto the finite past and the…

Statistics Theory · Mathematics 2008-02-14 Fanny Godet