English
Related papers

Related papers: Minimax estimation of linear and quadratic functio…

200 papers

This note addresses the question of optimally estimating a linear functional of an object acquired through linear observations corrupted by random noise, where optimality pertains to a worst-case setting tied to a symmetric, convex, and…

Statistics Theory · Mathematics 2023-08-01 Simon Foucart , Grigoris Paouris

In this paper, the estimation problem for sparse reduced rank regression (SRRR) model is considered. The SRRR model is widely used for dimension reduction and variable selection with applications in signal processing, econometrics, etc. The…

Machine Learning · Statistics 2018-03-21 Ziping Zhao , Daniel P. Palomar

The Lasso is an attractive technique for regularization and variable selection for high-dimensional data, where the number of predictor variables $p_n$ is potentially much larger than the number of samples $n$. However, it was recently…

Statistics Theory · Mathematics 2009-03-02 Nicolai Meinshausen , Bin Yu

This paper deals with sparse phase retrieval, i.e., the problem of estimating a vector from quadratic measurements under the assumption that few components are nonzero. In particular, we consider the problem of finding the sparsest vector…

Information Theory · Computer Science 2014-02-25 Fabien Lauer , Henrik Ohlsson

We consider the class of convex minimization problems, composed of a self-concordant function, such as the $\log\det$ metric, a convex data fidelity term $h(\cdot)$ and, a regularizing -- possibly non-smooth -- function $g(\cdot)$. This…

Machine Learning · Statistics 2014-05-14 Anastasios Kyrillidis , Rabeeh Karimi Mahabadi , Quoc Tran-Dinh , Volkan Cevher

Thus far, sparse representations have been exploited largely in the context of robustly estimating functions in a noisy environment from a few measurements. In this context, the existence of a basis in which the signal class under…

Data Structures and Algorithms · Computer Science 2009-06-26 Mohamed-Ali Belabbas , Patrick J. Wolfe

We deal with the problem of optimal estimation of the linear functionals constructed from unobserved values of a continuous time stochastic process with periodically correlated increments based on past observations of this process. To solve…

Statistics Theory · Mathematics 2023-04-25 Maksym Luz , Mikhail Moklyachuk

Functional linear discriminant analysis offers a simple yet efficient method for classification, with the possibility of achieving a perfect classification. Several methods are proposed in the literature that mostly address the…

Methodology · Statistics 2020-12-14 Juhyun Park , Jeongyoun Ahn , Yongho Jeon

We consider the estimation of the value of a linear functional of the slope parameter in functional linear regression, where scalar responses are modeled in dependence of random functions. In Johannes and Schenk [2010] it has been shown…

Statistics Theory · Mathematics 2011-12-14 Jan Johannes , Rudolf Schenk

In this paper we consider the problem of estimating simultaneously low-rank and row-wise sparse matrices from nested linear measurements where the linear operator consists of the product of a linear operator $\mathcal{W}$ and a matrix…

Statistics Theory · Mathematics 2016-03-22 Sohail Bahmani , Justin Romberg

Motivated by portfolio allocation and linear discriminant analysis, we consider estimating a functional $\mathbf{\mu}^T \mathbf{\Sigma}^{-1} \mathbf{\mu}$ involving both the mean vector $\mathbf{\mu}$ and covariance matrix…

Statistics Theory · Mathematics 2021-02-12 Jianqing Fan , Haolei Weng , Yifeng Zhou

This paper considers the sample-efficiency of preference learning, which models and predicts human choices based on comparative judgments. The minimax optimal estimation error rate $\Theta(d/n)$ in classical estimation theory requires that…

Machine Learning · Computer Science 2025-06-05 Yunzhen Yao , Lie He , Michael Gastpar

Sparse linear regression is one of the classical and extensively studied problems in high-dimensional statistics and compressed sensing. Despite the substantial body of literature dedicated to this problem, the precise determination of its…

Statistics Theory · Mathematics 2024-05-10 Yilin Guo , Shubhangi Ghosh , Haolei Weng , Arian Maleki

In high-dimensional linear regression, the goal pursued here is to estimate an unknown regression function using linear combinations of a suitable set of covariates. One of the key assumptions for the success of any statistical procedure in…

Statistics Theory · Mathematics 2015-03-13 Philippe Rigollet , Alexandre Tsybakov

This paper considers estimation of sparse covariance matrices and establishes the optimal rate of convergence under a range of matrix operator norm and Bregman divergence losses. A major focus is on the derivation of a rate sharp minimax…

Statistics Theory · Mathematics 2013-02-14 T. Tony Cai , Harrison H. Zhou

We study sparse linear regression over a network of agents, modeled as an undirected graph (with no centralized node). The estimation problem is formulated as the minimization of the sum of the local LASSO loss functions plus a quadratic…

Machine Learning · Computer Science 2023-06-23 Yao Ji , Gesualdo Scutari , Ying Sun , Harsha Honnappa

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a small number of noisy linear measurements is an important problem in compressed sensing. In this paper, the high-dimensional setting is considered. It is shown…

Information Theory · Computer Science 2013-02-06 Galen Reeves , Michael Gastpar

In this paper, we focus on the high-dimensional double sparse structure, where the parameter of interest simultaneously encourages group-wise sparsity and element-wise sparsity in each group. By combining the Gilbert-Varshamov bound and its…

Statistics Theory · Mathematics 2023-07-19 Zhifan Li , Yanhang Zhang , Jianxin Yin

We consider the nonparametric estimation problem of time-dependent multivariate functions observed in a presence of additive cylindrical Gaussian white noise of a small intensity. We derive minimax lower bounds for the $L^2$-risk in the…

Statistics Theory · Mathematics 2012-11-02 Jérémie Bigot , Theofanis Sapatinas

Sparse additive models are an attractive choice in circumstances calling for modelling flexibility in the face of high dimensionality. We study the signal detection problem and establish the minimax separation rate for the detection of a…

Statistics Theory · Mathematics 2024-10-03 Subhodh Kotekal , Chao Gao
‹ Prev 1 3 4 5 6 7 10 Next ›