中文
相关论文

相关论文: Minimax rate of testing in sparse linear regressio…

200 篇论文

Consider the Gaussian vector model with mean value {\theta}. We study the twin problems of estimating the number |{\theta}|_0 of non-zero components of {\theta} and testing whether |{\theta}|_0 is smaller than some value. For testing, we…

统计理论 · 数学 2017-03-02 Alexandra Carpentier , Nicolas Verzelen

We quantify the minimax rate for a nonparametric regression model over a star-shaped function class $\mathcal{F}$ with bounded diameter. We obtain a minimax rate of ${\varepsilon^{\ast}}^2\wedge\mathrm{diam}(\mathcal{F})^2$ where…

统计理论 · 数学 2025-08-20 Akshay Prasadan , Matey Neykov

The aim of this paper is to establish non-asymptotic minimax rates of testing for goodness-of-fit hypotheses in a heteroscedastic setting. More precisely, we deal with sequences $(Y_j)_{j\in J}$ of independent Gaussian random variables,…

统计理论 · 数学 2010-02-09 Béatrice Laurent , Jean-Michel Loubès , Clément Marteau

We consider nonparametric testing in a non-asymptotic framework. Our statistical guarantees are exact in the sense that Type I and II errors are controlled for any finite sample size. Meanwhile, one proposed test is shown to achieve minimax…

统计理论 · 数学 2017-02-07 Yun Yang , Zuofeng Shang , Guang Cheng

We consider parameter estimation under sparse linear regression -- an extensively studied problem in high-dimensional statistics and compressed sensing. While the minimax framework has been one of the most fundamental approaches for…

统计理论 · 数学 2025-01-24 Shubhangi Ghosh , Yilin Guo , Haolei Weng , Arian Maleki

We consider the problem of robustly testing the norm of a high-dimensional sparse signal vector under two different observation models. In the first model, we are given $n$ i.i.d. samples from the distribution…

信息论 · 计算机科学 2022-11-08 Anand Jerry George , Clément L. Canonne

Sparse linear regression is one of the most basic questions in machine learning and statistics. Here, we are given as input a design matrix $X \in \mathbb{R}^{N \times d}$ and measurements or labels ${y} \in \mathbb{R}^N$ where ${y} = {X}…

机器学习 · 计算机科学 2025-11-11 Gautam Chandrasekaran , Raghu Meka , Konstantinos Stavropoulos

Estimating linear, mean-square continuous functionals is a pivotal challenge in statistics. In high-dimensional contexts, this estimation is often performed under the assumption of exact model sparsity, meaning that only a small number of…

统计理论 · 数学 2025-08-04 Jelena Bradic , Victor Chernozhukov , Whitney K. Newey , Yinchu Zhu

We propose new methods for multivariate linear regression when the regression coefficient matrix is sparse and the error covariance matrix is dense. We assume that the error covariance matrix has equicorrelation across the response…

统计方法学 · 统计学 2025-08-13 Daeyoung Ham , Bradley S. Price , Adam J. Rothman

We consider a nonlinear polynomial regression model in which we wish to test the null hypothesis of structural stability in the regression parameters against the alternative of a break at an unknown time. We derive the extreme value…

统计理论 · 数学 2008-10-23 Alexander Aue , Lajos Horváth , Marie Hušková , Piotr Kokoszka

This work is a re-examination of the sparse Bayesian learning (SBL) of linear regression models of Tipping (2001) in a high-dimensional setting. We propose a hard-thresholded version of the SBL estimator that achieves, for orthogonal design…

统计方法学 · 统计学 2015-02-12 Yves Atchade , Chia Chye Yee

This paper suggests a nonparametric scheme to find the sparse solution of the underdetermined system of linear equations in the presence of unknown impulsive or non-Gaussian noise. This approach is robust against any variations of the noise…

计算机视觉与模式识别 · 计算机科学 2012-01-16 Mahmoud Ramezani Mayiami , Babak Seyfe

The problem of sparse linear regression is relevant in the context of linear system identification from large datasets. When data are collected from real-world experiments, measurements are always affected by perturbations or low-precision…

最优化与控制 · 数学 2020-04-01 S. M. Fosson , V. Cerone , D. Regruto

Missing values in datasets are common in applied statistics. For regression problems, theoretical work thus far has largely considered the issue of missing covariates as distinct from missing responses. However, in practice, many datasets…

统计理论 · 数学 2026-02-17 Benedict M. Risebrow , Thomas B. Berrett

We consider the design of a linear sensing system with a fixed energy budget assuming that the sampling noise is the dominant noise source. The energy constraint implies that the signal energy per measurement decreases linearly with the…

信号处理 · 电气工程与系统科学 2019-05-22 Yang Lu , Wei Dai , Yonina C. Eldar

This paper gives a theoretical analysis of high dimensional linear discrimination of Gaussian data. We study the excess risk of linear discriminant rules. We emphasis on the poor performances of standard procedures in the case when…

统计理论 · 数学 2010-02-19 Robin Girard

We consider a model where a signal (discrete or continuous) is observed with an additive Gaussian noise process. The signal is issued from a linear combination of a finite but increasing number of translated features. The features are…

统计理论 · 数学 2024-07-23 Cristina Butucea , Jean-François Delmas , Anne Dutfoy , Clément Hardy

We propose a methodology for testing linear hypothesis in high-dimensional linear models. The proposed test does not impose any restriction on the size of the model, i.e. model sparsity or the loading vector representing the hypothesis.…

统计方法学 · 统计学 2019-07-09 Yinchu Zhu , Jelena Bradic

This paper proposes a fast and accurate method for sparse regression in the presence of missing data. The underlying statistical model encapsulates the low-dimensional structure of the incomplete data matrix and the sparsity of the…

机器学习 · 统计学 2015-03-31 Ravi Ganti , Rebecca M. Willett

We present a sparse analogue to stochastic gradient descent that is guaranteed to perform well under similar conditions to the lasso. In the linear regression setup with irrepresentable noise features, our algorithm recovers the support set…

统计理论 · 数学 2014-12-16 Jacob Steinhardt , Stefan Wager , Percy Liang