English
Related papers

Related papers: Non-asymptotic error controlled sparse high dimens…

200 papers

In the high dimensional regression analysis when the number of predictors is much larger than the sample size, an important question is to select the important variable which are relevant to the response variable of interest. Variable…

Methodology · Statistics 2023-01-09 Pengsheng Ji , Zhigen Zhao

In typical high dimensional statistical inference problems, confidence intervals and hypothesis tests are performed for a low dimensional subset of model parameters under the assumption that the parameters of interest are unconstrained.…

Methodology · Statistics 2019-11-19 Ming Yu , Varun Gupta , Mladen Kolar

High-dimensional regression models with regularized sparse estimation are widely applied. For statistical inferences, debiased methods are available about single coefficients or predictions with sparse new covariate vectors (also called…

Statistics Theory · Mathematics 2025-07-16 Libin Liang , Zhiqiang Tan

This paper proposes a new algorithm for multiple sparse regression in high dimensions, where the task is to estimate the support and values of several (typically related) sparse vectors from a few noisy linear measurements. Our algorithm is…

Machine Learning · Statistics 2012-06-08 Ali Jalali , Sujay Sanghavi

In this manuscript a unified framework for conducting inference on complex aggregated data in high dimensional settings is proposed. The data are assumed to be a collection of multiple non-Gaussian realizations with underlying undirected…

Applications · Statistics 2013-10-14 Fang Han , Han Liu , Brian Caffo

This paper studies Graphical SLOPE for precision matrix estimation, with emphasis on its ability to recover both sparsity and clusters of edges with equal or similar strength. In a fixed-dimensional regime, we establish that the root-$n$…

Statistics Theory · Mathematics 2026-04-15 Ivan Hejný , Giovanni Bonaccolto , Philipp Kremer , Sandra Paterlini , Małgorzata Bogdan , Jonas Wallin

Line spectral estimation theory aims to estimate the off-the-grid spectral components of a time signal with optimal precision. Recent results have shown that it is possible to recover signals having sparse line spectra from few temporal…

Information Theory · Computer Science 2017-01-31 Maxime Ferreira Da Costa , Wei Dai

Multivariate Gaussian is often used as a first approximation to the distribution of high-dimensional data. Determining the parameters of this distribution under various constraints is a widely studied problem in statistics, and is often…

Statistics Theory · Mathematics 2016-02-09 Samuel Balmand , Arnak Dalalyan

This paper studies the sparse identification problem of unknown sparse parameter vectors in stochastic dynamic systems. Firstly, a novel sparse identification algorithm is proposed, which can generate sparse estimates based on least squares…

Optimization and Control · Mathematics 2024-04-02 Ziming Wang , Xinghua Zhu

We examine the linear regression problem in a challenging high-dimensional setting with correlated predictors where the vector of coefficients can vary from sparse to dense. In this setting, we propose a combination of probabilistic…

Methodology · Statistics 2025-05-13 Roman Parzer , Peter Filzmoser , Laura Vana-Gür

In this paper, we show a way to exploit sparsity in the problem data in a primal-dual potential reduction method for solving a class of semidefinite programs. When the problem data is sparse, the dual variable is also sparse, but the primal…

Numerical Analysis · Mathematics 2025-10-20 Gun Srijuntongsiri , Stephen A. Vavasis

In this paper, we study high-dimensional estimation from truncated samples. We focus on two fundamental and classical problems: (i) inference of sparse Gaussian graphical models and (ii) support recovery of sparse linear models. (i) For…

Machine Learning · Statistics 2020-06-18 Arnab Bhattacharyya , Rathin Desai , Sai Ganesh Nagarajan , Ioannis Panageas

Count data is prevalent in various fields like ecology, medical research, and genomics. In high-dimensional settings, where the number of features exceeds the sample size, feature selection becomes essential. While frequentist methods like…

Methodology · Statistics 2024-10-22 The Tien Mai

We consider Gaussian mixture models in high dimensions and concentrate on the twin tasks of detection and feature selection. Under sparsity assumptions on the difference in means, we derive information bounds and establish the performance…

Statistics Theory · Mathematics 2016-10-04 Nicolas Verzelen , Ery Arias-Castro

We consider sparsity-based techniques for the approximation of high-dimensional functions from random pointwise evaluations. To date, almost all the works published in this field contain some a priori assumptions about the error corrupting…

Numerical Analysis · Mathematics 2019-05-10 Ben Adcock , Anyi Bao , Simone Brugiapaglia

Large-scale precision matrix estimation is of fundamental importance yet challenging in many contemporary applications for recovering Gaussian graphical models. In this paper, we suggest a new approach of innovated scalable efficient…

Methodology · Statistics 2016-05-12 Yingying Fan , Jinchi Lv

Nonnegative matrix factorization is a powerful technique to realize dimension reduction and pattern recognition through single-layer data representation learning. Deep learning, however, with its carefully designed hierarchical structure,…

Computer Vision and Pattern Recognition · Computer Science 2017-07-31 Zhenxing Guo , Shihua Zhang

Sparse estimation of the precision matrix under high-dimensional scaling constitutes a canonical problem in statistics and machine learning. Numerous regression and likelihood based approaches, many frequentist and some Bayesian in nature…

Methodology · Statistics 2020-05-20 Peyman Jalali , Kshitij Khare , George Michailidis

Repeated measurements are common in many fields, where random variables are observed repeatedly across different subjects. Such data have an underlying hierarchical structure, and it is of interest to learn covariance/correlation at…

Methodology · Statistics 2023-06-13 Sunpeng Duan , Guo Yu , Juntao Duan , Yuedong Wang

The real-life data have a complex and non-linear structure due to their nature. These non-linearities and the large number of features can usually cause problems such as the empty-space phenomenon and the well-known curse of dimensionality.…

Machine Learning · Computer Science 2025-03-13 Kadir Özçoban , Murat Manguoğlu , Emrullah Fatih Yetkin