中文
相关论文

相关论文: Calibrated zero-norm regularized LS estimator for …

200 篇论文

For the problem of high-dimensional sparse linear regression, it is known that an $\ell_0$-based estimator can achieve a $1/n$ "fast" rate on the prediction error without any conditions on the design matrix, whereas in absence of…

统计理论 · 数学 2015-12-01 Yuchen Zhang , Martin J. Wainwright , Michael I. Jordan

We provide a principled way for investigators to analyze randomized experiments when the number of covariates is large. Investigators often use linear multivariate regression to analyze randomized experiments instead of simply reporting the…

统计理论 · 数学 2022-06-08 Adam Bloniarz , Hanzhong Liu , Cun-Hui Zhang , Jasjeet Sekhon , Bin Yu

We propose a new algorithm for estimating NARMAX models with $L_1$ regularization for models represented as a linear combination of basis functions. Due to the $L_1$-norm penalty the Lasso estimation tends to produce some coefficients that…

系统与控制 · 计算机科学 2018-02-27 Antônio H. Ribeiro , Luis A. Aguirre

Estimating covariance matrices with high-dimensional complex data presents significant challenges, particularly concerning positive definiteness, sparsity, and numerical stability. Existing robust sparse estimators often fail to guarantee…

统计方法学 · 统计学 2025-12-30 Shaoxin Wang , Ziyun Ma

Learning sparse models from data is an important task in all those frameworks where relevant information should be identified within a large dataset. This can be achieved by formulating and solving suitable sparsity promoting optimization…

最优化与控制 · 数学 2025-02-18 V. Cerone , S. M. Fosson , D. Regruto , A. Salam

We consider a high-dimensional linear regression problem. Unlike many papers on the topic, we do not require sparsity of the regression coefficients; instead, our main structural assumption is a decay of eigenvalues of the covariance matrix…

统计理论 · 数学 2021-10-01 Igor Silin , Jianqing Fan

Finding an unconstrained and statistically interpretable reparameterization of a covariance matrix is still an open problem in statistics. Its solution is of central importance in covariance estimation, particularly in the recent…

统计方法学 · 统计学 2012-02-09 Mohsen Pourahmadi

High-dimensional regression often suffers from heavy-tailed noise and outliers, which can severely undermine the reliability of least-squares based methods. To improve robustness, we adopt a non-smooth Wilcoxon score based rank objective…

机器学习 · 统计学 2026-01-29 Meixia Lin , Meijiao Shi , Yunhai Xiao , Qian Zhang

The least absolute shrinkage and selection operator (Lasso) is a popular method for high-dimensional statistics. However, it is known that the Lasso often has estimation bias and prediction error. To address such disadvantages, many…

统计方法学 · 统计学 2026-04-29 Guo Liu

We consider high-dimensional measurement errors with high-frequency data. Our objective is on recovering the high-dimensional cross-sectional covariance matrix of the random errors with optimality. In this problem, not all components of the…

统计理论 · 数学 2024-04-03 Jinyuan Chang , Qiao Hu , Cheng Liu , Cheng Yong Tang

In high dimensional sparse regression, pivotal estimators are estimators for which the optimal regularization parameter is independent of the noise level. The canonical pivotal estimator is the square-root Lasso, formulated along with its…

机器学习 · 统计学 2020-09-04 Mathurin Massias , Quentin Bertrand , Alexandre Gramfort , Joseph Salmon

This paper presents a new method for estimating high dimensional covariance matrices. The method, permuted rank-penalized least-squares (PRLS), is based on a Kronecker product series expansion of the true covariance matrix. Assuming an…

统计方法学 · 统计学 2013-12-25 Theodoros Tsiligkaridis , Alfred O. Hero

Variance estimation in the linear model when $p > n$ is a difficult problem. Standard least squares estimation techniques do not apply. Several variance estimators have been proposed in the literature, all with accompanying asymptotic…

统计方法学 · 统计学 2014-01-30 Stephen Reid , Robert Tibshirani , Jerome Friedman

In the field of statistical learning and data analysis, estimating precision matrices (i.e., the inverse of covariance matrices) is a critical task, particularly for understanding dependency structures among variables. However, traditional…

统计方法学 · 统计学 2026-05-15 Zhongfeng Qin , Hao Xu , Wenhao Cui , Wan Tian

Least Absolute Deviations (LAD) regression provides a robust alternative to ordinary least squares by minimizing the sum of absolute residuals. However, its widespread use has been limited by the computational cost of existing solvers,…

统计方法学 · 统计学 2026-03-23 Zehaan Naik , Debasis Kundu

We consider statistical inference for a single coordinate of regression coefficients in high-dimensional linear models. Recently, the debiased estimators are popularly used for constructing confidence intervals and hypothesis testing in…

统计理论 · 数学 2020-10-20 Sai Li

Asymmetry along with heteroscedasticity or contamination often occurs with the growth of data dimensionality. In ultra-high dimensional data analysis, such irregular settings are usually overlooked for both theoretical and computational…

统计理论 · 数学 2022-07-20 Bin Luo , Xiaoli Gao

We introduce and study the Group Square-Root Lasso (GSRL) method for estimation in high dimensional sparse regression models with group structure. The new estimator minimizes the square root of the residual sum of squares plus a penalty…

统计理论 · 数学 2013-08-01 Florentina Bunea , Johannes Lederer , Yiyuan She

Consider a regression model with infinitely many parameters and time series errors. We are interested in choosing weights for averaging across generalized least squares (GLS) estimators obtained from a set of approximating models. However,…

统计理论 · 数学 2016-10-05 Tzu-Chang F. Cheng , Ching-Kang Ing , Shu-Hui Yu

An asymptotically optimal blind calibration scheme of uniform linear arrays for narrowband Gaussian signals is proposed. Rather than taking the direct Maximum Likelihood (ML) approach for joint estimation of all the unknown model…

信号处理 · 电气工程与系统科学 2020-09-01 Amir Weiss , Arie Yeredor