中文
相关论文

相关论文: Does SLOPE outperform bridge regression?

200 篇论文

We consider machine learning techniques to develop low-latency approximate solutions to a class of inverse problems. More precisely, we use a probabilistic approach for the problem of recovering sparse stochastic signals that are members of…

信息论 · 计算机科学 2016-09-06 Steffen Limmer , Sławomir Stańczak

Recent results from compressive sampling (CS) have demonstrated that accurate reconstruction of sparse signals often requires far fewer samples than suggested by the classical Nyquist--Shannon sampling theorem. Typically, signal…

流体动力学 · 物理学 2014-04-24 Gudmundur F. Adalsteinsson , Nicholas K. -R. Kevlahan

This paper proposes a fast and accurate method for sparse regression in the presence of missing data. The underlying statistical model encapsulates the low-dimensional structure of the incomplete data matrix and the sparsity of the…

机器学习 · 统计学 2015-03-31 Ravi Ganti , Rebecca M. Willett

We introduce a financial portfolio optimization framework that allows us to automatically select the relevant assets and estimate their weights by relying on a sorted $\ell_1$-Norm penalization, henceforth SLOPE. Our approach is able to…

投资组合管理 · 定量金融 2021-07-30 Philipp J. Kremer , Sangkyun Lee , Malgorzata Bogdan , Sandra Paterlini

In high dimension, it is customary to consider Lasso-type estimators to enforce sparsity. For standard Lasso theory to hold, the regularization parameter should be proportional to the noise level, yet the latter is generally unknown in…

机器学习 · 统计学 2017-10-19 Mathurin Massias , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

We study nonasymptotic minimax estimation of the linear functional $L(\theta)=\eta^\top \theta$ for a high-dimensional $s$-sparse mean vector with an arbitrary loading vector $\eta$. For symmetric noise with exponentially decaying tails, we…

统计理论 · 数学 2026-04-29 Jie Xie , Dongming Huang

This paper gives a precise characterization of the fundamental limits of adaptive sensing for diverse estimation and testing problems concerning sparse signals. We consider in particular the setting introduced in (IEEE Trans. Inform. Theory…

统计理论 · 数学 2014-10-16 Rui M. Castro

When the signal does not have a sparse structure but has sparsity under a certain transformation domain, Nam et al. \cite{NS} introduced the cosparse analysis model, which provides a dual perspective on the sparse representation model. This…

最优化与控制 · 数学 2023-11-27 Zisheng Liu , Ting Zhang

For the sparse vector model, we consider estimation of the target vector, of its L2-norm and of the noise variance. We construct adaptive estimators and establish the optimal rates of adaptive estimation when adaptation is considered with…

The Sorted L-One Estimator (SLOPE) is a popular regularization method in regression, which induces clustering of the estimated coefficients. That is, the estimator can have coefficients of identical magnitude. In this paper, we derive an…

统计理论 · 数学 2023-04-17 Ivan Hejný , Jonas Wallin , Małgorzata Bogdan

We consider estimating the Shannon entropy of a discrete distribution $P$ from $n$ i.i.d. samples. Recently, Jiao, Venkat, Han, and Weissman, and Wu and Yang constructed approximation theoretic estimators that achieve the minimax $L_2$…

信息论 · 计算机科学 2019-01-03 Yanjun Han , Jiantao Jiao , Tsachy Weissman

Precision matrix is of significant importance in a wide range of applications in multivariate analysis. This paper considers adaptive minimax estimation of sparse precision matrices in the high dimensional setting. Optimal rates of…

统计理论 · 数学 2012-12-13 T. Tony Cai , Weidong Liu , Harrison H. Zhou

In high-dimensional linear regression, the goal pursued here is to estimate an unknown regression function using linear combinations of a suitable set of covariates. One of the key assumptions for the success of any statistical procedure in…

统计理论 · 数学 2015-03-13 Philippe Rigollet , Alexandre Tsybakov

We consider the high-dimensional linear regression model and assume that a fraction of the measurements are altered by an adversary with complete knowledge of the data and the underlying distribution. We are interested in a scenario where…

统计理论 · 数学 2023-12-11 Stanislav Minsker , Mohamed Ndaoud , Lang Wang

We study the nested model averaging method on the solution path for a high-dimensional linear regression problem. In particular, we propose to combine model averaging with regularized estimators (e.g., lasso and SLOPE) on the solution path…

统计方法学 · 统计学 2020-05-19 Yang Feng , Qingfeng Liu

We develop a constructive approach to estimating sparse, high-dimensional linear regression models. The approach is a computational algorithm motivated from the KKT conditions for the $\ell_0$-penalized least squares solutions. It generates…

统计计算 · 统计学 2017-01-19 Jian Huang , Yuling Jiao , Yanyan Liu , Xiliang Lu

We introduce SpinSVAR, a novel method for estimating a structural vector autoregression (SVAR) from time-series data under sparse input assumption. Unlike prior approaches using Gaussian noise, we model the input as independent Laplacian…

机器学习 · 计算机科学 2025-02-24 Panagiotis Misiakos , Markus Püschel

Estimating linear, mean-square continuous functionals is a pivotal challenge in statistics. In high-dimensional contexts, this estimation is often performed under the assumption of exact model sparsity, meaning that only a small number of…

统计理论 · 数学 2025-08-04 Jelena Bradic , Victor Chernozhukov , Whitney K. Newey , Yinchu Zhu

The paper deals with the non-parametric estimation in the regression with the multiplicative noise. Using the local polynomial fitting and the bayesian approach, we construct the minimax on isotropic H\"older class estimator. Next applying…

统计理论 · 数学 2012-07-24 M. Chichignoud

We consider the sparse regression model where the number of parameters $p$ is larger than the sample size $n$. The difficulty when considering high-dimensional problems is to propose estimators achieving a good compromise between…

统计理论 · 数学 2011-03-15 Pierre Alquier , Karim Lounici