中文
相关论文

相关论文: Sparse recovery in convex hulls via entropy penali…

200 篇论文

We consider a system of m linear equations in n variables Ax=b where A is a given m x n matrix and b is a given m-vector known to be equal to Ax' for some unknown solution x' that is integer and k-sparse: x' in {0,1}^n and exactly k entries…

信息论 · 计算机科学 2015-03-19 T. S. Jayram , Soumitra Pal , Vijay Arya

This paper proposes a new interpretation of sparse penalties such as the elastic-net and the group-lasso. Beyond providing a new viewpoint on these penalization schemes, our approach results in a unified optimization strategy. Our…

机器学习 · 统计学 2017-07-20 Yves Grandvalet , Julien Chiquet , Christophe Ambroise

The $\ell_1$ norm is the tight convex relaxation for the $\ell_0$ "norm" and has been successfully applied for recovering sparse signals. For problems with fewer samplings, one needs to enhance the sparsity by nonconvex penalties such as…

最优化与控制 · 数学 2016-01-05 Xiaolin Huang , Lei Shi , Ming Yan

This paper concerns solving the sparse deconvolution and demixing problem using $\ell_{1,2}$-minimization. We show that under a certain structured random model, robust and stable recovery is possible. The results extend results of Ling and…

统计理论 · 数学 2017-05-11 Axel Flinth

Probabilistic Coalition Structure Generation (PCSG) is NP-hard and can be recast as an $l_0$-type sparse recovery problem by representing coalition structures as sparse coefficient vectors over a coalition-incidence design. A natural…

计算机科学与博弈论 · 计算机科学 2026-01-12 Angshul Majumdar

Popular regularizers with non-differentiable penalties, such as Lasso, Elastic Net, Generalized Lasso, or SLOPE, reduce the dimension of the parameter space by inducing sparsity or clustering in the estimators' coordinates. In this paper,…

统计理论 · 数学 2025-01-03 Ivan Hejný , Jonas Wallin , Małgorzata Bogdan , Michał Kos

In this paper, we consider the problem of collaboratively estimating the sparsity pattern of a sparse signal with multiple measurement data in distributed networks. We assume that each node makes Compressive Sensing (CS) based measurements…

信息论 · 计算机科学 2012-11-29 Thakshila Wimalajeewa , Pramod K. Varshney

Many problems in classification involve huge numbers of irrelevant features. Model selection reveals the crucial features, reduces the dimensionality of feature space, and improves model interpretation. In the support vector machine…

统计方法学 · 统计学 2021-10-18 Alfonso Landeros , Kenneth Lange

We study high-dimensional estimators with the trimmed $\ell_1$ penalty, which leaves the $h$ largest parameter entries penalty-free. While optimization techniques for this nonconvex penalty have been studied, the statistical properties have…

统计理论 · 数学 2019-05-14 Jihun Yun , Peng Zheng , Eunho Yang , Aurelie Lozano , Aleksandr Aravkin

We consider the problem of estimating the parameters of a Gaussian or binary distribution in such a way that the resulting undirected graphical model is sparse. Our approach is to solve a maximum likelihood problem with an added l_1-norm…

人工智能 · 计算机科学 2007-07-06 Onureena Banerjee , Laurent El Ghaoui , Alexandre d'Aspremont

We consider observations $(X,y)$ from single index models with unknown link function, Gaussian covariates and a regularized M-estimator $\hat\beta$ constructed from convex loss function and regularizer. In the regime where sample size $n$…

统计理论 · 数学 2026-02-13 Pierre C Bellec

We study a sample complexity vs. conditioning tradeoff in modern signal recovery problems (including sparse recovery, low-rank matrix sensing, covariance estimation, and abstract phase retrieval), where convex optimization problems are…

最优化与控制 · 数学 2024-07-19 Lijun Ding , Alex L. Wang

In this paper, we aim at recovering an unknown signal x0 from noisy L1measurements y=Phi*x0+w, where Phi is an ill-conditioned or singular linear operator and w accounts for some noise. To regularize such an ill-posed inverse problem, we…

统计理论 · 数学 2013-11-05 Samuel Vaiter , Charles Deledalle , Gabriel Peyré , Charles Dossal , Jalal Fadili

Weighted $\ell_1$-minimization has been studied as a technique for the reconstruction of a sparse signal from compressively sampled measurements when prior information about the signal, in the form of a support estimate, is available. In…

信息论 · 计算机科学 2016-12-09 Deanna Needell , Rayan Saab , Tina Woolf

Sparse Gaussian graphical models characterize sparse dependence relationships between random variables in a network. To estimate multiple related Gaussian graphical models on the same set of variables, we formulate a hierarchical model,…

统计方法学 · 统计学 2014-06-10 Yuancheng Zhu , Rina Foygel Barber

Let $F$ be a finite model of cardinality $M$ and denote by $\operatorname {conv}(F)$ its convex hull. The problem of convex aggregation is to construct a procedure having a risk as close as possible to the minimal risk over $\operatorname…

统计理论 · 数学 2013-12-17 Guillaume Lecué

We develop and analyze stochastic optimization algorithms for problems in which the expected loss is strongly convex, and the optimum is (approximately) sparse. Previous approaches are able to exploit only one of these two structures,…

机器学习 · 统计学 2012-07-19 Alekh Agarwal , Sahand Negahban , Martin J. Wainwright

The idea of compressed sensing is to exploit representations in suitable (overcomplete) dictionaries that allow to recover signals far beyond the Nyquist rate provided that they admit a sparse representation in the respective dictionary.…

计算机视觉与模式识别 · 计算机科学 2018-06-22 Michael Moeller , Otmar Loffeld , Juergen Gall , Felix Krahmer

We consider the estimation of a sparse factor model where the factor loading matrix is assumed sparse. The estimation problem is reformulated as a penalized M-estimation criterion, while the restrictions for identifying the factor loading…

统计理论 · 数学 2025-01-23 Benjamin Poignard , Yoshikazu Terada

For two unlabeled graphs $G_1,G_2$ independently sub-sampled from an Erd\H{o}s-R\'enyi graph $\mathbf G(n,p)$ by keeping each edge with probability $s$, we aim to recover \emph{as many as possible} of the corresponding vertex pairs. We…

概率论 · 数学 2025-02-18 Hang Du