English
Related papers

Related papers: Rational Optimization for Nonlinear Reconstruction…

200 papers

In numerous substitution models for the $\l_{0}$-norm minimization problem $(P_{0})$, the $\l_{p}$-norm minimization $(P_{p})$ with $0<p<1$ have been considered as the most natural choice. However, the non-convex optimization problem…

Optimization and Control · Mathematics 2018-04-27 Angang Cui , Jigen Peng , Haiyang Li

We consider the problem of estimating the parameters of a Gaussian or binary distribution in such a way that the resulting undirected graphical model is sparse. Our approach is to solve a maximum likelihood problem with an added l_1-norm…

Artificial Intelligence · Computer Science 2007-07-06 Onureena Banerjee , Laurent El Ghaoui , Alexandre d'Aspremont

In this paper, we investigate the matrix estimation problem in the multi-response regression model with measurement errors. A nonconvex error-corrected estimator based on a combination of the amended loss function and the nuclear norm…

Statistics Theory · Mathematics 2022-09-19 Xin Li , Dongya Wu

In this paper we build provably near-optimal, in the minimax sense, estimates of linear forms and, more generally, "$N$-convex functionals" (the simplest example being the maximum of several fractional-linear functions) of unknown "signal"…

Statistics Theory · Mathematics 2019-04-01 Anatoli Juditsky , Arkadi Nemirovski

This two-part paper is concerned with the problem of minimizing a linear objective function subject to a bilinear matrix inequality (BMI) constraint. In this part, we first consider a family of convex relaxations which transform BMI…

Optimization and Control · Mathematics 2018-09-27 Mohsen Kheirandishfard , Fariba Zohrizadeh , Ramtin Madani

The most widely used form of convolutional sparse coding uses an $\ell_1$ regularization term. While this approach has been successful in a variety of applications, a limitation of the $\ell_1$ penalty is that it is homogeneous across the…

Computer Vision and Pattern Recognition · Computer Science 2017-11-09 Brendt Wohlberg

Convex optimization with sparsity-promoting convex regularization is a standard approach for estimating sparse signals in noise. In order to promote sparsity more strongly than convex regularization, it is also standard practice to employ…

Computer Vision and Pattern Recognition · Computer Science 2015-06-17 Po-Yu Chen , Ivan W. Selesnick

We study high-dimensional estimators with the trimmed $\ell_1$ penalty, which leaves the $h$ largest parameter entries penalty-free. While optimization techniques for this nonconvex penalty have been studied, the statistical properties have…

Statistics Theory · Mathematics 2019-05-14 Jihun Yun , Peng Zheng , Eunho Yang , Aurelie Lozano , Aleksandr Aravkin

In this paper, we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints are locally smooth. For solving this problem, we propose a…

Optimization and Control · Mathematics 2025-05-08 Lahcen El Bourkhissi , Ion Necoara

The de-facto standard approach of promoting sparsity by means of $\ell_1$-regularization becomes ineffective in the presence of simplex constraints, i.e.,~the target is known to have non-negative entries summing up to a given constant. The…

Methodology · Statistics 2016-05-04 Ping Li , Syama Sundar Rangapuram , Martin Slawski

We study parameter estimation and asymptotic inference for sparse nonlinear regression. More specifically, we assume the data are given by $y = f( x^\top \beta^* ) + \epsilon$, where $f$ is nonlinear. To recover $\beta^*$, we propose an…

Machine Learning · Statistics 2015-11-17 Zhuoran Yang , Zhaoran Wang , Han Liu , Yonina C. Eldar , Tong Zhang

In this paper, we aim at recovering an unknown signal x0 from noisy L1measurements y=Phi*x0+w, where Phi is an ill-conditioned or singular linear operator and w accounts for some noise. To regularize such an ill-posed inverse problem, we…

Statistics Theory · Mathematics 2013-11-05 Samuel Vaiter , Charles Deledalle , Gabriel Peyré , Charles Dossal , Jalal Fadili

Compressed sensing has shown that it is possible to reconstruct sparse high dimensional signals from few linear measurements. In many cases, the solution can be obtained by solving an L1-minimization problem, and this method is accurate…

Numerical Analysis · Mathematics 2009-04-27 Deanna Needell

Techniques involving factorization are found in a wide range of applications and have enjoyed significant empirical success in many fields. However, common to a vast majority of these problems is the significant disadvantage that the…

Numerical Analysis · Computer Science 2015-06-26 Benjamin D. Haeffele , Rene Vidal

This paper develops a unified nonconvex optimization framework for the design of group-sparse feedback controllers in infinite-horizon linear-quadratic (LQ) problems. We address two prominent extensions of the classical LQ problem: the…

Optimization and Control · Mathematics 2025-08-06 Lechen Feng , Xun Li , Yuan-Hua Ni

We consider a convex optimization problem with many linear inequality constraints. To deal with a large number of constraints, we provide a penalty reformulation of the problem, where the penalty is a variant of the one-sided Huber loss…

Optimization and Control · Mathematics 2023-11-03 Angelia Nedich , Tatiana Tatarenko

This paper concerns the problem of matrix completion, which is to estimate a matrix from observations in a small subset of indices. We propose a calibrated spectrum elastic net method with a sum of the nuclear and Frobenius penalties and…

Statistics Theory · Mathematics 2012-11-13 Tingni Sun , Cun-Hui Zhang

Detection of a signal under noise is a classical signal processing problem. When monitoring spatial phenomena under a fixed budget, i.e., either physical, economical or computational constraints, the selection of a subset of available…

Signal Processing · Electrical Eng. & Systems 2018-08-01 Mario Coutino , Sundeep Prabhakar Chepuri , Geert Leus

This paper is intended to solve the nonconvex $\ell_{p}$-ball constrained nonlinear optimization problems. An iteratively reweighted method is proposed, which solves a sequence of weighted $\ell_{1}$-ball projection subproblems. At each…

Optimization and Control · Mathematics 2024-10-28 Hao Wang , Xiangyu Yang , Wei Jiang

Compressed sensing aims at reconstructing sparse signals from significantly reduced number of samples, and a popular reconstruction approach is $\ell_1$-norm minimization. In this correspondence, a method called orthonormal expansion is…

Information Theory · Computer Science 2015-05-30 Zai Yang , Cishen Zhang , Jun Deng , Wenmiao Lu
‹ Prev 1 8 9 10 Next ›