English
Related papers

Related papers: Multi-stage Convex Relaxation for Feature Selectio…

200 papers

In this paper, we investigate the problem of stochastic multi-level compositional optimization, where the objective function is a composition of multiple smooth but possibly non-convex functions. Existing methods for solving this problem…

Machine Learning · Computer Science 2022-10-20 Wei Jiang , Bokun Wang , Yibo Wang , Lijun Zhang , Tianbao Yang

Nonlinear convex problems arise in various areas of applied mathematics and engineering. Classical techniques such as the relaxed proximal point algorithm (PPA) and the prediction correction (PC) method were proposed for linearly…

Optimization and Control · Mathematics 2023-07-28 Sai Wang , Yi Gong

This letter proposes to estimate low-rank matrices by formulating a convex optimization problem with non-convex regularization. We employ parameterized non-convex penalty functions to estimate the non-zero singular values more accurately…

Computer Vision and Pattern Recognition · Computer Science 2016-04-14 Ankit Parekh , Ivan W. Selesnick

The Lasso is an attractive technique for regularization and variable selection for high-dimensional data, where the number of predictor variables $p_n$ is potentially much larger than the number of samples $n$. However, it was recently…

Statistics Theory · Mathematics 2009-03-02 Nicolai Meinshausen , Bin Yu

We study convex relaxations of the image labeling problem on a continuous domain with regularizers based on metric interaction potentials. The generic framework ensures existence of minimizers and covers a wide range of relaxations of the…

Computer Vision and Pattern Recognition · Computer Science 2011-03-02 Jan Lellmann , Christoph Schnörr

We propose several new nonsmooth Newton methods for solving convex composite optimization problems with polyhedral regularizers, while avoiding the computation of complicated second-order information on these functions. Under the…

Optimization and Control · Mathematics 2025-11-25 Tran T. A. Nghia , Nghia V. Vo , Khoa V. H. Vu

When the signal does not have a sparse structure but has sparsity under a certain transformation domain, Nam et al. \cite{NS} introduced the cosparse analysis model, which provides a dual perspective on the sparse representation model. This…

Optimization and Control · Mathematics 2023-11-27 Zisheng Liu , Ting Zhang

In optimization-based image restoration models, the correct selection of hyperparameters is crucial for achieving superior performance. However, current research typically involves manual tuning of these hyperparameters, which is highly…

Optimization and Control · Mathematics 2026-04-03 Hang Xie , Xuewen Li , Peili Li , Qiuyu Wang

Feature selection problems have been extensively studied for linear estimation, for instance, Lasso, but less emphasis has been placed on feature selection for non-linear functions. In this study, we propose a method for feature selection…

Machine Learning · Computer Science 2020-07-28 Yutaro Yamada , Ofir Lindenbaum , Sahand Negahban , Yuval Kluger

Flexible sparsity regularization means stably approximating sparse solutions of operator equations by using coefficient-dependent penalizations. We propose and analyse a general nonconvex approach in this respect, from both theoretical and…

Optimization and Control · Mathematics 2021-11-12 Daria Ghilli , Dirk A. Lorenz , Elena Resmerita

This paper tackles the challenging problem of finding global optimal solutions for two-stage stochastic programs with continuous decision variables and nonconvex recourse functions. We introduce a two-phase approach. The first phase…

Optimization and Control · Mathematics 2024-05-29 Suhan Zhong , Ying Cui , Jiawang Nie

As a natural extension of compressive sensing and the requirement of some practical problems, Phaseless Compressed Sensing (PCS) has been introduced and studied recently. Many theoretical results have been obtained for PCS with the aid of…

Optimization and Control · Mathematics 2017-02-02 Guowei You , Zheng-Hai Huang , Yong Wang

We study theoretical properties of regularized robust M-estimators, applicable when data are drawn from a sparse high-dimensional linear model and contaminated by heavy-tailed distributions and/or outliers in the additive errors and…

Statistics Theory · Mathematics 2015-01-05 Po-Ling Loh

The problem of low-rank approximation with convex constraints, which appears in data analysis, system identification, model order reduction, low-order controller design and low-complexity modelling is considered. Given a matrix, the…

Optimization and Control · Mathematics 2018-11-12 Christian Grussler , Anders Rantzer , Pontus Giselsson

Passive synthetic aperture radar (SAR) uses existing signals of opportunity such as communication and broadcasting signals. In our prior work, we have developed a low-rank matrix recovery (LRMR) method that can reconstruct scenes with…

Computational Engineering, Finance, and Science · Computer Science 2017-11-10 Eric Mason , Birsen Yazici

Despite widespread adoption in practice, guarantees for the LASSO and Group LASSO are strikingly lacking in settings beyond statistical problems, and these algorithms are usually considered to be a heuristic in the context of sparse convex…

Machine Learning · Computer Science 2023-07-17 Kyriakos Axiotis , Taisuke Yasuda

Range-only (RO) pose estimation involves determining a robot's pose over time by measuring the distance between multiple devices on the robot, known as tags, and devices installed in the environment, known as anchors. The nonconvex nature…

Robotics · Computer Science 2024-01-09 Abhishek Goudar , Frederike Dümbgen , Timothy D. Barfoot , Angela P. Schoellig

In an ordinary feature selection procedure, a set of important features is obtained by solving an optimization problem such as the Lasso regression problem, and we expect that the obtained features explain the data well. In this study,…

Machine Learning · Statistics 2018-10-16 Satoshi Hara , Takanori Maehara

In generalized linear regression problems with an abundant number of features, lasso-type regularization which imposes an $\ell^1$-constraint on the regression coefficients has become a widely established technique. Deficiencies of the…

Applications · Statistics 2010-11-11 Martin Slawski , Wolfgang zu Castell , Gerhard Tutz

Recent work established that rank overparameterization eliminates spurious local minima in nonconvex low-rank matrix recovery under the restricted isometry property (RIP). But this does not fully explain the practical success of…

Optimization and Control · Mathematics 2025-05-07 Richard Y. Zhang