中文
相关论文

相关论文: Multi-stage Convex Relaxation for Feature Selectio…

200 篇论文

In this work, we consider a class of differentiable criteria for sparse image computing problems, where a nonconvex regularization is applied to an arbitrary linear transform of the target image. As special cases, it includes…

最优化与控制 · 数学 2013-08-27 Emilie Chouzenoux , Anna Jezierska , Jean-Christophe Pesquet , Hugues Talbot

We report on progress in algorithms for iterative phase retrieval. The theory of convex optimization is used to develop and to gain insight into counterparts for the nonconvex problem of phase retrieval. We propose a relaxation of averaged…

最优化与控制 · 数学 2009-11-10 D. Russell Luke

Concave regularization methods provide natural procedures for sparse recovery. However, they are difficult to analyze in the high dimensional setting. Only recently a few sparse recovery results have been established for some specific local…

机器学习 · 统计学 2012-02-14 Cun-Hui Zhang , Tong Zhang

We investigate the effectiveness of convex relaxation and nonconvex optimization in solving bilinear systems of equations under two different designs (i.e.$~$a sort of random Fourier design and Gaussian design). Despite the wide…

机器学习 · 统计学 2021-07-14 Yuxin Chen , Jianqing Fan , Bingyan Wang , Yuling Yan

In sparse regression modeling via regularization such as the lasso, it is important to select appropriate values of tuning parameters including regularization parameters. The choice of tuning parameters can be viewed as a model selection…

统计方法学 · 统计学 2012-01-05 Kei Hirose , Shohei Tateishi , Sadanori Konishi

For various applications, the relations between the dependent and independent variables are highly nonlinear. Consequently, for large scale complex problems, neural networks and regression trees are commonly preferred over linear models…

机器学习 · 计算机科学 2017-05-23 Samet Oymak , Mehrdad Mahdavi , Jiasi Chen

We propose a new approach to the recovery of binary signals in compressed sensing, based on the local minimization of a non-convex cost functional. The desired signal is proved to be a local minimum of the functional under mild conditions…

最优化与控制 · 数学 2018-11-08 Sophie M. Fosson

Simultaneous feature selection and non-linear function estimation is challenging in modeling, especially in high-dimensional settings where the number of variables exceeds the available sample size. In this article, we investigate the…

机器学习 · 统计学 2026-01-05 Bin Luo , Susan Halabi

We study convex relaxation algorithms for phase retrieval on imaging problems. We show that structural assumptions on the signal and the observations, such as sparsity, smoothness or positivity, can be exploited to both speed-up convergence…

最优化与控制 · 数学 2014-04-09 Fajwel Fogel , Irène Waldspurger , Alexandre d'Aspremont

High-dimensional learning problems, where the number of features exceeds the sample size, often require sparse regularization for effective prediction and variable selection. While established for fully supervised data, these techniques…

机器学习 · 计算机科学 2026-01-01 The Tien Mai , Mai Anh Nguyen , Trung Nghia Nguyen

Low-rank matrix recovery can be solved to statistical optimality by convex matrix optimization under the classical assumption of restricted isometry property (RIP). However, for large problems, the convex formulation is commonly replaced by…

最优化与控制 · 数学 2026-04-22 Andrew D. McRae , Richard Y. Zhang

Continuous optimization is an important problem in many areas of AI, including vision, robotics, probabilistic inference, and machine learning. Unfortunately, most real-world optimization problems are nonconvex, causing standard convex…

人工智能 · 计算机科学 2016-11-10 Abram L. Friesen , Pedro Domingos

Sparse feature selection has been demonstrated to be effective in handling high-dimensional data. While promising, most of the existing works use convex methods, which may be suboptimal in terms of the accuracy of feature selection and…

机器学习 · 计算机科学 2013-01-22 Shuo Xiang , Xiaotong Shen , Jieping Ye

A number of variable selection methods have been proposed involving nonconvex penalty functions. These methods, which include the smoothly clipped absolute deviation (SCAD) penalty and the minimax concave penalty (MCP), have been…

应用统计 · 统计学 2011-04-15 Patrick Breheny , Jian Huang

Real-valued Phase retrieval is a non-convex continuous inference problem, where a high-dimensional signal is to be reconstructed from a dataset of signless linear measurements. Focusing on the noiseless case, we aim to disentangle the two…

无序系统与神经网络 · 物理学 2025-02-07 Davide Straziota , Luca Saglietti

We develop tractable convex relaxations for rank-constrained quadratic optimization problems over $n \times m$ matrices, a setting for which tractable relaxations are typically only available when the objective or constraints admit spectral…

最优化与控制 · 数学 2026-05-22 Ryan Cory-Wright , Jean Pauphilet

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

机器学习 · 计算机科学 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

In this paper we study the $\ell_p$-analysis optimization ($0<p\leq1$) problem for cosparse signal recovery. We establish a bound for recovery error via the restricted $p$-isometry property over any subspace. We further prove that the…

信息论 · 计算机科学 2018-08-28 Shubao Zhang , Hui Qian , Xiaojin Gong , Jianying Zhou

In this paper, we review state-of-the-art methods for feature selection in statistics with an application-oriented eye. Indeed, sparsity is a valuable property and the profusion of research on the topic might have provided little guidance…

统计方法学 · 统计学 2021-11-08 Dimitris Bertsimas , Jean Pauphilet , Bart Van Parys

Non-Local Total Variation (NLTV) has emerged as a useful tool in variational methods for image recovery problems. In this paper, we extend the NLTV-based regularization to multicomponent images by taking advantage of the Structure Tensor…

计算机视觉与模式识别 · 计算机科学 2014-12-11 Giovanni Chierchia , Nelly Pustelnik , Beatrice Pesquet-Popescu , Jean-Christophe Pesquet