中文
相关论文

相关论文: Multi-stage Convex Relaxation for Feature Selectio…

200 篇论文

In this paper, we investigate the problem of stochastic multi-level compositional optimization, where the objective function is a composition of multiple smooth but possibly non-convex functions. Existing methods for solving this problem…

机器学习 · 计算机科学 2022-10-20 Wei Jiang , Bokun Wang , Yibo Wang , Lijun Zhang , Tianbao Yang

Nonlinear convex problems arise in various areas of applied mathematics and engineering. Classical techniques such as the relaxed proximal point algorithm (PPA) and the prediction correction (PC) method were proposed for linearly…

最优化与控制 · 数学 2023-07-28 Sai Wang , Yi Gong

This letter proposes to estimate low-rank matrices by formulating a convex optimization problem with non-convex regularization. We employ parameterized non-convex penalty functions to estimate the non-zero singular values more accurately…

计算机视觉与模式识别 · 计算机科学 2016-04-14 Ankit Parekh , Ivan W. Selesnick

The Lasso is an attractive technique for regularization and variable selection for high-dimensional data, where the number of predictor variables $p_n$ is potentially much larger than the number of samples $n$. However, it was recently…

统计理论 · 数学 2009-03-02 Nicolai Meinshausen , Bin Yu

We study convex relaxations of the image labeling problem on a continuous domain with regularizers based on metric interaction potentials. The generic framework ensures existence of minimizers and covers a wide range of relaxations of the…

计算机视觉与模式识别 · 计算机科学 2011-03-02 Jan Lellmann , Christoph Schnörr

We propose several new nonsmooth Newton methods for solving convex composite optimization problems with polyhedral regularizers, while avoiding the computation of complicated second-order information on these functions. Under the…

最优化与控制 · 数学 2025-11-25 Tran T. A. Nghia , Nghia V. Vo , Khoa V. H. Vu

When the signal does not have a sparse structure but has sparsity under a certain transformation domain, Nam et al. \cite{NS} introduced the cosparse analysis model, which provides a dual perspective on the sparse representation model. This…

最优化与控制 · 数学 2023-11-27 Zisheng Liu , Ting Zhang

In optimization-based image restoration models, the correct selection of hyperparameters is crucial for achieving superior performance. However, current research typically involves manual tuning of these hyperparameters, which is highly…

最优化与控制 · 数学 2026-04-03 Hang Xie , Xuewen Li , Peili Li , Qiuyu Wang

Feature selection problems have been extensively studied for linear estimation, for instance, Lasso, but less emphasis has been placed on feature selection for non-linear functions. In this study, we propose a method for feature selection…

机器学习 · 计算机科学 2020-07-28 Yutaro Yamada , Ofir Lindenbaum , Sahand Negahban , Yuval Kluger

Flexible sparsity regularization means stably approximating sparse solutions of operator equations by using coefficient-dependent penalizations. We propose and analyse a general nonconvex approach in this respect, from both theoretical and…

最优化与控制 · 数学 2021-11-12 Daria Ghilli , Dirk A. Lorenz , Elena Resmerita

This paper tackles the challenging problem of finding global optimal solutions for two-stage stochastic programs with continuous decision variables and nonconvex recourse functions. We introduce a two-phase approach. The first phase…

最优化与控制 · 数学 2024-05-29 Suhan Zhong , Ying Cui , Jiawang Nie

As a natural extension of compressive sensing and the requirement of some practical problems, Phaseless Compressed Sensing (PCS) has been introduced and studied recently. Many theoretical results have been obtained for PCS with the aid of…

最优化与控制 · 数学 2017-02-02 Guowei You , Zheng-Hai Huang , Yong Wang

We study theoretical properties of regularized robust M-estimators, applicable when data are drawn from a sparse high-dimensional linear model and contaminated by heavy-tailed distributions and/or outliers in the additive errors and…

统计理论 · 数学 2015-01-05 Po-Ling Loh

The problem of low-rank approximation with convex constraints, which appears in data analysis, system identification, model order reduction, low-order controller design and low-complexity modelling is considered. Given a matrix, the…

最优化与控制 · 数学 2018-11-12 Christian Grussler , Anders Rantzer , Pontus Giselsson

Passive synthetic aperture radar (SAR) uses existing signals of opportunity such as communication and broadcasting signals. In our prior work, we have developed a low-rank matrix recovery (LRMR) method that can reconstruct scenes with…

计算工程、金融与科学 · 计算机科学 2017-11-10 Eric Mason , Birsen Yazici

Despite widespread adoption in practice, guarantees for the LASSO and Group LASSO are strikingly lacking in settings beyond statistical problems, and these algorithms are usually considered to be a heuristic in the context of sparse convex…

机器学习 · 计算机科学 2023-07-17 Kyriakos Axiotis , Taisuke Yasuda

Range-only (RO) pose estimation involves determining a robot's pose over time by measuring the distance between multiple devices on the robot, known as tags, and devices installed in the environment, known as anchors. The nonconvex nature…

机器人学 · 计算机科学 2024-01-09 Abhishek Goudar , Frederike Dümbgen , Timothy D. Barfoot , Angela P. Schoellig

In an ordinary feature selection procedure, a set of important features is obtained by solving an optimization problem such as the Lasso regression problem, and we expect that the obtained features explain the data well. In this study,…

机器学习 · 统计学 2018-10-16 Satoshi Hara , Takanori Maehara

In generalized linear regression problems with an abundant number of features, lasso-type regularization which imposes an $\ell^1$-constraint on the regression coefficients has become a widely established technique. Deficiencies of the…

应用统计 · 统计学 2010-11-11 Martin Slawski , Wolfgang zu Castell , Gerhard Tutz

Recent work established that rank overparameterization eliminates spurious local minima in nonconvex low-rank matrix recovery under the restricted isometry property (RIP). But this does not fully explain the practical success of…

最优化与控制 · 数学 2025-05-07 Richard Y. Zhang