中文
相关论文

相关论文: Safe Feature Elimination for Non-Negativity Constr…

200 篇论文

We propose a new randomized algorithm for solving convex optimization problems that have a large number of constraints (with high probability). Existing methods like interior-point or Newton-type algorithms are hard to apply to such…

最优化与控制 · 数学 2020-03-25 Bo Wei , William B. Haskell , Sixiang Zhao

Modern second order solvers for convex optimisation, such as interior point methods, rely on primal dual information and are difficult to warm start, limiting their applicability in real time control. We propose the PVM, a duality free…

最优化与控制 · 数学 2026-01-14 Michael Cummins , Eric Kerrigan

We consider strongly convex optimization problems with affine-type restrictions. We build dual problem and solve dual problem by Fast Gradient Method. We use primal-dual structure of this method to construct the solution of the primal…

最优化与控制 · 数学 2017-06-23 Anton Anikin , Alexander Gasnikov , Pavel Dvurechensky , Alexander Turin , Alexey Chernov

This paper studies first-order algorithms for solving fully composite optimization problems over convex and compact sets. We leverage the structure of the objective by handling its differentiable and non-differentiable components…

最优化与控制 · 数学 2023-07-13 Maria-Luiza Vladarean , Nikita Doikov , Martin Jaggi , Nicolas Flammarion

In this paper, we introduce a class of nonsmooth nonconvex least square optimization problem using convex analysis tools and we propose to use the iterative minimization-majorization (MM) algorithm on a convex set with initializer away from…

最优化与控制 · 数学 2019-06-14 Azita Mayeli

In this paper, an inexact proximal-point penalty method is studied for constrained optimization problems, where the objective function is non-convex, and the constraint functions can also be non-convex. The proposed method approximately…

最优化与控制 · 数学 2020-12-02 Qihang Lin , Runchao Ma , Yangyang Xu

In this paper, we consider the problem of recovering a sparse signal based on penalized least squares formulations. We develop a novel algorithm of primal-dual active set type for a class of nonconvex sparsity-promoting penalties, including…

最优化与控制 · 数学 2019-02-28 Jian Huang , Yuling Jiao , Bangti Jin , Jin Liu , Xiliang Lu , Can Yang

Signal processing is rich in inherently continuous and often nonlinear applications, such as spectral estimation, optical imaging, and super-resolution microscopy, in which sparsity plays a key role in obtaining state-of-the-art results.…

机器学习 · 计算机科学 2020-03-23 Luiz F. O. Chamon , Yonina C. Eldar , Alejandro Ribeiro

We propose a primal-dual smoothing framework for finding a near-stationary point of a class of non-smooth non-convex optimization problems with max-structure. We analyze the primal and dual gradient complexities of the framework via two…

最优化与控制 · 数学 2023-07-19 Renbo Zhao

Incremental methods are widely utilized for solving finite-sum optimization problems in machine learning and signal processing. In this paper, we study a family of incremental methods -- including incremental subgradient, incremental…

最优化与控制 · 数学 2022-12-26 Xiao Li , Zhihui Zhu , Anthony Man-Cho So , Jason D Lee

In this work, we consider a class of differentiable criteria for sparse image computing problems, where a nonconvex regularization is applied to an arbitrary linear transform of the target image. As special cases, it includes…

最优化与控制 · 数学 2013-08-27 Emilie Chouzenoux , Anna Jezierska , Jean-Christophe Pesquet , Hugues Talbot

Screening rules allow to early discard irrelevant variables from the optimization in Lasso problems, or its derivatives, making solvers faster. In this paper, we propose new versions of the so-called $\textit{safe rules}$ for the Lasso.…

机器学习 · 统计学 2015-12-07 Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

We derive approximation algorithms for the nonnegative matrix factorization problem, i.e. the problem of factorizing a matrix as the product of two matrices with nonnegative coefficients. We form convex approximations of this problem which…

最优化与控制 · 数学 2012-07-03 Vijay Krishnamurthy , Alexandre d'Aspremont

Nonnegative least squares problems with multiple right-hand sides (MNNLS) arise in models that rely on additive linear combinations. In particular, they are at the core of most nonnegative matrix factorization algorithms and have many…

机器学习 · 计算机科学 2023-01-26 Nicolas Nadisic , Jeremy E Cohen , Arnaud Vandaele , Nicolas Gillis

We study projection-free methods for functional constrained optimization with convex or smooth nonconvex objectives. Such problems arise in applications such as portfolio optimization and radiation therapy planning, where risk-aware…

最优化与控制 · 数学 2026-05-12 Yi Cheng , Guanghui Lan , Saeed Masiha , H. Edwin Romeijn

From an optimizer's perspective, achieving the global optimum for a general nonconvex problem is often provably NP-hard using the classical worst-case analysis. In the case of Cox's proportional hazards model, by taking its statistical…

统计理论 · 数学 2021-07-07 Jianqing Fan , Wenyan Gong , Qiang Sun

This paper presents a novel method for reformulating non-differentiable collision avoidance constraints into smooth nonlinear constraints using strong duality of convex optimization. We focus on a controlled object whose goal is to avoid…

最优化与控制 · 数学 2018-06-12 Xiaojing Zhang , Alexander Liniger , Francesco Borrelli

In this paper we consider a distributed optimization scenario in which a set of agents has to solve a convex optimization problem with separable cost function, local constraint sets and a coupling inequality constraint. We propose a novel…

系统与控制 · 计算机科学 2018-04-25 Ivano Notarnicola , Giuseppe Notarstefano

In this paper, probabilistic guarantees for constraint sampling of multistage robust convex optimization problems are derived. The dynamic nature of these problems is tackled via the so-called scenario-with-certificates approach. This…

最优化与控制 · 数学 2016-11-08 Francesca Maggioni , Marida Bertocchi , Fabrizio Dabbene , Roberto Tempo

We design accelerated algorithms with improved rates for several fundamental classes of optimization problems. Our algorithms all build upon techniques related to the analysis of primal-dual extragradient methods via relative Lipschitzness…

最优化与控制 · 数学 2022-02-10 Yujia Jin , Aaron Sidford , Kevin Tian