English
Related papers

Related papers: Nonconvex Optimization Framework for Group-Sparse …

200 papers

We consider the problem of designing a feedback controller for a multivariable linear time-invariant system which regulates an arbitrary system output to the solution of an equality-constrained convex optimization problem despite unknown…

Optimization and Control · Mathematics 2020-05-12 Liam S. P. Lawrence , John W. Simpson-Porco , Enrique Mallada

Feedback optimization is a control paradigm that enables physical systems to autonomously reach efficient operating points. Its central idea is to interconnect optimization iterations in closed-loop with the physical plant. Since iterative…

Optimization and Control · Mathematics 2024-07-16 Zhiyu He , Saverio Bolognani , Jianping He , Florian Dörfler , Xinping Guan

We investigate implicit regularization schemes for gradient descent methods applied to unpenalized least squares regression to solve the problem of reconstructing a sparse signal from an underdetermined system of linear measurements under…

Machine Learning · Statistics 2019-09-12 Tomas Vaškevičius , Varun Kanade , Patrick Rebeschini

We present successive convexification, a real-time-capable solution method for nonconvex trajectory optimization, with continuous-time constraint satisfaction and guaranteed convergence, that only requires first-order information. The…

Optimization and Control · Mathematics 2024-04-26 Purnanand Elango , Dayou Luo , Abhinav G. Kamath , Samet Uzun , Taewan Kim , Behçet Açıkmeşe

Distributed aggregative optimization is a recently emerged framework in which the agents of a network want to minimize the sum of local objective functions, each one depending on the agent decision variable (e.g., the local position of a…

Optimization and Control · Mathematics 2024-04-08 Guido Carnevale , Nicola Mimmo , Giuseppe Notarstefano

Feature selection in learning to rank has recently emerged as a crucial issue. Whereas several preprocessing approaches have been proposed, only a few works have been focused on integrating the feature selection into the learning process.…

Machine Learning · Computer Science 2015-07-03 Léa Laporte , Rémi Flamary , Stephane Canu , Sébastien Déjean , Josiane Mothe

Many problems in machine learning and other fields can be (re)for-mulated as linearly constrained separable convex programs. In most of the cases, there are multiple blocks of variables. However, the traditional alternating direction method…

Numerical Analysis · Computer Science 2014-05-30 Zhouchen Lin , Risheng Liu , Huan Li

For the linear inverse problem with sparsity constraints, the $l_0$ regularized problem is NP-hard, and existing approaches either utilize greedy algorithms to find almost-optimal solutions or to approximate the $l_0$ regularization with…

Machine Learning · Computer Science 2024-02-14 Qinghua Tao , Xiangming Xi , Jun Xu , Johan A. K. Suykens

Sparse feature selection has been demonstrated to be effective in handling high-dimensional data. While promising, most of the existing works use convex methods, which may be suboptimal in terms of the accuracy of feature selection and…

Machine Learning · Computer Science 2013-01-22 Shuo Xiang , Xiaotong Shen , Jieping Ye

Hypergraph matching is a fundamental problem in computer vision. Mathematically speaking, it maximizes a polynomial objective function, subject to assignment constraints. In this paper, we reformulate the hypergraph matching problem as a…

Optimization and Control · Mathematics 2017-11-15 Chunfeng Cui , Qingna Li , Liqun Qi , Hong Yan

The circumcentered-reflection method (CRM) has been recently proposed as a methodology for accelerating several algorithms for solving the Convex Feasibility Problem (CFP), equivalent to finding a common fixed-point of the orthogonal…

Optimization and Control · Mathematics 2022-03-07 Reza Arefidamghani , Roger Behling , Alfredo N. Iusem , Luiz-Rafael Santos

We introduce BLOC (Black-box Optimization over Correlation matrices), a general framework for sparse covariance estimation with non-convex penalties. BLOC operates on the manifold of correlation matrices and reparameterizes it via an…

Methodology · Statistics 2026-04-01 Priyam Das , Trambak Banerjee , Prajamitra Bhuyan

This paper proposes an improved quasi-Newton penalty decomposition algorithm for the minimization of continuously differentiable functions, possibly nonconvex, over sparse symmetric sets. The method solves a sequence of penalty subproblems…

Optimization and Control · Mathematics 2026-01-21 Ahmad Mousavi , Morteza Kimiaei , Saman Babaie-Kafaki , Vyacheslav Kungurtsev

This paper defines a strong convertible nonconvex(SCN) function for solving the unconstrained optimization problems with the nonconvex or nonsmooth(nondifferentiable) function. First, many examples of SCN function are given, where the SCN…

Optimization and Control · Mathematics 2022-05-17 Min Jiang , Rui Shen , Zhiqing Meng , Chuangyin Dang

This paper mainly addresses the distributed online optimization problem where the local objective functions are assumed to be convex or non-convex. First, the distributed algorithms are proposed for the convex and non-convex situations,…

Optimization and Control · Mathematics 2025-03-24 Yaowen Wang , Lipo Mo , Min Zuo , Yuanshi Zheng

Constrained non-convex optimization problems frequently arise in control applications. Solving such problems is inherently challenging, as existing methods often converge to suboptimal local minima or incur prohibitive computational costs.…

Optimization and Control · Mathematics 2026-01-27 Anran Li , John P. Swensen , Mehdi Hosseinzadeh

This paper investigates the collaboration of multiple connected and automated vehicles (CAVs) in different scenarios. In general, the collaboration of CAVs can be formulated as a nonlinear and nonconvex model predictive control (MPC)…

Optimization and Control · Mathematics 2022-07-26 Xiaoxue Zhang , Jun Ma , Zilong Cheng , Frank L. Lewis , Tong Heng Lee

Nonconvex sparse models have received significant attention in high-dimensional machine learning. In this paper, we study a new model consisting of a general convex or nonconvex objectives and a variety of continuous nonconvex…

Optimization and Control · Mathematics 2020-10-26 Digvijay Boob , Qi Deng , Guanghui Lan , Yilin Wang

In this paper we consider sparse approximation problems, that is, general $l_0$ minimization problems with the $l_0$-"norm" of a vector being a part of constraints or objective function. In particular, we first study the first-order…

Machine Learning · Computer Science 2012-05-31 Zhaosong Lu , Yong Zhang

In this paper, we consider smooth convex optimization problems with simple constraints and inexactness in the oracle information such as value, partial or directional derivatives of the objective function. We introduce a unifying framework,…

Optimization and Control · Mathematics 2020-12-17 Pavel Dvurechensky , Alexander Gasnikov , Alexander Tiurin , Vladimir Zholobov