English
Related papers

Related papers: Constrained Optimization of Rank-One Functions wit…

200 papers

Sparse methods for supervised learning aim at finding good linear predictors from as few variables as possible, i.e., with small cardinality of their supports. This combinatorial selection problem is often turned into a convex optimization…

Machine Learning · Computer Science 2010-11-15 Francis Bach

We propose a novel framework for learning stabilizable nonlinear dynamical systems for continuous control tasks in robotics. The key contribution is a control-theoretic regularizer for dynamics fitting rooted in the notion of…

Optimization and Control · Mathematics 2019-08-01 Sumeet Singh , Spencer M. Richards , Vikas Sindhwani , Jean-Jacques E. Slotine , Marco Pavone

We derive computationally tractable formulations of the robust counterparts of convex quadratic and conic quadratic constraints that are concave in matrix-valued uncertain parameters. We do this for a broad range of uncertainty sets. In…

Optimization and Control · Mathematics 2022-04-07 Ahmadreza Marandi , Aharon Ben-Tal , Dick den Hertog , Bertrand Melenberg

A convex optimization model predicts an output from an input by solving a convex optimization problem. The class of convex optimization models is large, and includes as special cases many well-known models like linear and logistic…

Machine Learning · Computer Science 2020-06-19 Akshay Agrawal , Shane Barratt , Stephen Boyd

This paper proposes an algorithmic framework for solving parametric optimization problems which we call adjoint-based predictor-corrector sequential convex programming. After presenting the algorithm, we prove a contraction estimate that…

Optimization and Control · Mathematics 2011-09-14 Q. Tran Dinh , C. Savorgnan , M. Diehl

Recently, convex formulations of low-rank matrix factorization problems have received considerable attention in machine learning. However, such formulations often require solving for a matrix of the size of the data matrix, making it…

Machine Learning · Computer Science 2017-08-29 Benjamin D. Haeffele , Rene Vidal

Evolutionary algorithms have been frequently applied to constrained continuous optimisation problems. We carry out feature based comparisons of different types of evolutionary algorithms such as evolution strategies, differential evolution…

Artificial Intelligence · Computer Science 2015-09-24 Shayan Poursoltan , Frank Neumann

Non-convex optimization plays a key role in a growing number of machine learning applications. This motivates the identification of specialized structure that enables sharper theoretical analysis. One such identified structure is…

Optimization and Control · Mathematics 2023-06-06 Qiang Fu , Dongchu Xu , Ashia Wilson

We propose an exact iterative algorithm for minimization of a class of continuous cell-wise linear convex functions on a hyperplane arrangement. Our particular setup is motivated by evaluation of so-called rank estimators used in robust…

Optimization and Control · Mathematics 2020-01-01 Michal Černý , Milan Hladík , Miroslav Rada

In this article, we propose a data-enabled economic predictive control method for a class of nonlinear systems, which aims to optimize the economic operational performance while handling hard constraints on the system outputs. Two lifting…

Systems and Control · Electrical Eng. & Systems 2025-12-30 Mingxue Yan , Xuewen Zhang , Kaixiang Zhang , Zhaojian Li , Xunyuan Yin

We consider the problem of optimal sparse output feedback controller synthesis for continuous linear time invariant systems when the feedback gain is static and subject to specified structural constraints. Introducing an additional term…

Optimization and Control · Mathematics 2015-06-23 Reza Arastoo , Nader Motee , Mayuresh V. Kothare

We describe a convex programming approach to the calculation of lower bounds on the minimum cost of constrained decentralized control problems with nonclassical information structures. The class of problems we consider entail the…

Optimization and Control · Mathematics 2019-06-05 Weixuan Lin , Eilyan Bitar

We present the viewpoint that optimization problems encountered in machine learning can often be interpreted as minimizing a convex functional over a function space, but with a non-convex constraint set introduced by model parameterization.…

Machine Learning · Computer Science 2020-04-21 Yongqiang Cai , Qianxiao Li , Zuowei Shen

In this work, we investigate the question of how knowledge about expectations $\mathbb{E}(f_i(X))$ of a random vector $X$ translate into inequalities for $\mathbb{E}(g(X))$ for given functions $f_i$, $g$ and a random vector $X$ whose…

Probability · Mathematics 2021-04-27 André M. Timpanaro

An algorithm is proposed, analyzed, and tested for solving continuous nonlinear-equality-constrained optimization problems where the objective and constraint functions are defined by expectations or averages over large, finite numbers of…

Optimization and Control · Mathematics 2026-05-14 Frank E. Curtis , Lingjun Guo , Daniel P. Robinson

Evolutionary strategies have recently been shown to achieve competing levels of performance for complex optimization problems in reinforcement learning. In such problems, one often needs to optimize an objective function subject to a set of…

Neural and Evolutionary Computing · Computer Science 2022-02-23 Youssef Diouane , Aurelien Lucchi , Vihang Patil

Substantial progress has been made recently on developing provably accurate and efficient algorithms for low-rank matrix factorization via nonconvex optimization. While conventional wisdom often takes a dim view of nonconvex optimization…

Machine Learning · Computer Science 2019-10-23 Yuejie Chi , Yue M. Lu , Yuxin Chen

Motivated by robust matrix recovery problems such as Robust Principal Component Analysis, we consider a general optimization problem of minimizing a smooth and strongly convex loss function applied to the sum of two blocks of variables,…

Machine Learning · Computer Science 2019-11-19 Dan Garber , Shoham Sabach , Atara Kaplan

We study the polyhedral convex hull structure of a mixed-integer set which arises in a class of cardinality-constrained concave submodular minimization problems. This class of problems has an objective function in the form of $f(a^\top x)$,…

Optimization and Control · Mathematics 2022-12-22 Qimeng Yu , Simge Küçükyavuz

This paper is concerned with a finite-horizon inverse control problem, which has the goal of reconstructing, from observations, the possibly non-convex and non-stationary cost driving the actions of an agent. In this context, we present a…

Optimization and Control · Mathematics 2024-06-27 Emiland Garrabe , Hozefa Jesawada , Carmen Del Vecchio , Giovanni Russo