English
Related papers

Related papers: Matrix-Free Convex Optimization Modeling

200 papers

We derive approximation algorithms for the nonnegative matrix factorization problem, i.e. the problem of factorizing a matrix as the product of two matrices with nonnegative coefficients. We form convex approximations of this problem which…

Optimization and Control · Mathematics 2012-07-03 Vijay Krishnamurthy , Alexandre d'Aspremont

This paper presents a novel convex optimization-based method for finding the globally optimal solutions of a class of mixed-integer non-convex optimal control problems. We consider problems with non-convex constraints that restrict the…

Optimization and Control · Mathematics 2019-11-21 Danylo Malyuta , Behcet Acikmese

Model predictive control (MPC) has established itself as the primary methodology for constrained control, enabling general-purpose robot autonomy in diverse real-world scenarios. However, for most problems of interest, MPC relies on the…

A multi-convex optimization problem is one in which the variables can be partitioned into sets over which the problem is convex when the other variables are fixed. Multi-convex problems are generally solved approximately using variations on…

Optimization and Control · Mathematics 2016-10-11 Xinyue Shen , Steven Diamond , Madeleine Udell , Yuantao Gu , Stephen Boyd

We consider the problem of minimizing a linear function over an affine section of the cone of positive semidefinite matrices, with the additional constraint that the feasible matrix has prescribed rank. When the rank constraint is active,…

Systems and Control · Computer Science 2016-11-22 Simone Naldi

We present a unified framework for solving trajectory optimization problems in a derivative-free manner through the use of sequential convex programming. Traditionally, nonconvex optimization problems are solved by forming and solving a…

Optimization and Control · Mathematics 2025-10-01 Kevin Tracy , John Z. Zhang , Jon Arrizabalaga , Stefan Schaal , Yuval Tassa , Tom Erez , Zachary Manchester

Machine Learning models incorporating multiple layered learning networks have been seen to provide effective models for various classification problems. The resulting optimization problem to solve for the optimal vector minimizing the…

Optimization and Control · Mathematics 2018-07-03 Vyacheslav Kungurtsev , Tomas Pevny

A fundamental model of quantum computation is the programmable quantum gate array. This is a quantum processor that is fed by a program state that induces a corresponding quantum operation on input states. While being programmable, any…

Quantum Physics · Physics 2020-05-20 Leonardo Banchi , Jason Pereira , Seth Lloyd , Stefano Pirandola

Consider a dataset of vector-valued observations that consists of noisy inliers, which are explained well by a low-dimensional subspace, along with some number of outliers. This work describes a convex optimization problem, called REAPER,…

Information Theory · Computer Science 2015-07-24 Gilad Lerman , Michael McCoy , Joel A. Tropp , Teng Zhang

A standard quadratic program is an optimization problem that consists of minimizing a (nonconvex) quadratic form over the unit simplex. We focus on reformulating a standard quadratic program as a mixed integer linear programming problem. We…

Optimization and Control · Mathematics 2018-10-05 Jacek Gondzio , E. Alper Yildirim

This document introduces a strategy to solve linear optimization problems. The strategy is based on the bounding condition each constraint produces on each one of the problem's dimension. The solution of a linear optimization problem is…

Optimization and Control · Mathematics 2018-09-24 Gerardo L. Febres

Motivated by the expressive power of completely positive programming to encode hard optimization problems, many approximation schemes for the completely positive cone have been proposed and successfully used. Most schemes are based on outer…

Optimization and Control · Mathematics 2019-10-07 João Gouveia , Ting Kei Pong , Mina Saee

We present the viewpoint that optimization problems encountered in machine learning can often be interpreted as minimizing a convex functional over a function space, but with a non-convex constraint set introduced by model parameterization.…

Machine Learning · Computer Science 2020-04-21 Yongqiang Cai , Qianxiao Li , Zuowei Shen

Model instability and poor prediction of long-term behavior are common problems when modeling dynamical systems using nonlinear "black-box" techniques. Direct optimization of the long-term predictions, often called simulation error…

Systems and Control · Computer Science 2017-01-25 Mark M. Tobenkin , Ian R. Manchester , Alexandre Megretski

Constrained Optimization solution algorithms are restricted to point based solutions. In practice, single or multiple objectives must be satisfied, wherein both the objective function and constraints can be non-convex resulting in multiple…

Neural and Evolutionary Computing · Computer Science 2021-01-05 Gurpreet Singh , Soumyajit Gupta , Matthew Lease

In modern data analysis, one is frequently faced with statistical inference problems involving massive datasets. Processing such large datasets is usually viewed as a substantial computational challenge. However, if data are a…

Statistics Theory · Mathematics 2015-06-12 Venkat Chandrasekaran , Michael I. Jordan

The paper introduces the first formulation of convex Q-learning for Markov decision processes with function approximation. The algorithms and theory rest on a relaxation of a dual of Manne's celebrated linear programming characterization of…

Optimization and Control · Mathematics 2023-09-12 Fan Lu , Sean Meyn

Despite the recent development in machine learning, most learning systems are still under the concept of "black box", where the performance cannot be understood and derived. With the rise of safety and privacy concerns in public, designing…

Machine Learning · Computer Science 2023-06-30 Shuai Zhang

We consider the densest submatrix problem, which seeks the submatrix of fixed size of a given binary matrix that contains the most nonzero entries. This problem is a natural generalization of fundamental problems in combinatorial…

Optimization and Control · Mathematics 2026-03-13 Valentine Olanubi , Phineas Agar , Brendan Ames

For those acquainted with CVX (aka disciplined convex programming) of M. Grant and S. Boyd, the motivation of this work is the desire to extend the scope of CVX beyond convex minimization -- to convex-concave saddle point problems and…

Optimization and Control · Mathematics 2021-06-30 Anatoli Juditsky , Arkadi Nemirovski