English
Related papers

Related papers: Approximate Convex Optimization by Online Game Pla…

200 papers

We propose a randomized algorithm with quadratic convergence rate for convex optimization problems with a self-concordant, composite, strongly convex objective function. Our method is based on performing an approximate Newton step using a…

Optimization and Control · Mathematics 2021-05-18 Jonathan Lacotte , Yifei Wang , Mert Pilanci

Building on the blueprint from Goemans and Williamson (1995) for the Max-Cut problem, we construct a polynomial-time approximation algorithm for orthogonally constrained quadratic optimization problems. First, we derive a semidefinite…

Optimization and Control · Mathematics 2026-03-17 Ryan Cory-Wright , Jean Pauphilet

The problem of solving linear systems is one of the most fundamental problems in computer science, where given a satisfiable linear system $(A,b)$, for $A \in \mathbb{R}^{n \times n}$ and $b \in \mathbb{R}^n$, we wish to find a vector $x…

Data Structures and Algorithms · Computer Science 2021-06-25 Mitali Bafna , Nikhil Vyas

We present Epsilon, a system for general convex programming using fast linear and proximal operators. As with existing convex programming frameworks, users specify convex optimization problems using a natural grammar for mathematical…

Optimization and Control · Mathematics 2015-11-17 Matt Wytock , Po-Wei Wang , J. Zico Kolter

This paper studies the problem of controlling linear dynamical systems subject to point-wise-in-time constraints. We present an algorithm similar to online gradient descent, that can handle time-varying and a priori unknown convex cost…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

Constrained quasiconvex optimization problems appear in many fields, such as economics, engineering, and management science. In particular, fractional programming, which models ratio indicators such as the profit/cost ratio as fractional…

Optimization and Control · Mathematics 2019-09-02 Kazuhiro Hishinuma , Hideaki Iiduka

Hidden convexity is a powerful idea in optimization: under the right transformations, nonconvex problems that are seemingly intractable can be solved efficiently using convex optimization. We introduce the notion of a Lagrangian dual…

Optimization and Control · Mathematics 2025-11-07 Venkat Chandrasekaran , Timothy Duff , Jose Israel Rodriguez , Kevin Shu

This paper presents a modeling and optimization framework to compute the minimum-lap-time spatial trajectory and powertrain operation of racing cars in a computationally efficient fashion. Specifically, we first derive a quasi-steady-state…

Optimization and Control · Mathematics 2026-04-15 Erik van den Eshof , Wytze de Vries , Jorn van Kampen , Mauro Salazar

We develop a family of accelerated stochastic algorithms that minimize sums of convex functions. Our algorithms improve upon the fastest running time for empirical risk minimization (ERM), and in particular linear least-squares regression,…

Machine Learning · Statistics 2015-06-25 Roy Frostig , Rong Ge , Sham M. Kakade , Aaron Sidford

We propose first order algorithms for convex optimization problems where the feasible set is described by a large number of convex inequalities that is to be explored by subgradient projections. The first algorithm is an adaptation of a…

Optimization and Control · Mathematics 2015-06-30 C. H. Jeffrey Pang

Random projection techniques based on Johnson-Lindenstrauss lemma are used for randomly aggregating the constraints or variables of optimization problems while approximately preserving their optimal values, that leads to smaller-scale…

Optimization and Control · Mathematics 2021-07-13 Terunari Fuji , Pierre-Louis Poirion , Akiko Takeda

This paper discusses a special kind of convex constrained optimization problem, whose constraints consist of box inequalities and linear equalities. For this problem, in addition to general optimization algorithms such as exact penalty…

Optimization and Control · Mathematics 2020-04-21 Yue Sun

We develop two new proximal alternating penalty algorithms to solve a wide range class of constrained convex optimization problems. Our approach mainly relies on a novel combination of the classical quadratic penalty, alternating…

Optimization and Control · Mathematics 2018-09-20 Quoc Tran-Dinh

We consider solving equality-constrained nonlinear, nonconvex optimization problems. This class of problems appears widely in a variety of applications in machine learning and engineering, ranging from constrained deep neural networks, to…

Optimization and Control · Mathematics 2023-05-31 Ilgee Hong , Sen Na , Michael W. Mahoney , Mladen Kolar

This paper is devoted to the theoretical and numerical investigation of an augmented Lagrangian method for the solution of optimization problems with geometric constraints. Specifically, we study situations where parts of the constraints…

Optimization and Control · Mathematics 2022-04-20 Xiaoxi Jia , Christian Kanzow , Patrick Mehlitz , Gerd Wachsmuth

Convex relaxations based on different hierarchies of linear/semi-definite programs have been used recently to devise approximation algorithms for various optimization problems. The approximation guarantee of these algorithms improves with…

Data Structures and Algorithms · Computer Science 2015-03-20 Venkatesan Guruswami , Ali Kemal Sinop

We examine online safe multi-agent reinforcement learning using constrained Markov games in which agents compete by maximizing their expected total rewards under a constraint on expected total utilities. Our focus is confined to an episodic…

Machine Learning · Computer Science 2023-06-02 Dongsheng Ding , Xiaohan Wei , Zhuoran Yang , Zhaoran Wang , Mihailo R. Jovanović

In this paper we propose a new inexact dual decomposition algorithm for solving separable convex optimization problems. This algorithm is a combination of three techniques: dual Lagrangian decomposition, smoothing and excessive gap. The…

Optimization and Control · Mathematics 2013-02-11 Quoc Tran Dinh , Ion Necoara , Moritz Diehl

An algorithm which computes a solution of a set optimization problem is provided. The graph of the objective map is assumed to be given by finitely many linear inequalities. A solution is understood to be a set of points in the domain…

Optimization and Control · Mathematics 2014-05-29 Andreas Löhne , Carola Schrage

The Knapsack Problem is a classic problem in combinatorial optimisation. Solving these problems may be computationally expensive. Recent years have seen a growing interest in the use of deep learning methods to approximate the solutions to…

Machine Learning · Computer Science 2023-12-07 Mitchell Keegan , Mahdi Abolghasemi