English
Related papers

Related papers: Matrix-Valued Optimism is Matrix-Valued Augmentati…

200 papers

In this paper, we propose the primal-dual method of multipliers (PDMM) for distributed optimization over a graph. In particular, we optimize a sum of convex functions defined over a graph, where every edge in the graph carries a linear…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-06 G. Zhang , R. Heusdens

The paper studies a distributed constrained optimization problem, where multiple agents connected in a network collectively minimize the sum of individual objective functions subject to a global constraint being an intersection of the local…

Optimization and Control · Mathematics 2016-03-08 Jinlong Lei , Han-Fu Chen , Hai-Tao Fang

In this paper, we propose novel algorithms for inferring the Maximum a Posteriori (MAP) solution of discrete pairwise random field models under multiple constraints. We show how this constrained discrete optimization problem can be…

Machine Learning · Computer Science 2013-08-02 Yongsub Lim , Kyomin Jung , Pushmeet Kohli

Majorization-minimization algorithms consist of successively minimizing a sequence of upper bounds of the objective function. These upper bounds are tight at the current estimate, and each iteration monotonically drives the objective…

Optimization and Control · Mathematics 2015-02-03 Julien Mairal

In this paper, we develop unrolled neural networks to solve constrained optimization problems, offering accelerated, learnable counterparts to dual ascent (DA) algorithms. Our framework, termed constrained dual unrolling (CDU), comprises…

Machine Learning · Computer Science 2026-01-27 Samar Hadou , Alejandro Ribeiro

In the context of augmented Lagrangian approaches for solving semidefinite programming problems, we investigate the possibility of eliminating the positive semidefinite constraint on the dual matrix by employing a factorization. Hints on…

Optimization and Control · Mathematics 2018-09-12 Marianna De Santis , Franz Rendl , Angelika Wiegele

Primal-dual methods in online optimization give several of the state-of-the art results in both of the most common models: adversarial and stochastic/random order. Here we try to provide a more unified analysis of primal-dual algorithms to…

Data Structures and Algorithms · Computer Science 2020-11-04 Marco Molinaro

We study momentum-based first-order optimization algorithms in which the iterations utilize information from the two previous steps and are subject to an additive white noise. This setup uses noise to account for uncertainty in either…

Optimization and Control · Mathematics 2024-06-21 Hesameddin Mohammadi , Meisam Razaviyayn , Mihailo R. Jovanović

Models involving hybrid systems are versatile in their application but difficult to optimize efficiently due to their combinatorial nature. This work presents a method to cope with hybrid optimal control problems which, in contrast to…

Optimization and Control · Mathematics 2025-05-20 Viktoriya Nikitina , Alberto De Marchi , Matthias Gerdts

We revisit a formulation technique for inequality constrained optimization problems that has been known for decades: the substitution of squared variables for nonnegative variables. Using this technique, inequality constraints are converted…

Optimization and Control · Mathematics 2024-11-07 Lijun Ding , Stephen J. Wright

Motivated by variational models in continuum mechanics, we introduce a novel algorithm to perform nonsmooth and nonconvex minimizations with linear constraints in Euclidean spaces. We show how this algorithm is actually a natural…

Analysis of PDEs · Mathematics 2015-03-20 Marco Artina , Massimo Fornasier , Francesco Solombrino

Primal-Dual Interior-Point methods are capable of solving constrained convex optimization problems to tight tolerances in a fast and robust manner. The derivatives of the primal-dual solution with respect to the problem matrices can be…

Optimization and Control · Mathematics 2024-06-21 Kevin Tracy , Zachary Manchester

We consider a general multi-agent convex optimization problem where the agents are to collectively minimize a global objective function subject to a global inequality constraint, a global equality constraint, and a global constraint set.…

Optimization and Control · Mathematics 2011-05-13 Minghui Zhu , Sonia Martinez

Differential Dynamic Programming (DDP) has become a well established method for unconstrained trajectory optimization. Despite its several applications in robotics and controls however, a widely successful constrained version of the…

Optimization and Control · Mathematics 2020-05-05 Yuichiro Aoyama , George Boutselis , Akash Patel , Evangelos A. Theodorou

In this paper, we consider the problem of distributed optimisation of a separable convex cost function over a graph, where every edge and node in the graph could carry both linear equality and/or inequality constraints. We show how to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-20 Richard Heusdens , Guoqiang Zhang

This paper considers an optimization problem for a dynamical system whose evolution depends on a collection of binary decision variables. We develop scalable approximation algorithms with provable suboptimality bounds to provide…

Optimization and Control · Mathematics 2016-10-31 Insoon Yang , Samuel A. Burden , Ram Rajagopal , S. Shankar Sastry , Claire J. Tomlin

We consider the general problem of online convex optimization with time-varying additive constraints in the presence of predictions for the next cost and constraint functions. A novel primal-dual algorithm is designed by combining a…

Machine Learning · Computer Science 2022-01-11 Daron Anderson , George Iosifidis , Douglas J. Leith

Nonconvex and structured optimization problems arise in many engineering applications that demand scalable and distributed solution methods. The study of the convergence properties of these methods is in general difficult due to the…

Optimization and Control · Mathematics 2015-05-04 Sindri Magnússon , Pradeep Chathuranga Weeraddana , Michael G. Rabbat , Carlo Fischione

The recently introduced Gradient Methods with Memory use a subset of the past oracle information to create an accurate model of the objective function that enables them to surpass the Gradient Method in practical performance. The model…

Optimization and Control · Mathematics 2024-01-30 Mihai I. Florea

This work aims to minimize a continuously differentiable convex function with Lipschitz continuous gradient under linear equality constraints. The proposed inertial algorithm results from the discretization of the second-order primal-dual…

Optimization and Control · Mathematics 2022-08-03 Radu Ioan Bot , Ernö Robert Csetnek , Dang-Khoa Nguyen