English
Related papers

Related papers: Solving Quadratic Programs via Deep Unrolled Dougl…

200 papers

In this paper, we consider nonconvex decentralised optimisation and learning over a network of distributed agents. We develop an ADMM algorithm based on the Randomised Block Coordinate Douglas-Rachford splitting method which enables agents…

Optimization and Control · Mathematics 2025-07-31 Behnam Mafakheri , Jonathan H. Manton , Iman Shames

Approximate dynamic programming (ADP) faces challenges in dealing with constraints in control problems. Model predictive control (MPC) is, in comparison, well-known for its accommodation of constraints and stability guarantees, although its…

Systems and Control · Electrical Eng. & Systems 2023-04-10 Kanghui He , Shengling Shi , Ton van den Boom , Bart De Schutter

Dynamic programming (DP) solves a variety of structured combinatorial problems by iteratively breaking them down into smaller subproblems. In spite of their versatility, DP algorithms are usually non-differentiable, which hampers their use…

Machine Learning · Statistics 2018-02-21 Arthur Mensch , Mathieu Blondel

The technique of semidefinite programming (SDP) relaxation can be used to obtain a nontrivial bound on the optimal value of a nonconvex quadratically constrained quadratic program (QCQP). We explore concave quadratic inequalities that hold…

Optimization and Control · Mathematics 2016-09-30 Jaehyun Park , Stephen Boyd

We consider the exact solution of problem $(QP)$ that consists in minimizing a quadratic function subject to quadratic constraints. Starting from the classical convex relaxation that uses the McCormick's envelopes, we introduce 12…

Optimization and Control · Mathematics 2020-05-07 Amélie Lambert

Per-example gradient clipping is a key algorithmic step that enables practical differential private (DP) training for deep learning models. The choice of clipping threshold R, however, is vital for achieving high accuracy under DP. We…

Machine Learning · Computer Science 2023-10-05 Zhiqi Bu , Yu-Xiang Wang , Sheng Zha , George Karypis

This paper introduces a novel data-driven approach to design a linear quadratic regulator (LQR) using a reinforcement learning (RL) algorithm that does not require a system model. The key contribution is to perform policy iteration (PI) by…

Systems and Control · Electrical Eng. & Systems 2023-11-20 Soroush Asri , Luis Rodrigues

Algorithm unrolling has emerged as a learning-based optimization paradigm that unfolds truncated iterative algorithms in trainable neural-network optimizers. We introduce Stochastic UnRolled Federated learning (SURF), a method that expands…

Machine Learning · Computer Science 2024-02-08 Samar Hadou , Navid NaderiAlizadeh , Alejandro Ribeiro

This paper proposes and analyzes a tuning-free variant of Primal-Dual Hybrid Gradient (PDHG), and investigates its effectiveness for solving large-scale semidefinite programming (SDP). The core idea is based on the combination of two…

Optimization and Control · Mathematics 2024-02-02 Yinjun Wang , Haixiang Lan , Yinyu Ye

Solving linear programs is often a challenging task in distributed settings. While there are good algorithms for solving packing and covering linear programs in a distributed manner (Kuhn et al.~2006), this is essentially the only class of…

Data Structures and Algorithms · Computer Science 2017-09-12 Michael Dinitz , Yasamin Nazari

In this paper, we study the generalized Douglas-Rachford algorithm and its cyclic variants which include many projection-type methods such as the classical Douglas-Rachford algorithm and the alternating projection algorithm. Specifically,…

Optimization and Control · Mathematics 2020-04-14 Minh N. Dao , Hung M. Phan

Inverse problems for accelerated MRI typically incorporate domain-specific knowledge about the forward encoding operator in a regularized reconstruction framework. Recently physics-driven deep learning (DL) methods have been proposed to use…

Image and Video Processing · Electrical Eng. & Systems 2020-07-09 Seyed Amir Hossein Hosseini , Burhaneddin Yaman , Steen Moeller , Mingyi Hong , Mehmet Akçakaya

Quadratic Programming (QP) is the well-studied problem of maximizing over {-1,1} values the quadratic form \sum_{i \ne j} a_{ij} x_i x_j. QP captures many known combinatorial optimization problems, and assuming the unique games conjecture,…

Computational Complexity · Computer Science 2015-03-17 Aditya Bhaskara , Moses Charikar , Rajsekar Manokaran , Aravindan Vijayaraghavan

We present \texttt{DR-DAQP}, an open-source solver for strongly monotone affine variational inequaliries that combines Douglas-Rachford operator splitting with an active-set acceleration strategy. The key idea is to estimate the active set…

Systems and Control · Electrical Eng. & Systems 2026-04-06 Daniel Arnström , Emilio Benenati , Giuseppe Belgioioso

Many large-scale and distributed optimization problems can be brought into a composite form in which the objective function is given by the sum of a smooth term and a nonsmooth regularizer. Such problems can be solved via a proximal…

Optimization and Control · Mathematics 2020-06-26 Sepideh Hassan-Moghaddam , Mihailo R. Jovanović

We present a novel method for Deep Reinforcement Learning (DRL), incorporating the convex property of the value function over the belief space in Partially Observable Markov Decision Processes (POMDPs). We introduce hard- and soft-enforced…

Machine Learning · Computer Science 2025-03-13 Daniel Koutas , Daniel Hettegger , Kostas G. Papakonstantinou , Daniel Straub

Operator splitting schemes have been successfully used in computational sciences to reduce complex problems into a series of simpler subproblems. Since 1950s, these schemes have been widely used to solve problems in PDE and control.…

Optimization and Control · Mathematics 2015-04-07 Damek Davis , Wotao Yin

Douglas-Rachford (DR) algorithm is analyzed for Fourier phase retrieval with a single random phase mask. Local, geometric convergence to a unique fixed point is proved with numerical demonstration of global convergence.

Numerical Analysis · Mathematics 2015-09-04 Pengwen Chen , Albert Fannjiang

By absorbing the merits of both the model- and data-driven methods, deep physics-engaged learning scheme achieves high-accuracy and interpretable image reconstruction. It has attracted growing attention and become the mainstream for inverse…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Bin Chen , Jiechong Song , Jingfen Xie , Jian Zhang

This paper begins with a class of convex quadratic programs (QPs) with bounded variables solvable by the parametric principal pivoting algorithm with $\mathcal{O}(n^3)$ strongly polynomial complexity, where $n$ is the number of variables of…

Optimization and Control · Mathematics 2022-09-28 Jong-Shi Pang , Shaoning Han