English
Related papers

Related papers: Solving Quadratic Programs via Deep Unrolled Dougl…

200 papers

Deep unrolling, or unfolding, is an emerging learning-to-optimize method that unrolls a truncated iterative algorithm in the layers of a trainable neural network. However, the convergence guarantees and generalizability of the unrolled…

Machine Learning · Computer Science 2024-12-02 Samar Hadou , Navid NaderiAlizadeh , Alejandro Ribeiro

Motivated by nonconvex, inconsistent feasibility problems in imaging, the relaxed alternating averaged reflections algorithm, or relaxed Douglas-Rachford algorithm (DR$\lambda$), was first proposed over a decade ago. Convergence results for…

Optimization and Control · Mathematics 2020-03-26 D. Russell Luke , Anna-Lena Martins

In this paper, we propose a new algorithm combining the Douglas-Rachford (DR) algorithm and the Frank-Wolfe algorithm, also known as the conditional gradient (CondG) method, for solving the classic convex feasibility problem. Within the…

Optimization and Control · Mathematics 2021-06-09 R. Díaz Millán , O. P. Ferreira , J. Ugon

We address the solution of time-varying optimization problems characterized by the sum of a time-varying strongly convex function and a time-invariant nonsmooth convex function. We design an online algorithmic framework based on…

Optimization and Control · Mathematics 2024-05-07 Nicola Bastianello , Andrea Simonetto , Ruggero Carli

We propose a solution approach for the problem (P) of minimizing an unconstrained binary polynomial optimization problem. We call this method PQCR (Polynomial Quadratic Convex Reformulation). The resolution is based on a 3-phase method. The…

Data Structures and Algorithms · Computer Science 2019-01-24 Sourour Elloumi , Amélie Lambert , Arnaud Lazare

The difference-of-convex (DC) program is an important model in nonconvex optimization due to its structure, which encompasses a wide range of practical applications. In this paper, we aim to tackle a generalized class of DC programs, where…

Optimization and Control · Mathematics 2025-05-29 Tan Nhat Pham , Minh N. Dao , Nima Amjady , Rakibuzzaman Shah

Douglas-Rachford splitting and its equivalent dual formulation ADMM are widely used iterative methods in composite optimization problems arising in control and machine learning applications. The performance of these algorithms depends on…

Optimization and Control · Mathematics 2019-06-28 Jacob H. Seidman , Mahyar Fazlyab , Victor M. Preciado , George J. Pappas

While neural networks have achieved vastly enhanced performance over traditional iterative methods in many cases, they are generally empirically designed and the underlying structures are difficult to interpret. The algorithm unrolling…

Computer Vision and Pattern Recognition · Computer Science 2019-02-18 Yuelong Li , Mohammad Tofighi , Vishal Monga , Yonina C. Eldar

Deep learning methods have achieved great success in solving partial differential equations (PDEs), where the loss is often defined as an integral. The accuracy and efficiency of these algorithms depend greatly on the quadrature method. We…

Numerical Analysis · Mathematics 2022-10-31 Fengjiang Fu , Xiaoqun Wang

Symmetry is the essential element of lifted inference that has recently demon- strated the possibility to perform very efficient inference in highly-connected, but symmetric probabilistic models models. This raises the question, whether…

Artificial Intelligence · Computer Science 2016-06-15 Martin Mladenov , Leonard Kleinhans , Kristian Kersting

We present a general-purpose solver for convex quadratic programs based on the alternating direction method of multipliers, employing a novel operator splitting technique that requires the solution of a quasi-definite linear system with the…

Optimization and Control · Mathematics 2020-02-13 Bartolomeo Stellato , Goran Banjac , Paul Goulart , Alberto Bemporad , Stephen Boyd

Quadratic programming (QP) is a fundamental optimization model with wide-ranging applications in decision-making and machine learning, yet efficiently solving large-scale instances remains a major computational challenge. Building upon the…

Optimization and Control · Mathematics 2026-03-02 Hongpei Li , Yicheng Huang , Huikang Liu , Dongdong Ge , Yinyu Ye

Convex optimization has become ubiquitous in most quantitative disciplines of science, including variational image processing. Proximal splitting algorithms are becoming popular to solve such structured convex optimization problems. Within…

Optimization and Control · Mathematics 2015-08-03 Jingwei Liang , Jalal Fadili , Gabriel Peyré , Russell Luke

In this paper, we analyze the convergence as well as the rate of convergence of asynchronous distributed quadratic programming (QP) with dual decomposition technique. In general, distributed optimization requires synchronization of data at…

Optimization and Control · Mathematics 2015-06-22 Kooktae Lee , Raktim Bhattacharya

The Douglas-Rachford method, a projection algorithm designed to solve continuous optimization problems, forms the basis of a useful heuristic for solving combinatorial optimization problems. In order to successfully use the method, it is…

Optimization and Control · Mathematics 2019-04-22 Francisco J. Aragón Artacho , Rubén Campoy , Matthew K. Tam

Differentiable optimization has attracted significant research interest, particularly for quadratic programming (QP). Existing approaches for differentiating the solution of a QP with respect to its defining parameters often rely on…

Machine Learning · Computer Science 2025-10-31 Connor W. Magoon , Fengyu Yang , Noam Aigerman , Shahar Z. Kovalsky

This paper presents an algorithmic study and complexity analysis for solving distributionally robust multistage convex optimization (DR-MCO). We generalize the usual consecutive dual dynamic programming (DDP) algorithm to DR-MCO and propose…

Optimization and Control · Mathematics 2024-01-05 Shixuan Zhang , Xu Andy Sun

In this paper, we consider a class of nonconvex complex quadratic programming (CQP) problems, which find a broad spectrum of signal processing applications. By using the polar coordinate representations of the complex variables, we first…

Information Theory · Computer Science 2020-08-20 Cheng Lu , Ya-Feng Liu , Jing Zhou

We propose a Jacobi-style distributed algorithm to solve convex, quadratically constrained quadratic programs (QCQPs), which arise from a broad range of applications. While small to medium-sized convex QCQPs can be solved efficiently by…

Optimization and Control · Mathematics 2021-10-15 Run Chen , Andrew L. Liu

Randomized iterative methods have gained recent interest in machine learning and signal processing for solving large-scale linear systems. One such example is the randomized Douglas-Rachford (RDR) method, which updates the iterate by…

Numerical Analysis · Mathematics 2025-06-13 Liqi Guo , Ruike Xiang , Deren Han , Jiaxin Xie