English
Related papers

Related papers: On the Primal Feasibility in Dual Decomposition Me…

200 papers

In this work we focus our attention on distributed optimization problems in the context where the communication time between the server and the workers is non-negligible. We obtain novel methods supporting bidirectional compression (both…

Optimization and Control · Mathematics 2023-05-23 Kaja Gruntkowska , Alexander Tyurin , Peter Richtárik

In this paper, we propose two algorithms for solving linear inverse problems when the observations are corrupted by noise. A proper data fidelity term (log-likelihood) is introduced to reflect the statistics of the noise (e.g. Gaussian,…

Applications · Statistics 2011-03-14 François-Xavier Dupé , Jalal Fadili , Jean-Luc Starck

This work investigates the convergence behavior of augmented Lagrangian methods (ALMs) when applied to convex optimization problems that may be infeasible. ALMs are a popular class of algorithms for solving constrained optimization…

Optimization and Control · Mathematics 2026-03-17 Roland Andrews , Justin Carpentier , Adrien Taylor

We consider algorithms for solving structured convex optimization problems over a network of agents with communication delays. It is assumed that each agent performs its local updates by using possibly outdated information from its…

Optimization and Control · Mathematics 2020-09-14 Puya Latafat , Panagiotis Patrinos

Given a convex optimization problem and its dual, there are many possible first-order algorithms. In this paper, we show the equivalence between mirror descent algorithms and algorithms generalizing the conditional gradient method. This is…

Machine Learning · Computer Science 2013-10-21 Francis Bach

In this work, we first consider distributed convex constrained optimization problems where the objective function is encoded by multiple local and possibly nonsmooth objectives privately held by a group of agents, and propose a distributed…

Optimization and Control · Mathematics 2020-02-20 Changxin Liu , Huiping Li , Yang Shi

We present a hierarchical model predictive control approach for large-scale systems based on dual decomposition. The proposed scheme allows coupling in both dynamics and constraints between the subsystems and generates a primal feasible…

Optimization and Control · Mathematics 2011-11-10 Minh Dang Doan , Tamás Keviczky , Bart De Schutter

In the distributed optimization problem for a multi-agent system, each agent knows a local function and must find a minimizer of the sum of all agents' local functions by performing a combination of local gradient evaluations and…

Optimization and Control · Mathematics 2022-06-16 Bryan Van Scoy , Laurent Lessard

We study two mixed robust/average-case submodular partitioning problems that we collectively call Submodular Partitioning. These problems generalize both purely robust instances of the problem (namely max-min submodular fair allocation…

Data Structures and Algorithms · Computer Science 2016-08-17 Kai Wei , Rishabh Iyer , Shengjie Wang , Wenruo Bai , Jeff Bilmes

Undersampled inverse problems occur everywhere in the sciences including medical imaging, radar, astronomy etc., yielding underdetermined linear or non-linear reconstruction problems. There are now a myriad of techniques to design decoders…

Optimization and Control · Mathematics 2023-11-29 Nina Maria Gottschling , Paolo Campodonico , Vegard Antun , Anders C. Hansen

Primal-dual algorithms are frequently used for iteratively solving large-scale convex optimization problems. The analysis of such algorithms is usually done on a case-by-case basis, and the resulting guaranteed rates of convergence can be…

Optimization and Control · Mathematics 2023-09-21 Bryan Van Scoy , John W. Simpson-Porco , Laurent Lessard

High-dimensional limit theorems have been shown useful to derive tuning rules for finding the optimal scaling in random-walk Metropolis algorithms. The assumptions under which weak convergence results are proved are however restrictive: the…

Methodology · Statistics 2022-02-16 Sebastian M Schmon , Philippe Gagnon

In this work, we revisit a classical incremental implementation of the primal-descent dual-ascent gradient method used for the solution of equality constrained optimization problems. We provide a short proof that establishes the linear…

Optimization and Control · Mathematics 2020-01-17 Sulaiman A. Alghunaim , Ali H. Sayed

This note is concerned with the problem of minimizing a separable, convex, composite (smooth and nonsmooth) function subject to linear constraints. We study a randomized block-coordinate interpretation of the Chambolle-Pock primal-dual…

Optimization and Control · Mathematics 2024-08-30 Olivier Bilenne

Devising efficient algorithms to solve continuously-varying strongly convex optimization programs is key in many applications, from control systems to signal processing and machine learning. In this context, solving means to find and track…

Optimization and Control · Mathematics 2020-01-09 Andrea Simonetto

This paper studies the possibility of upper bounding the position error of an estimate for range based positioning algorithms in wireless sensor networks. In this study, we argue that in certain situations when the measured distances…

Information Theory · Computer Science 2015-03-20 Mohammad Reza Gholami , Erik G. Ström , Henk Wymeersch , Mats Rydström

Binary optimization, a representative subclass of discrete optimization, plays an important role in mathematical optimization and has various applications in computer vision and machine learning. Usually, binary optimization problems are…

Optimization and Control · Mathematics 2021-05-18 Huan Xiong , Mengyang Yu , Li Liu , Fan Zhu , Fumin Shen , Ling Shao

The distributed adaptive signal fusion (DASF) framework allows to solve spatial filtering optimization problems in a distributed and adaptive fashion over a bandwidth-constrained wireless sensor network. The DASF algorithm requires each…

Signal Processing · Electrical Eng. & Systems 2025-05-02 Cem Ates Musluoglu , Alexander Bertrand

In this paper, we consider a primal-dual domain decomposition method for total variation regularized problems appearing in mathematical image processing. The model problem is transformed into an equivalent constrained minimization problem…

Numerical Analysis · Mathematics 2019-12-10 Chang-Ock Lee , Jongho Park

Analysis of the convergence rates of modern convex optimization algorithms can be achived through binary means: analysis of emperical convergence, or analysis of theoretical convergence. These two pathways of capturing information diverge…

Machine Learning · Computer Science 2013-05-20 Patrick Hop , Xinghao Pan