English
Related papers

Related papers: Guaranteed upper bounds for iteration errors and m…

200 papers

We develop a novel unified randomized block-coordinate primal-dual algorithm to solve a class of nonsmooth constrained convex optimization problems, which covers different existing variants and model settings from the literature. We prove…

Optimization and Control · Mathematics 2021-10-29 Quoc Tran-Dinh , Deyi Liu

A key idea in convex optimization theory is to use well-structured affine functions to approximate general functions, leading to impactful developments in conjugate functions and convex duality theory. This raises the question: what are the…

Optimization and Control · Mathematics 2025-04-22 Ningji Wei

First order methods endowed with global convergence guarantees operate using global lower bounds on the objective. The tightening of the bounds has been shown to increase both the theoretical guarantees and the practical performance. In…

Optimization and Control · Mathematics 2024-04-30 Mihai I. Florea , Yurii Nesterov

With the widespread adoption of machine learning systems, the need to curtail their behavior has become increasingly apparent. This is evidenced by recent advancements towards developing models that satisfy robustness, safety, and fairness…

Machine Learning · Computer Science 2024-03-19 Juan Elenter , Luiz F. O. Chamon , Alejandro Ribeiro

This paper extends algorithms that remove the fixed point bias of decentralized gradient descent to solve the more general problem of distributed optimization over subspace constraints. Leveraging the integral quadratic constraint…

Optimization and Control · Mathematics 2022-10-31 Dennis J. Marquis , Dany Abou Jaoude , Mazen Farhood , Craig A. Woolsey

Advanced machine learning methods, and more prominently neural networks, have become standard to solve inverse problems over the last years. However, the theoretical recovery guarantees of such methods are still scarce and difficult to…

Machine Learning · Computer Science 2024-03-11 Nathan Buskulic , Jalal Fadili , Yvain Quéau

Primal-dual algorithms are frequently used for iteratively solving large-scale convex optimization problems. The analysis of such algorithms is usually done on a case-by-case basis, and the resulting guaranteed rates of convergence can be…

Optimization and Control · Mathematics 2023-09-21 Bryan Van Scoy , John W. Simpson-Porco , Laurent Lessard

In this paper we propose a distributed dual gradient algorithm for minimizing linearly constrained separable convex problems and analyze its rate of convergence. In particular, we prove that under the assumption of strong convexity and…

Optimization and Control · Mathematics 2014-10-01 Ion Necoara , Valentin Nedelcu

Dual decomposition approaches in nonconvex optimization may suffer from a duality gap. This poses a challenge when applying them directly to nonconvex problems such as MAP-inference in a Markov random field (MRF) with continuous state…

Optimization and Control · Mathematics 2022-05-17 Hartmut Bauermeister , Emanuel Laude , Thomas Möllenhoff , Michael Moeller , Daniel Cremers

We study the problem of bounding the posterior distribution of discrete probabilistic programs with unbounded support, loops, and conditioning. Loops pose the main difficulty in this setting: even if exact Bayesian inference is possible,…

Programming Languages · Computer Science 2024-12-06 Fabian Zaiser , Andrzej S. Murawski , C. -H. Luke Ong

We introduce a cutting-plane framework for nonconvex quadratic programs (QPs) that progressively tightens convex relaxations. Our approach leverages the doubly nonnegative (DNN) relaxation to compute strong lower bounds and generate…

Optimization and Control · Mathematics 2025-10-06 Zheng Qu , Defeng Sun , Jintao Xu

This technical note is concerned with boundary stabilization of multi-dimensional discrete-velocity kinetic models. By exploiting a certain stability structure of the models and adapting an appropriate Lyapunov functional, we derive…

Optimization and Control · Mathematics 2025-02-24 Haitian Yang , Wen-An Yong

We develop an algorithmic theory of convex optimization over discrete sets. Using a combination of algebraic and geometric tools we are able to provide polynomial time algorithms for solving broad classes of convex combinatorial…

Optimization and Control · Mathematics 2009-01-24 Shmuel Onn

This work investigates the finite-horizon optimal covariance steering problem for discrete-time linear systems subject to both additive and multiplicative uncertainties as well as state and input chance constraints. In particular, a…

Optimization and Control · Mathematics 2023-01-19 Jacob Knaup , Panagiotis Tsiotras

In monotone submodular function maximization, approximation guarantees based on the curvature of the objective function have been extensively studied in the literature. However, the notion of curvature is often pessimistic, and we rarely…

Data Structures and Algorithms · Computer Science 2017-09-12 Tasuku Soma , Yuichi Yoshida

A multiscale optimization framework for problems over a space of Lipschitz continuous functions is developed. The method solves a coarse-grid discretization followed by linear interpolation to warm-start project gradient descent on…

Numerical Analysis · Mathematics 2026-03-05 Nicholas J. E. Richardson , Noah Marusenko , Michael P. Friedlander

In this article we develop a duality principle suitable for a large class of problems in optimization. The main result is obtained through basic tools of convex analysis and duality theory. We establish a correct relation between the…

Optimization and Control · Mathematics 2019-06-26 Fabio Botelho

A proximal safeguarded augmented Lagrangian method for minimizing the difference of convex (DC) functions over a nonempty, closed and convex set with additional linear equality as well as convex inequality constraints is presented. Thereby,…

Optimization and Control · Mathematics 2026-04-01 Christian Kanzow , Tanja Neder

In this paper, we propose a general approach for explicit a posteriori error representation for convex minimization problems using basic convex duality relations. Exploiting discrete orthogonality relations in the space of element-wise…

Numerical Analysis · Mathematics 2023-07-11 Sören Bartels , Alex Kaltenbach

This article deals with the computation of guaranteed lower bounds of the error in the framework of finite element (FE) and domain decomposition (DD) methods. In addition to a fully parallel computation, the proposed lower bounds separate…

Numerical Analysis · Mathematics 2016-06-22 Valentine Rey , Pierre Gosselet , Christian Rey