English
Related papers

Related papers: Deterministic Approximate Methods for Maximum Cons…

200 papers

This paper studies efficient distributed optimization methods for multi-agent networks. Specifically, we consider a convex optimization problem with a globally coupled linear equality constraint and local polyhedra constraints, and develop…

Systems and Control · Computer Science 2016-11-15 Tsung-Hui Chang

Machine learning algorithms in high-dimensional settings are highly susceptible to the influence of even a small fraction of structured outliers, making robust optimization techniques essential. In particular, within the…

Machine Learning · Computer Science 2025-04-25 Changyu Gao , Andrew Lowy , Xingyu Zhou , Stephen J. Wright

In this paper, we consider a class of nonconvex problems with linear constraints appearing frequently in the area of image processing. We solve this problem by the penalty method and propose the iteratively reweighted alternating…

Optimization and Control · Mathematics 2019-02-13 Tao Sun , Dongsheng Li , Hao Jiang , Zhe Quan

We propose a decomposition framework for the parallel optimization of the sum of a differentiable {(possibly nonconvex)} function and a nonsmooth (possibly nonseparable), convex one. The latter term is usually employed to enforce structure…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-19 Amir Daneshmand , Francisco Facchinei , Vyacheslav Kungurtsev , Gesualdo Scutari

The data-compatibility approach to constrained optimization, proposed here, strives to a point that is "close enough" to the solution set and whose target function value is "close enough" to the constrained minimum value. These notions can…

Optimization and Control · Mathematics 2020-10-26 Yair Censor , Maroun Zaknoon , Alexander J. Zaslavski

This work studies the linear approximation of high-dimensional dynamical systems using low-rank dynamic mode decomposition (DMD). Searching this approximation in a data-driven approach is formalised as attempting to solve a low-rank…

Machine Learning · Statistics 2021-08-23 Patrick Héas , Cédric Herzet

We propose a new asynchronous parallel block-descent algorithmic framework for the minimization of the sum of a smooth nonconvex function and a nonsmooth convex one, subject to both convex and nonconvex constraints. The proposed framework…

Optimization and Control · Mathematics 2018-04-02 Loris Cannelli , Francisco Facchinei , Vyacheslav Kungurtsev , Gesualdo Scutari

We consider a global variable consensus ADMM algorithm for solving large-scale PDE parameter estimation problems asynchronously and in parallel. To this end, we partition the data and distribute the resulting subproblems among the available…

Numerical Analysis · Mathematics 2019-05-01 Samy Wu Fung , Lars Ruthotto

Dense image matching is a fundamental low-level problem in Computer Vision, which has received tremendous attention from both discrete and continuous optimization communities. The goal of this paper is to combine the advantages of discrete…

Computer Vision and Pattern Recognition · Computer Science 2016-01-26 Alexander Shekhovtsov , Christian Reinbacher , Gottfried Graber , Thomas Pock

State-of-the-art methods for solving smooth optimization problems are nonlinear conjugate gradient, low memory BFGS, and Majorize-Minimize (MM) subspace algorithms. The MM subspace algorithm which has been introduced more recently has shown…

Optimization and Control · Mathematics 2016-08-24 Emilie Chouzenoux , Jean-Christophe Pesquet

In the online learning with experts problem, an algorithm must make a prediction about an outcome on each of $T$ days (or times), given a set of $n$ experts who make predictions on each day (or time). The algorithm is given feedback on the…

Data Structures and Algorithms · Computer Science 2023-03-06 David P. Woodruff , Fred Zhang , Samson Zhou

Fixpoints are ubiquitous in computer science and when dealing with quantitative semantics and verification one often considers least fixpoints of (higher-dimensional) functions over the non-negative reals. We show how to approximate the…

Logic in Computer Science · Computer Science 2025-06-16 Paolo Baldan , Sebastian Gurke , Barbara König , Tommaso Padoan , Florian Wittbold

In this paper we propose a fast optimization algorithm for approximately minimizing convex quadratic functions over the intersection of affine and separable constraints (i.e., the Cartesian product of possibly nonconvex real sets). This…

Optimization and Control · Mathematics 2015-09-29 Reza Takapoui , Nicholas Moehle , Stephen Boyd , Alberto Bemporad

In this paper, we develop deterministic fully dynamic algorithms for computing approximate distances in a graph with worst-case update time guarantees. In particular, we obtain improved dynamic algorithms that, given an unweighted and…

Data Structures and Algorithms · Computer Science 2022-09-09 Jan van den Brand , Sebastian Forster , Yasamin Nazari

In this paper, we propose a new Fully Composite Formulation of convex optimization problems. It includes, as a particular case, the problems with functional constraints, max-type minimization problems, and problems of Composite…

Optimization and Control · Mathematics 2021-03-24 Nikita Doikov , Yurii Nesterov

This study focuses on solving group zero-norm regularized robust loss minimization problems. We propose a proximal Majorization-Minimization (PMM) algorithm to address a class of equivalent Difference-of-Convex (DC) surrogate optimization…

Optimization and Control · Mathematics 2025-05-30 Ling Liang , Shujun Bi

The Alternating Direction Method of Multipliers (ADMM) provides a natural way of solving inverse problems with multiple partial differential equations (PDE) forward models and nonsmooth regularization. ADMM allows splitting these…

Numerical Analysis · Mathematics 2021-04-29 Luke Lozenski , Umberto Villa

This paper develops an adaptive proximal alternating direction method of multipliers (ADMM) for solving linearly constrained, composite optimization problems under the assumption that the smooth component of the objective is weakly convex,…

Optimization and Control · Mathematics 2026-05-04 Leandro Farias Maia , David H. Gutman , Renato D. C. Monteiro , Gilson N. Silva

Consensus planning is a method for coordinating decision making across complex systems and organizations, including complex supply chain optimization pipelines. It arises when large interdependent distributed agents (systems) share common…

Optimization and Control · Mathematics 2025-11-25 Alvaro Maggiar , Lee Dicker , Michael Mahoney

This paper proposes a novel non-parametric multidimensional convex regression estimator which is designed to be robust to adversarial perturbations in the empirical measure. We minimize over convex functions the maximum (over Wasserstein…

Statistics Theory · Mathematics 2020-07-28 Jose Blanchet , Peter W. Glynn , Jun Yan , Zhengqing Zhou