English
Related papers

Related papers: A Primal-Dual Perspective on Program Verification …

200 papers

Under some mild Markov assumptions it is shown that the problem of designing optimal sequential tests for two simple hypotheses can be formulated as a linear program. The result is derived by investigating the Lagrangian dual of the…

Statistics Theory · Mathematics 2015-02-24 Michael Fauss , Abdelhak M. Zoubir

Distributed optimization algorithms are used in a wide variety of problems involving complex network systems where the goal is for a set of agents in the network to solve a network-wide optimization problem via distributed update rules. In…

Optimization and Control · Mathematics 2025-09-23 Liam Hallinan , Ioannis Lestas

Several well-known algorithms in the field of combinatorial optimization can be interpreted in terms of the primal-dual method for solving linear programs. For example, Dijkstra's algorithm, the Ford-Fulkerson algorithm, and the Hungarian…

Optimization and Control · Mathematics 2016-01-19 Randy Cogill

Despite the non-convexity of most modern machine learning parameterizations, Lagrangian duality has become a popular tool for addressing constrained learning problems. We revisit Augmented Lagrangian methods, which aim to mitigate the…

Machine Learning · Computer Science 2025-10-30 Ignacio Boero , Ignacio Hounie , Alejandro Ribeiro

Variational inequality problems are recognized for their broad applications across various fields including machine learning and operations research. First-order methods have emerged as the standard approach for solving these problems due…

Optimization and Control · Mathematics 2025-03-24 Liang Zhang , Niao He , Michael Muehlebach

This paper introduces a novel approach to contextual stochastic optimization, integrating operations research and machine learning to address decision-making under uncertainty. Traditional methods often fail to leverage contextual…

Machine Learning · Computer Science 2025-05-09 Louis Bouvier , Thibault Prunet , Vincent Leclère , Axel Parmentier

In the context of augmented Lagrangian approaches for solving semidefinite programming problems, we investigate the possibility of eliminating the positive semidefinite constraint on the dual matrix by employing a factorization. Hints on…

Optimization and Control · Mathematics 2018-09-12 Marianna De Santis , Franz Rendl , Angelika Wiegele

Discrete inverse problems correspond to solving a system of equations in a stable way with respect to noise in the data. A typical approach to enforce uniqueness and select a meaningful solution is to introduce a regularizer. While for most…

Optimization and Control · Mathematics 2022-04-22 Cristian Vega , Cesare Molinari , Lorenzo Rosasco , Silvia Villa

A sparse linear programming (SLP) problem is a linear programming problem equipped with a sparsity (or cardinality) constraint, which is nonconvex and discontinuous theoretically and generally NP-hard computationally due to the…

Optimization and Control · Mathematics 2018-06-05 Chen Zhao , Ziyan Luo , Weiyue Li , Houduo Qi , Naihua Xiu

We consider large-scale Markov decision processes with an unknown cost function and address the problem of learning a policy from a finite set of expert demonstrations. We assume that the learner is not allowed to interact with the expert…

Machine Learning · Computer Science 2021-12-30 Angeliki Kamoutsi , Goran Banjac , John Lygeros

We study deterministic and stochastic primal-dual sub-gradient algorithms for distributed optimization of a separable objective function with global inequality constraints. In both algorithms, the norm of the Lagrangian multipliers are…

Optimization and Control · Mathematics 2017-06-20 Masoud Badiei Khuzani , Na Li

This paper addresses the problem of formally verifying desirable properties of neural networks, i.e., obtaining provable guarantees that neural networks satisfy specifications relating their inputs and outputs (robustness to bounded norm…

Machine Learning · Computer Science 2018-08-06 Krishnamurthy , Dvijotham , Robert Stanforth , Sven Gowal , Timothy Mann , Pushmeet Kohli

Based on the complete-lattice approach, a new Lagrangian duality theory for set-valued optimization problems is presented. In contrast to previous approaches, set-valued versions for the known scalar formulas involving infimum and supremum…

Optimization and Control · Mathematics 2024-01-26 Andreas H. Hamel , Andreas Löhne

Lagrangian decomposition (LD) is a relaxation method that provides a dual bound for constrained optimization problems by decomposing them into more manageable sub-problems. This bound can be used in branch-and-bound algorithms to prune the…

Artificial Intelligence · Computer Science 2024-08-26 Swann Bessa , Darius Dabert , Max Bourgeat , Louis-Martin Rousseau , Quentin Cappart

For boolean quadratic programming (BQP), we will show that there is no duality gap between the primal and dual problems under some conditions by using the classical Lagrangian duality. A benchmark generator is given to create random BQP…

Numerical Analysis · Computer Science 2021-03-16 Xiaojun Zhou

We introduce a framework for designing primal methods under the decentralized optimization setting where local functions are smooth and strongly convex. Our approach consists of approximately solving a sequence of sub-problems induced by…

Optimization and Control · Mathematics 2020-06-15 Yossi Arjevani , Joan Bruna , Bugra Can , Mert Gürbüzbalaban , Stefanie Jegelka , Hongzhou Lin

In this paper we present a new Lagrange dual problem associated to a primal DC optimization problem under the additivity condition (AC). As usual for DC programming, even weak duality is not guaranteed for free and, due to this issue, we…

Optimization and Control · Mathematics 2025-03-28 M. D. Fajardo , J. Vidal-Nunez

We develop a second order primal-dual method for optimization problems in which the objective function is given by the sum of a strongly convex twice differentiable term and a possibly nondifferentiable convex regularizer. After introducing…

Optimization and Control · Mathematics 2020-08-31 Neil K. Dhingra , Sei Zhen Khong , Mihailo R. Jovanović

Most real world applications require dealing with stochasticity like sensor noise or predictive uncertainty, where formal specifications of desired behavior are inherently probabilistic. Despite the promise of formal verification in…

A fundamental component of neural network verification is the computation of bounds on the values their outputs can take. Previous methods have either used off-the-shelf solvers, discarding the problem structure, or relaxed the problem even…