English
Related papers

Related papers: Lagrangian Relaxation for MAP Estimation in Graphi…

200 papers

This paper is concerned with the problem of exact MAP inference in general higher-order graphical models by means of a traditional linear programming relaxation approach. In fact, the proof that we have developed in this paper is a rather…

Optimization and Control · Mathematics 2026-03-23 Ikhlef Bechar

Lagrangian relaxation is a versatile mathematical technique employed to relax constraints in an optimization problem, enabling the generation of dual bounds to prove the optimality of feasible solutions and the design of efficient…

Artificial Intelligence · Computer Science 2023-12-25 Augustin Parjadis , Quentin Cappart , Bistra Dilkina , Aaron Ferber , Louis-Martin Rousseau

Dual decomposition approaches in nonconvex optimization may suffer from a duality gap. This poses a challenge when applying them directly to nonconvex problems such as MAP-inference in a Markov random field (MRF) with continuous state…

Optimization and Control · Mathematics 2022-05-17 Hartmut Bauermeister , Emanuel Laude , Thomas Möllenhoff , Michael Moeller , Daniel Cremers

Energy minimization algorithms, such as graph cuts, enable the computation of the MAP solution under certain probabilistic models such as Markov random fields. However, for many computer vision problems, the MAP solution under the model is…

Computer Vision and Pattern Recognition · Computer Science 2013-07-31 Yongsub Lim , Kyomin Jung , Pushmeet Kohli

In this paper, we propose novel algorithms for inferring the Maximum a Posteriori (MAP) solution of discrete pairwise random field models under multiple constraints. We show how this constrained discrete optimization problem can be…

Machine Learning · Computer Science 2013-08-02 Yongsub Lim , Kyomin Jung , Pushmeet Kohli

The Knapsack Problem is a classic problem in combinatorial optimisation. Solving these problems may be computationally expensive. Recent years have seen a growing interest in the use of deep learning methods to approximate the solutions to…

Machine Learning · Computer Science 2023-12-07 Mitchell Keegan , Mahdi Abolghasemi

We consider the NP-hard problem of MAP-inference for undirected discrete graphical models. We propose a polynomial time and practically efficient algorithm for finding a part of its optimal solution. Specifically, our algorithm marks some…

Computer Vision and Pattern Recognition · Computer Science 2017-02-06 Alexander Shekhovtsov , Paul Swoboda , Bogdan Savchynskyy

Lagrangian Relaxation (LR) is a powerful technique for solving large-scale Mixed Integer Linear Programming (MILP), particularly those with decomposable structures, such as vehicle routing or unit commitment problems. By relaxing the…

Machine Learning · Statistics 2026-05-27 Tung Quoc Le , Anh Tuan Nguyen , Viet Anh Nguyen

We develop and analyze methods for computing provably optimal {\em maximum a posteriori} (MAP) configurations for a subclass of Markov random fields defined on graphs with cycles. By decomposing the original distribution into a convex…

Information Theory · Computer Science 2007-07-13 Martin J. Wainwright , Tommi S. Jaakkola , Alan S. Willsky

We propose a new integer programming formulation for the problem of finding a maximum stable set of a graph based on representatives of stable sets. In addition, we investigate exact solutions provided by a Lagrangian decomposition of this…

Discrete Mathematics · Computer Science 2009-03-10 Manoel Campelo , Ricardo C. Correa

We prove a general result demonstrating the power of Lagrangian relaxation in solving constrained maximization problems with arbitrary objective functions. This yields a unified approach for solving a wide class of {\em subset selection}…

Data Structures and Algorithms · Computer Science 2015-12-22 Ariel Kulik , Hadas Shachnai , Gal Tamir

Optimization problems with norm-bounding constraints arise in a variety of applications, including portfolio optimization, machine learning, and feature selection. A common approach to these problems involves relaxing the norm constraint…

Optimization and Control · Mathematics 2025-05-08 Danial Davarnia , Mohammadreza Kiaghadi

We consider the MAP-inference problem for graphical models, which is a valued constraint satisfaction problem defined on real numbers with a natural summation operation. We propose a family of relaxations (different from the famous…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Stefan Haller , Paul Swoboda , Bogdan Savchynskyy

Dual decomposition, and more generally Lagrangian relaxation, is a classical method for combinatorial optimization; it has recently been applied to several inference problems in natural language processing (NLP). This tutorial gives an…

Computation and Language · Computer Science 2014-05-21 Alexander M. Rush , Michael Collins

By exploiting double-penalty terms for the primal subproblem, we develop a novel relaxed augmented Lagrangian method for solving a family of convex optimization problems subject to equality or inequality constraints. The method is then…

Numerical Analysis · Mathematics 2025-06-16 Jianchao Bai , Linyuan Jia , Zheng Peng

LP relaxation-based message passing algorithms provide an effective tool for MAP inference over Probabilistic Graphical Models. However, different LP relaxations often have different objective functions and variables of differing…

Computer Vision and Pattern Recognition · Computer Science 2014-04-22 Zhen Zhang , Qinfeng Shi , Yanning Zhang , Chunhua Shen , Anton van den Hengel

This paper presents the Lagrangian duality theory for mixed-integer semidefinite programming (MISDP). We derive the Lagrangian dual problem and prove that the resulting Lagrangian dual bound dominates the bound obtained from the continuous…

Optimization and Control · Mathematics 2025-07-10 Frank de Meijer , Renata Sotirov

Lagrangian relaxation stands among the most efficient approaches for solving a Mixed Integer Linear Programs (MILP) with difficult constraints. Given any duals for these constraints, called Lagrangian Multipliers (LMs), it returns a bound…

Machine Learning · Computer Science 2024-10-21 Francesco Demelas , Joseph Le Roux , Mathieu Lacroix , Axel Parmentier

We propose a new first-order primal-dual optimization framework for a convex optimization template with broad applications. Our optimization algorithms feature optimal convergence guarantees under a variety of common structure assumptions…

Optimization and Control · Mathematics 2018-02-23 Quoc Tran-Dinh , Olivier Fercoq , Volkan Cevher

This paper addresses the Graph Matching problem, which consists of finding the best possible alignment between two input graphs, and has many applications in computer vision, network deanonymization and protein alignment. A common approach…

Machine Learning · Statistics 2024-08-12 Ernesto Araya Valdivia , Hemant Tyagi
‹ Prev 1 2 3 10 Next ›