English
Related papers

Related papers: Exact MAP inference in general higher-order graphi…

200 papers

We study the Maximum Weight Matching (MWM) problem for general graphs through the max-product Belief Propagation (BP) and related Linear Programming (LP). The BP approach provides distributed heuristics for finding the Maximum A Posteriori…

Data Structures and Algorithms · Computer Science 2018-01-03 Sungsoo Ahn , Michael Chertkov , Andrew E. Gelfand , Sejun Park , Jinwoo Shin

Many Bayesian statistical inference problems come down to computing a maximum a-posteriori (MAP) assignment of latent variables. Yet, standard methods for estimating the MAP assignment do not have a finite time guarantee that the algorithm…

Machine Learning · Statistics 2024-10-31 Harsh Vardhan Dubey , Ji Ah Lee , Patrick Flaherty

Approximate algorithms for structured prediction problems---such as LP relaxations and the popular alpha-expansion algorithm (Boykov et al. 2001)---typically far exceed their theoretical performance guarantees on real-world instances. These…

Machine Learning · Statistics 2018-04-24 Hunter Lang , David Sontag , Aravindan Vijayaraghavan

Probabilistic inference in pairwise Markov Random Fields (MRFs), i.e. computing the partition function or computing a MAP estimate of the variables, is a foundational problem in probabilistic graphical models. Semidefinite programming…

Machine Learning · Computer Science 2021-05-04 Chirag Pabbaraju , Po-Wei Wang , J. Zico Kolter

Computing the conditional mode of a distribution, better known as the $\mathit{maximum\ a\ posteriori}$ (MAP) assignment, is a fundamental task in probabilistic inference. However, MAP estimation is generally intractable, and remains hard…

Machine Learning · Computer Science 2026-01-23 Matthew Shorvon , Frederik Mallmann-Trenn , David S. Watson

Finding the most probable assignment (MAP) in a general graphical model is known to be NP hard but good approximations have been attained with max-product belief propagation (BP) and its variants. In particular, it is known that using BP on…

Artificial Intelligence · Computer Science 2012-06-26 Yair Weiss , Chen Yanover , Talya Meltzer

In many safety-critical settings, probabilistic ML systems have to make predictions subject to algebraic constraints, e.g., predicting the most likely trajectory that does not cross obstacles. These real-world constraints are rarely convex,…

Machine Learning · Computer Science 2026-02-11 Leander Kurscheidt , Gabriele Masina , Roberto Sebastiani , Antonio Vergari

Marginal MAP inference involves making MAP predictions in systems defined with latent variables or missing information. It is significantly more difficult than pure marginalization and MAP tasks, for which a large class of efficient and…

Machine Learning · Computer Science 2015-11-10 Wei Ping , Qiang Liu , Alexander Ihler

Dual decomposition provides a tractable framework for designing algorithms for finding the most probable (MAP) configuration in graphical models. However, for many real-world inference problems, the typical decomposition has a large…

Data Structures and Algorithms · Computer Science 2012-10-19 David Sontag , Do Kook Choe , Yitao Li

Belief Propagation (BP) is a popular, distributed heuristic for performing MAP computations in Graphical Models. BP can be interpreted, from a variational perspective, as minimizing the Bethe Free Energy (BFE). BP can also be used to solve…

Artificial Intelligence · Computer Science 2013-05-20 Andrew Gelfand , Jinwoo Shin , Michael Chertkov

The marginal maximum a posteriori probability (MAP) estimation problem, which calculates the mode of the marginal posterior distribution of a subset of variables with the remaining variables marginalized, is an important inference problem…

Machine Learning · Statistics 2013-07-19 Qiang Liu , Alexander Ihler

Markov random fields (MRFs) are a powerful tool for modelling statistical dependencies for a set of random variables using a graphical representation. An important computational problem related to MRFs, called maximum a posteriori (MAP)…

Data Structures and Algorithms · Computer Science 2017-08-11 Alexander Bauer , Shinichi Nakajima , Nico Görnitz , Klaus-Robert Müller

The Method of Alternating Projections (MAP), a classical algorithm for solving feasibility prob- lems, has recently been intensely studied for nonconvex sets. However, intrinsically available are only local convergence results: convergence…

Optimization and Control · Mathematics 2013-05-21 Heinz H. Bauschke , Hung M. Phan , Xianfu Wang

The Mapper algorithm is an essential tool for visualizing complex, high dimensional data in topology data analysis (TDA) and has been widely used in biomedical research. It outputs a combinatorial graph whose structure implies the shape of…

Machine Learning · Computer Science 2025-04-24 Yuyang Tao , Shufei Ge

In this paper, we propose novel algorithms for inferring the Maximum a Posteriori (MAP) solution of discrete pairwise random field models under multiple constraints. We show how this constrained discrete optimization problem can be…

Machine Learning · Computer Science 2013-08-02 Yongsub Lim , Kyomin Jung , Pushmeet Kohli

We generalize the reduction mechanism for linear programming problems and semidefinite programming problems from [arXiv:1410.8816] in two ways 1) relaxing the requirement of affineness and 2) extending to fractional optimization problems.…

Computational Complexity · Computer Science 2018-10-23 Gábor Braun , Sebastian Pokutta , Aurko Roy

We prove that the $\alpha$-expansion algorithm for MAP inference always returns a globally optimal assignment for Markov Random Fields with Potts pairwise potentials, with a catch: the returned assignment is only guaranteed to be optimal…

Machine Learning · Statistics 2021-06-16 Hunter Lang , David Sontag , Aravindan Vijayaraghavan

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

It is well-known that by adding integrality constraints to the semidefinite programming (SDP) relaxation of the max-cut problem, the resulting integer semidefinite program is an exact formulation of the problem. In this paper we show…

Optimization and Control · Mathematics 2023-11-09 Frank de Meijer , Renata Sotirov

The importance of aggregated count data, which is calculated from the data of multiple individuals, continues to increase. Collective Graphical Model (CGM) is a probabilistic approach to the analysis of aggregated data. One of the most…

Machine Learning · Statistics 2021-02-19 Yasunori Akagi , Naoki Marumo , Hideaki Kim , Takeshi Kurashima , Hiroyuki Toda