English
Related papers

Related papers: Variational Algorithms for Marginal MAP

200 papers

Universality, namely distributional invariance, is a well-known property for many random structures. For example, it is known to hold for a broad range of variational problems with random input. Much less is known about the algorithmic…

Data Structures and Algorithms · Computer Science 2025-12-25 Houssam El Cheairi , David Gamarnik

Message passing (MP) is a computational technique used to find approximate solutions to a variety of problems defined on networks. MP approximations are generally accurate in locally tree-like networks but require corrections to maintain…

Physics and Society · Physics 2023-09-27 George T. Cantwell , Alec Kirkley , Filippo Radicchi

We describe a variational approximation method for efficient inference in large-scale probabilistic models. Variational methods are deterministic procedures that provide approximations to marginal and conditional probabilities of interest.…

Artificial Intelligence · Computer Science 2011-05-30 T. S. Jaakkola , M. I. Jordan

Markov Chain Monte Carlo (MCMC) and Belief Propagation (BP) are the most popular algorithms for computational inference in Graphical Models (GM). In principle, MCMC is an exact probabilistic method which, however, often suffers from…

Machine Learning · Statistics 2020-05-12 Sungsoo Ahn , Michael Chertkov , Jinwoo Shin

We consider planning problems for graphs, Markov decision processes (MDPs), and games on graphs. While graphs represent the most basic planning model, MDPs represent interaction with nature and games on graphs represent interaction with an…

Data Structures and Algorithms · Computer Science 2018-04-20 Krishnendu Chatterjee , Wolfgang Dvořák , Monika Henzinger , Alexander Svozil

Approximate message passing (AMP) is a family of iterative algorithms that generalize matrix power iteration. AMP algorithms are known to optimally solve many average-case optimization problems. In this paper, we show that a large class of…

Data Structures and Algorithms · Computer Science 2023-11-16 Misha Ivkov , Tselil Schramm

We consider the estimation of an i.i.d. (possibly non-Gaussian) vector $\xbf \in \R^n$ from measurements $\ybf \in \R^m$ obtained by a general cascade model consisting of a known linear transform followed by a probabilistic componentwise…

Information Theory · Computer Science 2012-12-04 Ulugbek S. Kamilov , Sundeep Rangan , Alyson K. Fletcher , Michael Unser

This article presents a new search algorithm for the NP-hard problem of optimizing functions of binary variables that decompose according to a graphical model. It can be applied to models of any order and structure. The main novelty is a…

Data Structures and Algorithms · Computer Science 2010-09-22 Bjoern Andres , Joerg H. Kappes , Ullrich Koethe , Fred A. Hamprecht

Approximate Message Passing (AMP) algorithms are a family of iterative algorithms based on large random matrices with the special property of tracking the statistical properties of their iterates. They are used in various fields such as…

Probability · Mathematics 2025-03-27 Mohammed-Younes Gueddari , Walid Hachem , Jamal Najim

Discretizing Helmholtz problems via finite elements yields linear systems whose efficient solution remains a major challenge for classical computation. In this paper, we investigate how variational quantum algorithms could address this…

Quantum Physics · Physics 2025-12-30 Arnaud Rémi , François Damanet , Christophe Geuzaine

The goal in {\em reconfiguration problems} is to compute a {\em gradual transformation} between two feasible solutions of a problem such that all intermediate solutions are also feasible. In the {\em Matching Reconfiguration Problem} (MRP),…

Data Structures and Algorithms · Computer Science 2020-05-07 Noam Solomon , Shay Solomon

Representing a manifold of very high-dimensional data with generative models has been shown to be computationally efficient in practice. However, this requires that the data manifold admits a global parameterization. In order to represent…

Machine Learning · Computer Science 2024-08-13 Giovanni S. Alberti , Johannes Hertrich , Matteo Santacesaria , Silvia Sciutto

We present a new proximal bundle method for Maximum-A-Posteriori (MAP) inference in structured energy minimization problems. The method optimizes a Lagrangean relaxation of the original energy minimization problem using a multi plane…

Machine Learning · Computer Science 2019-04-08 Paul Swoboda , Vladimir Kolmogorov

With the fast growth of communication networks, the video data transmission from these networks is extremely vulnerable. Error concealment is a technique to estimate the damaged data by employing the correctly received data at the decoder.…

Multimedia · Computer Science 2016-10-26 Seyed Mojtaba Marvasti-Zadeh , Hossein Ghanei-Yakhdan , Shohreh Kasaei

We study multi-marginal optimal transport (MOT) problems where the underlying cost has a graphical structure. These graphical multi-marginal optimal transport problems have found applications in several domains including traffic flow…

Optimization and Control · Mathematics 2025-12-02 Jiaojiao Fan , Isabel Haasler , Qinsheng Zhang , Johan Karlsson , Yongxin Chen

This paper proposes a Riemannian Multiobjective Proximal Gradient Method (RMPGM) for composite optimization problems on manifolds. Unlike scalarization-based approaches, the proposed framework directly handles vector-valued objectives and…

Optimization and Control · Mathematics 2026-05-19 Kangming Chen

Global variational approximation methods in graphical models allow efficient approximate inference of complex posterior distributions by using a simpler model. The choice of the approximating model determines a tradeoff between the…

Artificial Intelligence · Computer Science 2013-01-14 Tal El-Hay , Nir Friedman

Variational methods are employed in situations where exact Bayesian inference becomes intractable due to the difficulty in performing certain integrals. Typically, variational methods postulate a tractable posterior and formulate a lower…

Machine Learning · Statistics 2019-06-12 Nikolaos Gianniotis , Christoph Schnörr , Christian Molkenthin , Sanjay Singh Bora

We study fundamental graph problems such as graph connectivity, minimum spanning forest (MSF), and approximate maximum (weight) matching in a distributed setting. In particular, we focus on the Adaptive Massively Parallel Computation (AMPC)…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-25 Soheil Behnezhad , Laxman Dhulipala , Hossein Esfandiari , Jakub Łącki , Vahab Mirrokni , Warren Schudy

Mean-Field is an efficient way to approximate a posterior distribution in complex graphical models and constitutes the most popular class of Bayesian variational approximation methods. In most applications, the mean field distribution…

Machine Learning · Computer Science 2015-02-23 Pierre Baqué , Jean-Hubert Hours , François Fleuret , Pascal Fua