English
Related papers

Related papers: Variational Algorithms for Marginal MAP

200 papers

We present a probabilistic graphical model formulation for the graph clustering problem. This enables to locally represent uncertainty of image partitions by approximate marginal distributions in a mathematically substantiated way, and to…

Computer Vision and Pattern Recognition · Computer Science 2016-01-12 Jörg Hendrik Kappes , Paul Swoboda , Bogdan Savchynskyy , Tamir Hazan , Christoph Schnörr

Much effort has been directed at algorithms for obtaining the highest probability configuration in a probabilistic random field model known as the maximum a posteriori (MAP) inference problem. In many situations, one could benefit from…

Artificial Intelligence · Computer Science 2012-10-19 Dhruv Batra

Inference methods are often formulated as variational approximations: these approximations allow easy evaluation of statistics by marginalization or linear response, but these estimates can be inconsistent. We show that by introducing…

Machine Learning · Statistics 2017-04-27 Jack Raymond , Federico Ricci-Tersenghi

Gaussian and quadratic approximations of message passing algorithms on graphs have attracted considerable recent attention due to their computational simplicity, analytic tractability, and wide applicability in optimization and statistical…

Information Theory · Computer Science 2026-03-12 Sundeep Rangan , Alyson K. Fletcher , Vivek K. Goyal , Evan Byrne , Philip Schniter

Continuous-time Bayesian networks is a natural structured representation language for multicomponent stochastic processes that evolve continuously over time. Despite the compact representation, inference in such models is intractable even…

Artificial Intelligence · Computer Science 2012-05-14 Ido Cohn , Tal El-Hay , Nir Friedman , Raz Kupferman

We consider the structured-output prediction problem through probabilistic approaches and generalize the "perturb-and-MAP" framework to more challenging weighted Hamming losses, which are crucial in applications. While in principle our…

Machine Learning · Statistics 2018-11-22 Tatiana Shpakova , Francis Bach , Anton Osokin

Generalized approximate message passing (GAMP) is a promising technique for unknown signal reconstruction of generalized linear models (GLM). However, it requires that the transformation matrix has independent and identically distributed…

Information Theory · Computer Science 2021-10-18 Feiyan Tian , Lei Liu , Xiaoming Chen

In solving the variational problem, the key is to efficiently find the target function that minimizes or maximizes the specified functional. In this paper, by using the Pade approximant, we suggest a methods for the variational problem. By…

Numerical Analysis · Mathematics 2020-04-03 Chi-Chun Zhou , Yi Liu

The MAP problem in Bayesian networks is notoriously intractable, even when approximated. In an earlier paper we introduced the Most Frugal Explanation heuristic approach to solving MAP, by partitioning the set of intermediate variables…

Artificial Intelligence · Computer Science 2024-12-13 Johan Kwisthout , Andrew Schroeder

Boundary element methods (BEM) reduce a partial differential equation in a domain to an integral equation on the domain's boundary. They are particularly attractive for solving problems on unbounded domains, but handling the dense matrices…

Numerical Analysis · Mathematics 2020-06-30 Steffen Börm

A novel boundary element method (BEM) removes the classical dependence on explicit fundamental solutions and extends quasi-optimal BEM discretisations to strongly elliptic operators with variable coefficients. The approach constructs a…

Numerical Analysis · Mathematics 2026-05-22 Benedikt Gräßle , Stefan A. Sauter

We consider the problem of signal estimation in generalized linear models defined via rotationally invariant design matrices. Since these matrices can have an arbitrary spectral distribution, this model is well suited for capturing complex…

Machine Learning · Statistics 2022-06-10 Ramji Venkataramanan , Kevin Kögler , Marco Mondelli

We examine the \emph{submodular maximum coverage problem} (SMCP), which is related to a wide range of applications. We provide the first variational approximation for this problem based on the Nemhauser divergence, and show that it can be…

Machine Learning · Computer Science 2020-06-11 Jian Du , Zhigang Hua , Shuang Yang

Local solutions for variational and quasi-variational inequalities are usually the best type of solutions that could practically be obtained when in case of lack of convexity or else when available numerical techniques are too limited for…

Optimization and Control · Mathematics 2024-05-16 Didier Aussel , Parin Chaipunya

Approximating marginals of a graphical model is one of the fundamental problems in the theory of networks. In a recent paper a method was shown to construct a variational free energy such that the linear response estimates, and maximum…

Disordered Systems and Neural Networks · Physics 2014-05-01 Jack Raymond , Federico Ricci-Tersenghi

Discrete variational methods have shown an excellent performance in numerical simulations of different mechanical systems. In this paper, we introduce an iterative method for discrete variational methods appropriate for boundary value…

Numerical Analysis · Mathematics 2021-09-14 Sebastián J. Ferraro , David Martín de Diego , Rodrigo T. Sato Martín de Almagro

We present an alternate formulation of the partial assignment problem as matching random clique complexes, that are higher-order analogues of random graphs, designed to provide a set of invariants that better detect higher-order structure.…

Machine Learning · Computer Science 2020-07-30 Charu Sharma , Deepak Nathani , Manohar Kaul

Maximum a posteriori (MAP) inference in discrete-valued Markov random fields is a fundamental problem in machine learning that involves identifying the most likely configuration of random variables given a distribution. Due to the…

Machine Learning · Computer Science 2020-07-03 Jonathan N. Lee , Aldo Pacchiano , Peter Bartlett , Michael I. Jordan

A general framework for solving image inverse problems is introduced in this paper. The approach is based on Gaussian mixture models, estimated via a computationally efficient MAP-EM algorithm. A dual mathematical interpretation of the…

Computer Vision and Pattern Recognition · Computer Science 2010-06-16 Guoshen Yu , Guillermo Sapiro , Stéphane Mallat

This paper addresses the problem of approximate MAP-MRF inference in general graphical models. Following [36], we consider a family of linear programming relaxations of the problem where each relaxation is specified by a set of nested pairs…

Computer Vision and Pattern Recognition · Computer Science 2015-03-20 Vladimir Kolmogorov , Thomas Schoenemann