English
Related papers

Related papers: Generalized sequential tree-reweighted message pas…

200 papers

We propose a new family of message passing techniques for MAP estimation in graphical models which we call {\em Sequential Reweighted Message Passing} (SRMP). Special cases include well-known techniques such as {\em Min-Sum Diffusion} (MSD)…

Artificial Intelligence · Computer Science 2017-01-20 Vladimir Kolmogorov

Inference problems in graphical models are often approximated by casting them as constrained optimization problems. Message passing algorithms, such as belief propagation, have previously been suggested as methods for solving these…

Machine Learning · Computer Science 2012-06-26 Amir Globerson , Tommi S. Jaakkola

We analyze variational inference for highly symmetric graphical models such as those arising from first-order probabilistic models. We first show that for these graphical models, the tree-reweighted variational objective lends itself to a…

Artificial Intelligence · Computer Science 2014-06-23 Hung Hai Bui , Tuyen N. Huynh , David Sontag

We consider the linear programming relaxation of an energy minimization problem for Markov Random Fields. The dual objective of this problem can be treated as a concave and unconstrained, but non-smooth function. The idea of smoothing the…

Artificial Intelligence · Computer Science 2012-10-19 Bogdan Savchynskyy , Stefan Schmidt , Joerg Kappes , Christoph Schnoerr

The graph matching problem is a significant special case of the Quadratic Assignment Problem, with extensive applications in pattern recognition, computer vision, protein alignments and related fields. As the problem is NP-hard, relaxation…

Optimization and Control · Mathematics 2025-04-01 Rongxuan Li

In this letter, we propose an algorithm for learning a sparse weighted graph by estimating its adjacency matrix under the assumption that the observed signals vary smoothly over the nodes of the graph. The proposed algorithm is based on the…

Signal Processing · Electrical Eng. & Systems 2022-05-11 Ghania Fatima , Aakash Arora , Prabhu Babu , Petre Stoica

Probabilistic graphical models provide a powerful tool to describe complex statistical structure, with many real-world applications in science and engineering from controlling robotic arms to understanding neuronal computations. A major…

Artificial Intelligence · Computer Science 2023-05-04 Yicheng Fei , Xaq Pitkow

We introduce a globally-convergent algorithm for optimizing the tree-reweighted (TRW) variational objective over the marginal polytope. The algorithm is based on the conditional gradient method (Frank-Wolfe) and moves pseudomarginals within…

Machine Learning · Statistics 2015-11-26 Rahul G. Krishnan , Simon Lacoste-Julien , David Sontag

A popular class of algorithms to optimize the dual LP relaxation of the discrete energy minimization problem (a.k.a.\ MAP inference in graphical models or valued constraint satisfaction) are convergent message-passing algorithms, such as…

Optimization and Control · Mathematics 2017-09-18 Tomas Werner

We describe a new technique for computing lower-bounds on the minimum energy configuration of a planar Markov Random Field (MRF). Our method successively adds large numbers of constraints and enforces consistency over binary projections of…

Machine Learning · Computer Science 2012-02-20 Julian Yarkony , Ragib Morshed , Alexander T. Ihler , Charless C. Fowlkes

A large number of problems in computer vision can be modelled as energy minimization problems in a Markov Random Field (MRF) or Conditional Random Field (CRF) framework. Graph-cuts based $\alpha$-expansion is a standard move-making method…

Computer Vision and Pattern Recognition · Computer Science 2014-03-26 Vibhav Vineet , Jonathan Warrell , Philip H. S. Torr

We propose a general framework for deriving generalization bounds for parallel positively homogeneous neural networks--a class of neural networks whose input-output map decomposes as the sum of positively homogeneous maps. Examples of such…

Machine Learning · Computer Science 2025-03-20 Uday Kiran Reddy Tadipatri , Benjamin D. Haeffele , Joshua Agterberg , René Vidal

We present a general method of designing fast approximation algorithms for cut-based minimization problems in undirected graphs. In particular, we develop a technique that given any such problem that can be approximated quickly on trees,…

Data Structures and Algorithms · Computer Science 2010-11-09 Aleksander Madry

We develop and analyze methods for computing provably optimal {\em maximum a posteriori} (MAP) configurations for a subclass of Markov random fields defined on graphs with cycles. By decomposing the original distribution into a convex…

Information Theory · Computer Science 2007-07-13 Martin J. Wainwright , Tommi S. Jaakkola , Alan S. Willsky

Nowadays, the availability of large-scale data in disparate application domains urges the deployment of sophisticated tools for extracting valuable knowledge out of this huge bulk of information. In that vein, low-rank representations…

Machine Learning · Computer Science 2017-10-06 Paris V. Giampouras , Athanasios A. Rontogiannis , Konstantinos D. Koutroumbas

Weighted low rank approximation (WLRA) is an important yet computationally challenging primitive with applications ranging from statistical analysis, model compression, and signal processing. To cope with the NP-hardness of this problem,…

Data Structures and Algorithms · Computer Science 2024-06-05 David P. Woodruff , Taisuke Yasuda

We consider the structured-output prediction problem through probabilistic approaches and generalize the "perturb-and-MAP" framework to more challenging weighted Hamming losses, which are crucial in applications. While in principle our…

Machine Learning · Statistics 2018-11-22 Tatiana Shpakova , Francis Bach , Anton Osokin

In this paper, we will present a generalization for a minimization problem from I. Daubechies, M. Defrise, and C. Demol [3]. This generalization is useful for solving many practical problems in which more than one constraint are involved.…

Optimization and Control · Mathematics 2019-12-20 Saman Khoramian

Combining the techniques of approximation algorithms and parameterized complexity has long been considered a promising research area, but relatively few results are currently known. In this paper we study the parameterized approximability…

Data Structures and Algorithms · Computer Science 2014-02-18 Michael Lampis

The marginal maximum a posteriori probability (MAP) estimation problem, which calculates the mode of the marginal posterior distribution of a subset of variables with the remaining variables marginalized, is an important inference problem…

Machine Learning · Statistics 2013-07-19 Qiang Liu , Alexander Ihler
‹ Prev 1 2 3 10 Next ›