English
Related papers

Related papers: On the Partition Function and Random Maximum A-Pos…

200 papers

Partitioning a set of elements into an unknown number of mutually exclusive subsets is essential in many machine learning problems. However, assigning elements, such as samples in a dataset or neurons in a network layer, to an unknown and…

Machine Learning · Computer Science 2023-11-10 Thomas M. Sutter , Alain Ryser , Joram Liebeskind , Julia E. Vogt

We develop and analyze methods for computing provably optimal {\em maximum a posteriori} (MAP) configurations for a subclass of Markov random fields defined on graphs with cycles. By decomposing the original distribution into a convex…

Information Theory · Computer Science 2007-07-13 Martin J. Wainwright , Tommi S. Jaakkola , Alan S. Willsky

Distributed computing excels at processing large scale data, but the communication cost for synchronizing the shared parameters may slow down the overall performance. Fortunately, the interactions between parameter and data in many problems…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-19 Mu Li , Dave G. Andersen , Alexander J. Smola

Partition of unity methods (PUMs) on graphs are simple and highly adaptive auxiliary tools for graph signal processing. Based on a greedy-type metric clustering and augmentation scheme, we show how a partition of unity can be generated in…

Signal Processing · Electrical Eng. & Systems 2020-12-22 Roberto Cavoretto , Alessandra De Rossi , Wolfgang Erb

We present a new proximal bundle method for Maximum-A-Posteriori (MAP) inference in structured energy minimization problems. The method optimizes a Lagrangean relaxation of the original energy minimization problem using a multi plane…

Machine Learning · Computer Science 2019-04-08 Paul Swoboda , Vladimir Kolmogorov

This paper deals with the question of conditional sampling and prediction for the class of stationary max-stable processes which allow for a mixed moving maxima representation. We develop an exact procedure for conditional sampling using…

Probability · Mathematics 2014-03-25 Marco Oesting , Martin Schlather

Decision making under uncertainty is at the heart of any autonomous system acting with imperfect information. The cost of solving the decision making problem is exponential in the action and observation spaces, thus rendering it unfeasible…

Artificial Intelligence · Computer Science 2024-06-18 Tom Yotam , Vadim Indelman

We propose a computational framework to quantify (measure) and to optimize the reliability of complex systems. The approach uses a graph representation of the system that is subject to random failures of its components (nodes and edges).…

Optimization and Control · Mathematics 2021-06-25 Joshua L. Pulsipher , Victor M. Zavala

Although symmetry methods and analysis are a necessary ingredient in every physicist's toolkit, rather less use has been made of combinatorial methods. One exception is in the realm of Statistical Physics, where the calculation of the…

Quantum Physics · Physics 2007-05-23 Allan I. Solomon , Pawel Blasiak , Gerard Duchamp , Andrzej Horzela , Karol A. Penson

We consider running-time optimization for band-joins in a distributed system, e.g., the cloud. To balance load across worker machines, input has to be partitioned, which causes duplication. We explore how to resolve this tension between…

Databases · Computer Science 2020-04-15 Rundong Li , Wolfgang Gatterbauer , Mirek Riedewald

Probabilistic circuits (PCs) such as sum-product networks efficiently represent large multi-variate probability distributions. They are preferred in practice over other probabilistic representations such as Bayesian and Markov networks…

Machine Learning · Computer Science 2024-02-07 Shivvrat Arya , Tahrima Rahman , Vibhav Gogate

We study graph parameters whose associated edge-connection matrices have exponentially bounded rank growth. Our main result is an explicit construction of a large class of graph parameters with this property that we call mixed partition…

Combinatorics · Mathematics 2020-06-16 Guus Regts , Bart Sevenster

Graph partitioning is the problem of dividing the nodes of a graph into balanced partitions while minimizing the edge cut across the partitions. Due to its combinatorial nature, many approximate solutions have been developed, including…

Machine Learning · Computer Science 2019-03-05 Azade Nazi , Will Hang , Anna Goldie , Sujith Ravi , Azalia Mirhoseini

In this paper the Partition of Unity Method (PUM) is efficiently performed using Radial Basis Functions (RBFs) as local approximants. In particular, we present a new space-partitioning data structure extremely useful in applications because…

Numerical Analysis · Mathematics 2015-12-15 Alessandra De Rossi , Roberto Cavoretto , Emma Perracchione

The autonomous systems need to decide how to react to the changes at runtime efficiently. The ability to rigorously analyze the environment and the system together is theoretically possible by the model-driven approaches; however, the model…

Software Engineering · Computer Science 2021-10-28 Melika Dastranj , Mehran Alidoost Nia , Mehdi Kargahi

We study a graph partitioning problem motivated by the simulation of the physical movement of multi-body systems on an atomistic level, where the forces are calculated from a quantum mechanical description of the electrons. Several advanced…

Analyzing large graph data is an essential part of many modern applications, such as social networks. Due to its large computational complexity, distributed processing is frequently employed. This requires graph data to be divided across…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-12 YoungJoon Park , DongKyu Lee , Tien-Cuong Bui

A new approach to maximum likelihood learning of discrete graphical models and RBM in particular is introduced. Our method, Perturb and Descend (PD) is inspired by two ideas (I) perturb and MAP method for sampling (II) learning by…

Neural and Evolutionary Computing · Computer Science 2014-05-08 Siamak Ravanbakhsh , Russell Greiner , Brendan Frey

An emerging trend in approximate counting is to show that certain `low-temperature' problems are easy on typical instances, despite worst-case hardness results. For the class of regular graphs one usually shows that expansion can be…

Data Structures and Algorithms · Computer Science 2024-02-06 Charles Carlson , Ewan Davies , Alexandra Kolla

In this paper we consider a novel partitioned framework for distributed optimization in peer-to-peer networks. In several important applications the agents of a network have to solve an optimization problem with two key features: (i) the…

Systems and Control · Computer Science 2018-05-23 Ivano Notarnicola , Ruggero Carli , Giuseppe Notarstefano