English
Related papers

Related papers: Linear and Parallel Learning of Markov Random Fiel…

200 papers

Learning the undirected graph structure of a Markov network from data is a problem that has received a lot of attention during the last few decades. As a result of the general applicability of the model class, a myriad of methods have been…

We present an integrated approach for structure and parameter estimation in latent tree graphical models. Our overall approach follows a "divide-and-conquer" strategy that learns models over small groups of variables and iteratively merges…

Machine Learning · Computer Science 2019-12-19 Furong Huang , Niranjan U. N. , Ioakeim Perros , Robert Chen , Jimeng Sun , Anima Anandkumar

We introduce a novel algorithm for estimating optimal parameters of linearized assignment flows for image labeling. An exact formula is derived for the parameter gradient of any loss function that is constrained by the linear system of ODEs…

Machine Learning · Computer Science 2022-04-07 Alexander Zeilmann , Stefania Petra , Christoph Schnörr

We present a new, deterministic, distributed MAP estimation algorithm for Markov Random Fields called Local Highest Confidence First (Local HCF). The algorithm has been applied to segmentation problems in computer vision and its performance…

Artificial Intelligence · Computer Science 2013-04-08 Michael J. Swain , Lambert E. Wixson , Paul B. Chou

The objective of this article is to study the asymptotic behavior of a new particle filtering approach in the context of hidden Markov models (HMMs). In particular, we develop an algorithm where the latent-state sequence is segmented into…

Statistics Theory · Mathematics 2014-09-16 Hock Peng Chan , Chiang Wee Heng , Ajay Jasra

In this paper, we propose a new framework for designing fast parallel algorithms for fundamental statistical subset selection tasks that include feature selection and experimental design. Such tasks are known to be weakly submodular and are…

Machine Learning · Computer Science 2021-04-02 Sharon Qian , Yaron Singer

Parametric Markov chains occur quite naturally in various applications: they can be used for a conservative analysis of probabilistic systems (no matter how the parameter is chosen, the system works to specification); they can be used to…

Logic in Computer Science · Computer Science 2018-11-05 Paul Gainer , Ernst Moritz Hahn , Sven Schewe

Markov Chain Monte Carlo (MCMC) algorithms are essential tools in computational statistics for sampling from unnormalised probability distributions, but can be fragile when targeting high-dimensional, multimodal, or complex target…

We consider versions of the Metropolis algorithm which avoid the inefficiency of rejections. We first illustrate that a natural Uniform Selection Algorithm might not converge to the correct distribution. We then analyse the use of Markov…

Statistics Theory · Mathematics 2024-04-04 J. S. Rosenthal , A. Dote , K. Dabiri , H. Tamura , S. Chen , A. Sheikholeslami

Hidden Markov models have successfully been applied as models of discrete time series in many fields. Often, when applied in practice, the parameters of these models have to be estimated. The currently predominating identification methods,…

Machine Learning · Statistics 2015-07-24 Robert Mattila , Cristian R. Rojas , Bo Wahlberg

We consider learning a sparse pairwise Markov Random Field (MRF) with continuous-valued variables from i.i.d samples. We adapt the algorithm of Vuffray et al. (2019) to this setting and provide finite-sample analysis revealing sample…

Machine Learning · Computer Science 2020-10-29 Abhin Shah , Devavrat Shah , Gregory W. Wornell

Machine learning potentials have achieved great success in accelerating atomistic simulations. Many of them relying on atom-centered local descriptors are natural for parallelization. More recent message passing neural network (MPNN) models…

Chemical Physics · Physics 2025-06-10 Junfan Xia , Bin Jiang

Undirected graphical models are widely used in statistics, physics and machine vision. However Bayesian parameter estimation for undirected models is extremely challenging, since evaluation of the posterior typically involves the…

Computation · Statistics 2012-03-19 Richard G. Everitt

We study the Parallel Replica Dynamics in a general setting. We introduce a trajectory fragment framework that can be used to design and prove consistency of Parallel Replica algorithms for generic Markov processes. We use our framework to…

Numerical Analysis · Mathematics 2022-04-22 David Aristoff

Traditionally, graph neural networks have been trained using a single observed graph. However, the observed graph represents only one possible realization. In many applications, the graph may encounter uncertainties, such as having…

Machine Learning · Computer Science 2024-10-10 See Hian Lee , Feng Ji , Kelin Xia , Wee Peng Tay

Markov networks are widely studied and used throughout multivariate statistics and computer science. In particular, the problem of learning the structure of Markov networks from data without invoking chordality assumptions in order to…

Machine Learning · Statistics 2025-12-29 Juri Kuronen , Jukka Corander , Johan Pensar

Markov chain Monte Carlo (MCMC) algorithms are simple and extremely powerful techniques to sample from almost arbitrary distributions. The flaw in practice is that it can take a large and/or unknown amount of time to converge to the…

Machine Learning · Computer Science 2014-11-13 Xianghang Liu , Justin Domke

We propose a novel parameterized skill-learning algorithm that aims to learn transferable parameterized skills and synthesize them into a new action space that supports efficient learning in long-horizon tasks. We propose to leverage…

Machine Learning · Computer Science 2023-07-20 Haotian Fu , Shangqun Yu , Saket Tiwari , Michael Littman , George Konidaris

Training examples are not all equally informative. Active learning strategies leverage this observation in order to massively reduce the number of examples that need to be labeled. We leverage the same observation to build a generic…

Machine Learning · Computer Science 2013-10-31 Alekh Agarwal , Leon Bottou , Miroslav Dudik , John Langford

Auxiliary variable methods such as the Parallel Tempering and the cluster Monte Carlo methods generate samples that follow a target distribution by using proposal and auxiliary distributions. In sampling from complex distributions, these…

Computation · Statistics 2012-07-16 Takamitsu Araki , Kazushi Ikeda