English
Related papers

Related papers: A Markov Chain Algorithm for Compression in Self-O…

200 papers

We present a novel approach to detecting and utilizing symmetries in probabilistic graphical models with two main contributions. First, we present a scalable approach to computing generating sets of permutation groups representing the…

Artificial Intelligence · Computer Science 2012-06-29 Mathias Niepert

Markov chain methods are remarkably successful in computational physics, machine learning, and combinatorial optimization. The cost of such methods often reduces to the mixing time, i.e., the time required to reach the steady state of the…

Quantum Physics · Physics 2018-11-15 Davide Orsucci , Hans J. Briegel , Vedran Dunjko

On a weakly Blackwell space we show how to define a Markov chain approximating problem, for the target problem. The approximating problem is proved to converge to the optimal reduced problem under different pseudometrics. A computational…

Probability · Mathematics 2009-01-14 Giacomo Aletti , Diane Saada

Reversibility is a key property of Markov chains, central to algorithms such as Metropolis-Hastings and other MCMC methods. Yet many applications yield non-reversible chains, motivating the problem of approximating them by reversible ones…

Numerical Analysis · Mathematics 2026-02-27 Stefano Cipolla , Fabio Durastante , Miryam Gnazzo , Beatrice Meini

Graded posets frequently arise throughout combinatorics, where it is natural to try to count the number of elements of a fixed rank. These counting problems are often $\#\textbf{P}$-complete, so we consider approximation algorithms for…

Data Structures and Algorithms · Computer Science 2023-04-11 Prateek Bhakta , Ben Cousins , Matthew Fahrbach , Dana Randall

Bayesian classification and regression with high order interactions is largely infeasible because Markov chain Monte Carlo (MCMC) would need to be applied with a great many parameters, whose number increases rapidly with the order. In this…

Machine Learning · Statistics 2017-04-28 Longhai Li , Radford M. Neal

Particle smoothers are widely used algorithms allowing to approximate the smoothing distribution in hidden Markov models. Existing algorithms often suffer from slow computational time or degeneracy. We propose in this paper a way to improve…

Methodology · Statistics 2011-07-28 Cyrille Dubarry , Randal Douc

We present a reduced-dimension, ballistic deposition, Monte Carlo particle packing algorithm and discuss its application to the analysis of the microstructure of hard-sphere systems with broad particle size distributions. We extend our…

Materials Science · Physics 2007-05-23 M. D. Webb , I. L. Davis

The goal of this thesis is to study the compression problems arising in distributed computing systematically. In the first part of the thesis, we study gradient compression for distributed first-order optimization. We begin by establishing…

Information Theory · Computer Science 2023-01-12 Prathamesh Mayekar

Shape formation is a basic distributed problem for systems of computational mobile entities. Intensively studied for systems of autonomous mobile robots, it has recently been investigated in the realm of programmable matter. Namely, it has…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-12 Giuseppe A. Di Luna , Paola Flocchini , Nicola Santoro , Giovanni Viglietta , Yukiko Yamauchi

In the continuity of a recent paper ([6]), dealing with finite Markov chains, this paper proposes and analyzes a recursive algorithm for the approximation of the quasi-stationary distribution of a general Markov chain living on a compact…

Probability · Mathematics 2017-11-15 Michel Benaim , Bertrand Cloez , Fabien Panloup

We develop a framework for the compression of reversible Markov chains with rigorous error control. Given a subset of selected states, we construct reduced dynamics that can be lifted to an approximation of the full dynamics, and we prove…

Numerical Analysis · Mathematics 2025-09-03 Mark Fornace , Michael Lindsey

The problem of electing a unique leader is central to all distributed systems, including programmable matter systems where particles have constant size memory. In this paper, we present a silent self-stabilising, deterministic, stationary,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-08 Jérémie Chalopin , Shantanu Das , Maria Kokkou

The analysis of parametrised systems is a growing field in verification, but the analysis of parametrised probabilistic systems is still in its infancy. This is partly because it is much harder: while there are beautiful cut-off results for…

Logic in Computer Science · Computer Science 2018-04-06 Paul Gainer , Ernst Moritz Hahn , Sven Schewe

Suppose there are $n$ Markov chains and we need to pay a per-step \emph{price} to advance them. The "destination" states of the Markov chains contain rewards; however, we can only get rewards for a subset of them that satisfy a…

Data Structures and Algorithms · Computer Science 2019-02-22 Anupam Gupta , Haotian Jiang , Ziv Scully , Sahil Singla

Several recent publications investigated Markov-chain modelling of linear optimization by a $(1,\lambda)$-ES, considering both unconstrained and linearly constrained optimization, and both constant and varying step size. All of them assume…

Numerical Analysis · Computer Science 2014-06-19 Alexandre Chotard , Martin Holena

We investigate computational issues in the distributed model Amoebots of programmable matter. In this model, the computational entities, called particles, are anonymous finite-state machines that operate and move on an hexagonal tasselation…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-01 Giuseppe Antonio Di Luna , Paola Flocchini , Nicola Santoro , Giovanni Viglietta , Yukiko Yamauchi

We consider the problem of controlling a fully specified Markov decision process (MDP), also known as the planning problem, when the state space is very large and calculating the optimal policy is intractable. Instead, we pursue the more…

Optimization and Control · Mathematics 2019-01-09 Yasin Abbasi-Yadkori , Peter L. Bartlett , Xi Chen , Alan Malek

In distribution compression, one aims to accurately summarize a probability distribution $\mathbb{P}$ using a small number of representative points. Near-optimal thinning procedures achieve this goal by sampling $n$ points from a Markov…

Machine Learning · Statistics 2022-10-19 Abhishek Shetty , Raaz Dwivedi , Lester Mackey

We compare different analytical and numerical methods for studying the partitions of a finite system into fragments. We propose a new numerical method of exploring the partition space by generating the Markov chains of partitions based on…

Mathematical Physics · Physics 2009-10-31 A. S. Botvina , A. D. Jackson , I. N. Mishustin