English
Related papers

Related papers: Statistically efficient thinning of a Markov chain…

200 papers

Stochastic gradient Markov Chain Monte Carlo (SG-MCMC) has been developed as a flexible family of scalable Bayesian sampling algorithms. However, there has been little theoretical analysis of the impact of minibatch size to the algorithm's…

Machine Learning · Statistics 2017-09-06 Changyou Chen , Wenlin Wang , Yizhe Zhang , Qinliang Su , Lawrence Carin

Filtering---estimating the state of a partially observable Markov process from a sequence of observations---is one of the most widely studied problems in control theory, AI, and computational statistics. Exact computation of the posterior…

Artificial Intelligence · Computer Science 2013-01-07 Bhaskara Marthi , Hanna Pasula , Stuart Russell , Yuval Peres

Multiple stochastic signals possess inherent statistical correlations, yet conventional sampling methods that process each channel independently result in data redundancy. To leverage this correlation for efficient sampling, we model…

Signal Processing · Electrical Eng. & Systems 2025-09-18 Lin Jin , Hang Sheng , Hui Feng , Bo Hu

Despite the enormous success of Hamiltonian Monte Carlo and related Markov Chain Monte Carlo (MCMC) methods, sampling often still represents the computational bottleneck in scientific applications. Availability of parallel resources can…

Computation · Statistics 2026-01-26 Jakob Robnik , Uroš Seljak

Statistical machine learning often uses probabilistic algorithms, such as Markov Chain Monte Carlo (MCMC), to solve a wide range of problems. Many accelerators are proposed using specialized hardware to address sampling inefficiency, the…

Signal Processing · Electrical Eng. & Systems 2020-03-09 Xiangyu Zhang , Sayan Mukherjee , Alvin R. Lebeck

We propose cube thinning, a novel method for compressing the output of a MCMC (Markov chain Monte Carlo) algorithm when control variates are available. It amounts to resampling the initial MCMC sample (according to weights derived from…

Computation · Statistics 2021-09-01 Nicolas Chopin , Gabriel Ducrocq

Autocorrelations in MCMC chains increase the variance of the estimators they produce. We propose the occlusion process to mitigate this problem. It is a process that sits upon an existing MCMC sampler, and occasionally replaces its samples…

Computation · Statistics 2024-11-20 Max Hird , Florian Maire

Parametric Markov chains occur quite naturally in various applications: they can be used for a conservative analysis of probabilistic systems (no matter how the parameter is chosen, the system works to specification); they can be used to…

Logic in Computer Science · Computer Science 2018-11-05 Paul Gainer , Ernst Moritz Hahn , Sven Schewe

The area of sublinear algorithms have recently received a lot of attention. In this setting, one has to choose specific access model for the input, as the algorithm does not have time to pre-process or even to see the whole input. A…

Data Structures and Algorithms · Computer Science 2020-09-24 Jakub Tětek

Consider $n$ random variables forming a Markov random field (MRF). The true model of the MRF is unknown, and it is assumed to belong to a binary set. The objective is to sequentially sample the random variables (one-at-a-time) such that the…

Methodology · Statistics 2020-08-04 Javad Heydari , Ali Tajer , H. Vincent Poor

Through a Metropolis-like algorithm with single step computational cost of order one, we build a Markov chain that relaxes to the canonical Fermi statistics for k non-interacting particles among m energy levels. Uniformly over the…

Probability · Mathematics 2015-05-14 Alexandre Gaudilliere , Julien Reygner

We consider the problem of estimating the measure of subsets in very large networks. A prime tool for this purpose is the Markov Chain Monte Carlo (MCMC) algorithm. This algorithm, while extremely useful in many cases, still often suffers…

Data Structures and Algorithms · Computer Science 2020-09-01 Ahmad Askarian , Rupei Xu , András Faragó

The choice of transition kernel critically influences the performance of the Markov chain Monte Carlo method. Despite the importance of kernel choice, guiding principles for optimal kernels have not been established. Here, we propose a…

Statistical Mechanics · Physics 2023-11-28 Hidemaro Suwa

Time series data from a variety of sensors and IoT devices need effective compression to reduce storage and I/O bandwidth requirements. While most time series databases and systems rely on lossless compression, lossy techniques offer even…

Databases · Computer Science 2025-01-27 Carlos Enrique Muñiz-Cuza , Matthias Boehm , Torben Bach Pedersen

Sample-efficient machine learning (SEML) has been widely applied to find optimal latency and power tradeoffs for configurable computer systems. Instead of randomly sampling from the configuration space, SEML reduces the search cost by…

Machine Learning · Computer Science 2022-04-12 Yi Ding , Alex Renda , Ahsan Pervaiz , Michael Carbin , Henry Hoffmann

Data augmentation improves the convergence of iterative algorithms, such as the EM algorithm and Gibbs sampler by introducing carefully designed latent variables. In this article, we first propose a data augmentation scheme for the…

Methodology · Statistics 2022-07-06 Linda S. L. Tan

We formulate the loop-free, binary superoptimization task as a stochastic search problem. The competing constraints of transformation correctness and performance improvement are encoded as terms in a cost function, and a Markov Chain Monte…

Performance · Computer Science 2012-11-06 Eric Schkufza , Rahul Sharma , Alex Aiken

Sequential scaling is a prominent inference-time scaling paradigm, yet its performance improvements are typically modest and not well understood, largely due to the prevalence of heuristic, non-principled approaches that obscure clear…

Machine Learning · Computer Science 2026-02-03 Youkang Wang , Jian Wang , Rubing Chen , Tianyi Zeng , Xiao-Yong Wei , Qing Li

We show that efficient approximate sampling algorithms, combined with a slow exponential time oracle for computing its output distribution, can be combined into constructing efficient perfect samplers, which sample exactly from a target…

Computational Complexity · Computer Science 2024-12-09 Andreas Göbel , Jingcheng Liu , Pasin Manurangsi , Marcus Pappik

The era of huge data necessitates highly efficient machine learning algorithms. Many common machine learning algorithms, however, rely on computationally intensive subroutines that are prohibitively expensive on large datasets. Oftentimes,…

Machine Learning · Computer Science 2023-09-26 Mo Tiwari