English
Related papers

Related papers: Work-Efficient Parallel Counting via Sampling

200 papers

A generic algorithm for the extraction of probabilistic (Bayesian) information about model parameters from data is presented. The algorithm propagates an ensemble of particles in the product space of model parameters and outputs. Each…

Computation · Statistics 2015-09-18 Carlo Albert

Bayesian optimization is an effective methodology for the global optimization of functions with expensive evaluations. It relies on querying a distribution over functions defined by a relatively cheap surrogate model. An accurate model for…

Gibbs sampling from continuous real-valued functions is a challenging problem of interest in machine learning. Here we leverage quantum Fourier transforms to build a quantum algorithm for this task when the function is periodic. We use the…

Quantum Physics · Physics 2024-07-23 Arsalan Motamedi , Pooya Ronagh

Numerical simulations of models and theories that describe complex systems such as spin glasses are becoming increasingly important. Beyond fundamental research, these computational methods also find practical applications in fields like…

In this paper, we investigate combining blocking and collapsing -- two widely used strategies for improving the accuracy of Gibbs sampling -- in the context of probabilistic graphical models (PGMs). We show that combining them is not…

Artificial Intelligence · Computer Science 2013-09-27 Deepak Venugopal , Vibhav Gogate

Gibbs sampling is a widely used Markov chain Monte Carlo (MCMC) method for numerically approximating integrals of interest in Bayesian statistics and other mathematical sciences. Many implementations of MCMC methods do not extend easily to…

Computation · Statistics 2019-06-03 Alexander Terenin , Shawfeng Dong , David Draper

We describe an embarrassingly parallel, anytime Monte Carlo method for likelihood-free models. The algorithm starts with the view that the stochasticity of the pseudo-samples generated by the simulator can be controlled externally by a…

Machine Learning · Computer Science 2015-12-03 Edward Meeds , Max Welling

Markov Chain Monte Carlo (MCMC) methods such as Gibbs sampling are finding widespread use in applied statistics and machine learning. These often lead to difficult computational problems, which are increasingly being solved on parallel and…

Machine Learning · Statistics 2018-06-05 Alexander Terenin , Eric P. Xing

Gaussian Boson Sampling (GBS) is a promising candidate for demonstrating quantum computational advantage and can be applied to solving graph-related problems. In this work, we propose Markov chain Monte Carlo-based algorithms to sample from…

Quantum Physics · Physics 2025-10-31 Yexin Zhang , Shuo Zhou , Xinzhao Wang , Ziruo Wang , Ziyi Yang , Rui Yang , Yecheng Xue , Tongyang Li

A linear-time algorithm is presented for the construction of the Gibbs distribution of configurations in the Ising model, on a quantum computer. The algorithm is designed so that each run provides one configuration with a quantum…

Quantum Physics · Physics 2009-10-30 Daniel A. Lidar , Ofer Biham

Population annealing is an easily parallelizable sequential Monte Carlo algorithm that is well-suited for simulating the equilibrium properties of systems with rough free energy landscapes. In this work we seek to understand and improve the…

Statistical Mechanics · Physics 2018-03-20 Chris Amey , Jon Machta

Doubly intractable distributions arise in many settings, for example in Markov models for point processes and exponential random graph models for networks. Bayesian inference for these models is challenging because they involve intractable…

Computation · Statistics 2019-04-03 Jaewoo Park , Murali Haran

We consider the problem of inference for the states and parameters of a continuous-time multitype branching process from partially observed time series data. Exact inference for this class of models, typically using sequential Monte Carlo,…

Methodology · Statistics 2025-12-01 Angus Lewis , Antonio Parrella , John Maclean , Andrew J. Black

To minimize data movement, state-of-the-art parallel sorting algorithms use techniques based on sampling and histogramming to partition keys prior to redistribution. Sampling enables partitioning to be done using a representative subset of…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-30 Vipul Harsh , Laxmikant Kale , Edgar Solomonik

Finding an energy minimum in the Ising model is an exemplar objective, associated with many combinatorial optimization problems, that is computationally hard in general, but occurs in all areas of modern science. There are several numerical…

Quantum Physics · Physics 2019-07-17 A. Yavorsky , L. A. Markovich , E. A. Polyakov , A. N. Rubtsov

We study sampling problems associated with non-convex potentials that meanwhile lack smoothness. In particular, we consider target distributions that satisfy either logarithmic-Sobolev inequality or Poincar\'e inequality. Rather than…

Machine Learning · Computer Science 2023-02-21 Jiaming Liang , Yongxin Chen

A central task in many applications is reasoning about processes that change over continuous time. Continuous-Time Bayesian Networks is a general compact representation language for multi-component continuous-time processes. However, exact…

Artificial Intelligence · Computer Science 2012-06-18 Tal El-Hay , Nir Friedman , Raz Kupferman

We consider decentralized consensus optimization when workers sample data from non-identical distributions and perform variable amounts of work due to slow nodes known as stragglers. The problem of non-identical distributions and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-26 Tharindu Adikari , Stark Draper

Sampling-based algorithms are classical approaches to perform Bayesian inference in inverse problems. They provide estimators with the associated credibility intervals to quantify the uncertainty on the estimators. Although these methods…

Methodology · Statistics 2023-11-28 Pierre-Antoine Thouvenin , Audrey Repetti , Pierre Chainais

We develop an efficient posterior sampling scheme for the Poisson INGARCH models. The proposed method is based on the approximation of the posterior density that exploits the Poisson limit of the negative binomial distribution. It allows us…

Methodology · Statistics 2026-03-10 Yixuan Fan , Zhengwei Liu , Fukang Zhu