English
Related papers

Related papers: A Wall-time Minimizing Parallelization Strategy fo…

200 papers

Approximate Bayesian Computation (ABC) methods are applicable to statistical models specified by generative processes with analytically intractable likelihoods. These methods try to approximate the posterior density of a model parameter by…

Methodology · Statistics 2024-03-11 Sanjay Chaudhuri , Subhroshekhar Ghosh , Kim Cuc Pham

We propose a novel approach to approximate Bayesian computation (ABC) that seeks to cater for possible misspecification of the assumed model. This new approach can be equally applied to rejection-based ABC and to popular regression…

Methodology · Statistics 2020-08-11 David T. Frazier , Christopher Drovandi , Ruben Loaiza-Maya

Parallel machine scheduling has been extensively studied in the past decades, with applications ranging from production planning to job processing in large computing clusters. In this work we study some of these fundamental optimization…

Data Structures and Algorithms · Computer Science 2015-09-08 Yael Mordechai

We present a novel variant of the multi-level Monte Carlo method that effectively utilizes a reserved computational budget on a high-performance computing system to minimize the mean squared error. Our approach combines concepts of the…

Numerical Analysis · Mathematics 2023-07-21 Niklas Baumgarten , Sebastian Krumscheid , Christian Wieners

Simulation models for pedestrian crowds are a ubiquitous tool in research and industry. It is crucial that the parameters of these models are calibrated carefully and ultimately it will be of interest to compare competing models to decide…

Multiagent Systems · Computer Science 2020-05-13 Nikolai Bode

Complicated generative models often result in a situation where computing the likelihood of observed data is intractable, while simulating from the conditional density given a parameter value is relatively easy. Approximate Bayesian…

Machine Learning · Statistics 2015-12-29 Mijung Park , Wittawat Jitkrittum , Dino Sejdinovic

Scientists often express their understanding of the world through a computationally demanding simulation program. Analyzing the posterior distribution of the parameters given observations (the inverse problem) can be extremely challenging.…

Machine Learning · Computer Science 2014-01-14 Edward Meeds , Max Welling

1. Challenging calibration of complex models can be approached by using prior knowledge on the parameters. However, the natural choice of Bayesian inference can be computationally heavy when relying on Markov Chain Monte Carlo (MCMC)…

Applications · Statistics 2023-04-27 Charlotte Baey , Henrik G. Smith , Maj Rundlöf , Ola Olsson , Yann Clough , Ullrika Sahlin

Estimating the predictive uncertainty of a Bayesian learning model is critical in various decision-making problems, e.g., reinforcement learning, detecting adversarial attack, self-driving car. As the model posterior is almost always…

Machine Learning · Computer Science 2021-02-16 Yufei Cui , Wuguannan Yao , Qiao Li , Antoni B. Chan , Chun Jason Xue

Many clustering applications in machine learning and data mining rely on solving metric-constrained optimization problems. These problems are characterized by $O(n^3)$ constraints that enforce triangle inequalities on distance variables…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-30 Cameron Ruggles , Nate Veldt , David F. Gleich

Bayesian optimization has emerged as a strong candidate tool for global optimization of functions with expensive evaluation costs. However, due to the dynamic nature of research in Bayesian approaches, and the evolution of computing…

Applications · Statistics 2018-08-24 Ran Rubin

Approximate Bayesian computation (ABC) methods are used to approximate posterior distributions using simulation rather than likelihood calculations. We introduce Gaussian process (GP) accelerated ABC, which we show can significantly reduce…

Computation · Statistics 2014-02-25 Richard D Wilkinson

Markov chain Monte Carlo is an inherently serial algorithm. Although likelihood calculations for individual steps can sometimes be parallelized, the serial evolution of the process is widely viewed as incompatible with parallelization,…

Computation · Statistics 2013-12-31 Douglas N. VanDerwerken , Scott C. Schmidler

Despite the enormous success of Hamiltonian Monte Carlo and related Markov Chain Monte Carlo (MCMC) methods, sampling often still represents the computational bottleneck in scientific applications. Availability of parallel resources can…

Computation · Statistics 2026-01-26 Jakob Robnik , Uroš Seljak

We present a novel parallelisation scheme that simplifies the adaptation of learning algorithms to growing amounts of data as well as growing needs for accurate and confident predictions in critical applications. In contrast to other…

Machine Learning · Computer Science 2018-10-09 Michael Kamp , Mario Boley , Olana Missura , Thomas Gärtner

A growing number of generative statistical models do not permit the numerical evaluation of their likelihood functions. Approximate Bayesian computation (ABC) has become a popular approach to overcome this issue, in which one simulates…

Methodology · Statistics 2019-05-10 Espen Bernton , Pierre E. Jacob , Mathieu Gerber , Christian P. Robert

Decision trees are highly famous in machine learning and usually acquire state-of-the-art performance. Despite that, well-known variants like CART, ID3, random forest, and boosted trees miss a probabilistic version that encodes prior…

Artificial Intelligence · Computer Science 2022-07-27 Efthyvoulos Drousiotis , Paul G. Spirakis

Modern data centers suffer from immense power consumption. As a result, data center operators have heavily invested in capacity scaling solutions, which dynamically deactivate servers if the demand is low and activate them again when the…

Data Structures and Algorithms · Computer Science 2022-04-21 Daan Rutten , Debankur Mukherjee

Massively parallel desktop computing capabilities now well within the reach of individual academics modify the environment for posterior simulation in fundamental and potentially quite advantageous ways. But to fully exploit these benefits…

Computation · Statistics 2013-04-17 Garland Durham , John Geweke

This paper presents a comparative study of two Bayesian approaches - Markov Chain Monte Carlo (MCMC) and Approximate Bayesian Computation (ABC) - for estimating the parameters of autoregressive fractionally-integrated moving average…

Methodology · Statistics 2024-10-18 James Cohen Gabor , Clara Grazian