English
Related papers

Related papers: A Serverless Architecture for Efficient and Scalab…

200 papers

Performing Bayesian inference via Markov chain Monte Carlo (MCMC) can be exceedingly expensive when posterior evaluations invoke the evaluation of a computationally expensive model, such as a system of partial differential equations. In…

Computation · Statistics 2017-12-27 Patrick Conrad , Andrew Davis , Youssef Marzouk , Natesh Pillai , Aaron Smith

Serverless computing offers a pay-per-use model with high elasticity and automatic scaling for a wide range of applications. Since cloud providers abstract most of the underlying infrastructure, these services work similarly to black-boxes.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-10 Michael Kiener , Mohak Chadha , Michael Gerndt

Decision trees are highly famous in machine learning and usually acquire state-of-the-art performance. Despite that, well-known variants like CART, ID3, random forest, and boosted trees miss a probabilistic version that encodes prior…

Artificial Intelligence · Computer Science 2022-07-27 Efthyvoulos Drousiotis , Paul G. Spirakis

We propose a generic Markov Chain Monte Carlo (MCMC) algorithm to speed up computations for datasets with many observations. A key feature of our approach is the use of the highly efficient difference estimator from the survey sampling…

Methodology · Statistics 2017-08-03 Matias Quiroz , Mattias Villani , Robert Kohn

Bayesian inference for Markov processes has become increasingly relevant in recent years. Problems of this type often have intractable likelihoods and prior knowledge about model rate parameters is often poor. Markov Chain Monte Carlo…

Computation · Statistics 2014-10-23 Jamie Owen , Darren J. Wilkinson , Colin S. Gillespie

This paper explores serverless cloud computing for double machine learning. Being based on repeated cross-fitting, double machine learning is particularly well suited to exploit the high level of parallelism achievable with serverless…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-21 Malte S. Kurz

Single-chain Markov chain Monte Carlo simulates realizations from a Markov chain to estimate expectations with the empirical average. The single-chain simulation is generally of considerable length and restricts many advantages of modern…

Statistics Theory · Mathematics 2024-02-01 Austin Brown

Markov chain Monte Carlo (MCMC) is a widely used sampling method in modern artificial intelligence and probabilistic computing systems. It involves repetitive random number generations and thus often dominates the latency of probabilistic…

Hardware Architecture · Computer Science 2023-12-12 Yihan Fu , Daijing Shi , Anjunyi Fan , Wenshuo Yue , Yuchao Yang , Ru Huang , Bonan Yan

Massively parallel desktop computing capabilities now well within the reach of individual academics modify the environment for posterior simulation in fundamental and potentially quite advantageous ways. But to fully exploit these benefits…

Computation · Statistics 2013-04-17 Garland Durham , John Geweke

Markov chain Monte Carlo (MCMC) methods are foundational algorithms for Bayesian inference and probabilistic modeling. However, most MCMC algorithms are inherently sequential and their time complexity scales linearly with the sequence…

Computation · Statistics 2025-12-03 David M. Zoltowski , Skyler Wu , Xavier Gonzalez , Leo Kozachkov , Scott W. Linderman

Cloud service provider propose services to insensitive customers to use their platform. Different services can achieve the same result at different cost. In this paper, we study the efficiency of a serverless architecture for running highly…

Software Engineering · Computer Science 2019-01-15 Samuel Lavoie , Anthony Garant , Fabio Petrillo

Serverless computing has become an important model in cloud computing and influenced the design of many applications. Here, we provide our perspective on how the recent landscape of serverless computing for scientific applications looks…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-06 Maciej Malawski , Bartosz Balis

Performing reliable Bayesian inference on a big data scale is becoming a keystone in the modern era of machine learning. A workhorse class of methods to achieve this task are Markov chain Monte Carlo (MCMC) algorithms and their design to…

Methodology · Statistics 2021-06-21 Vincent Plassier , Maxime Vono , Alain Durmus , Eric Moulines

Markov Chain Monte Carlo (MCMC) methods such as Gibbs sampling are finding widespread use in applied statistics and machine learning. These often lead to difficult computational problems, which are increasingly being solved on parallel and…

Machine Learning · Statistics 2018-06-05 Alexander Terenin , Eric P. Xing

Efficient sampling of many-dimensional and multimodal density functions is a task of great interest in many research fields. We describe an algorithm that allows parallelizing inherently serial Markov chain Monte Carlo (MCMC) sampling by…

Computation · Statistics 2020-08-10 Vasyl Hafych , Philipp Eller , Oliver Schulz , Allen Caldwell

Serverless computing offers the potential to program the cloud in an autoscaling, pay-as-you go manner. In this paper we address critical gaps in first-generation serverless computing, which place its autoscaling potential at odds with…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-11 Joseph M. Hellerstein , Jose Faleiro , Joseph E. Gonzalez , Johann Schleier-Smith , Vikram Sreekanti , Alexey Tumanov , Chenggang Wu

Generalized-ensemble Monte Carlo simulations such as the multicanonical method and similar techniques are among the most efficient approaches for simulations of systems undergoing discontinuous phase transitions or with rugged free- energy…

Computational Physics · Physics 2018-02-06 Jonathan Gross , Johannes Zierenberg , Martin Weigel , Wolfhard Janke

In dynamic Monte Carlo simulations, using for example the Metropolis dynamic, it is often required to simulate for long times and to simulate large systems. We present an overview of advanced algorithms to simulate for larger times and to…

Statistical Mechanics · Physics 2007-05-23 M. A. Novotny , Alice K. Kolakowska , G. Korniss

In this paper we consider fully Bayesian inference in general state space models. Existing particle Markov chain Monte Carlo (MCMC) algorithms use an augmented model that takes into account all the variable sampled in a sequential Monte…

Methodology · Statistics 2014-07-31 Christopher K. Carter , Eduardo F. Mendes , Robert Kohn

Recent developments in big data and analytics research have produced an abundance of large data sets that are too big to be analyzed in their entirety, due to limits on computer memory or storage capacity. To address these issues,…

Methodology · Statistics 2016-01-06 Alexey Miroshnikov , Erin M. Conlon