English
Related papers

Related papers: A Serverless Architecture for Efficient and Scalab…

200 papers

The increasing demand for computational power in big data and machine learning has driven the development of distributed training methodologies. Among these, peer-to-peer (P2P) networks provide advantages such as enhanced scalability and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-26 Amine Barrak , Ranim Trabelsi , Fehmi Jaafar , Fabio Petrillo

Bayesian hierarchical modeling is a popular approach to capturing unobserved heterogeneity across individual units. However, standard estimation methods such as Markov chain Monte Carlo (MCMC) can be impracticable for modeling outcomes from…

Methodology · Statistics 2014-11-04 Michael Braun , Paul Damien

This paper presents a new approach to automatically discovering accurate models of complex time series data. Working within a Bayesian nonparametric prior over a symbolic space of Gaussian process time series models, we present a novel…

Machine Learning · Computer Science 2023-07-20 Feras A. Saad , Brian J. Patton , Matthew D. Hoffman , Rif A. Saurous , Vikash K. Mansinghka

Markov chain Monte Carlo (MCMC) is a sampling-based method for estimating features of probability distributions. MCMC methods produce a serially correlated, yet representative, sample from the desired distribution. As such it can be…

Computation · Statistics 2019-12-10 Dootika Vats , Nathan Robertson , James M Flegal , Galin L Jones

We present a highly scalable Monte Carlo (MC) three-dimensional photon transport simulation platform designed for heterogeneous computing systems. Through the development of a massively parallel MC algorithm using the Open Computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-06 Leiming Yu , Fanny Nina-Paravecino , David Kaeli , Qianqian Fang

Markov chain Monte Carlo (MCMC) simulation methods are widely used to assess parametric uncertainties of hydrologic models conditioned on measurements of observable state variables. However, when the model is CPU-intensive and…

Optimization and Control · Mathematics 2018-06-18 Jiangjiang Zhang , Jun Man , Guang Lin , Laosheng Wu , Lingzao Zeng

The computer revolution has been driven by a sustained increase of computational speed of approximately one order of magnitude (a factor of ten) every five years since about 1950. In natural sciences this has led to a continuous increase of…

Statistical Mechanics · Physics 2007-09-06 Bernd A. Berg

We introduce and analyze a parallel sequential Monte Carlo methodology for the numerical solution of optimization problems that involve the minimization of a cost function that consists of the sum of many individual components. The proposed…

Computation · Statistics 2022-01-04 Ömer Deniz Akyildiz , Dan Crisan , Joaquín Míguez

We consider the task of MCMC sampling from a distribution defined on a discrete space. Building on recent insights provided in [Zan19], we devise a class of efficient continuous-time, non-reversible algorithms which make active use of the…

Computation · Statistics 2019-12-19 Samuel Power , Jacob Vorstrup Goldman

Any search or sampling algorithm for solution of inverse problems needs guidance to be efficient. Many algorithms collect and apply information about the problem on the fly, and much improvement has been made in this way. However, as a…

Geophysics · Physics 2021-05-19 Sarouyeh Khoshkholgh , Andrea Zunino , Klaus Mosegaard

Markov chain Monte Carlo (MCMC) methods to sample from a probability distribution $\pi$ defined on a space $(\Theta,\mathcal{T})$ consist of the simulation of realisations of Markov chains $\{\theta_{n},n\geq1\}$ of invariant distribution…

Computation · Statistics 2021-01-06 Christophe Andrieu , Sinan Yıldırım , Arnaud Doucet , Nicolas Chopin

The rise of serverless computing introduced a new class of scalable, elastic and widely available parallel workers in the cloud. Many systems and applications benefit from offloading computations and parallel tasks to dynamically allocated…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-23 Marcin Copik , Lukas Möller , Alexandru Calotoiu , Torsten Hoefler

The event-driven and elastic nature of serverless runtimes makes them a very efficient and cost-effective alternative for scaling up computations. So far, they have mostly been used for stateless, data parallel and ephemeral computations.…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-11 Arda Aytekin , Mikael Johansson

End-users can get functions-as-a-service from serverless platforms, which promise lower hosting costs, high availability, fault tolerance, and dynamic flexibility for hosting individual functions known as microservices. Machine learning…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-25 Prerana Khatiwada , Pranjal Dhakal

It is shown that superefficient Monte Carlo computations can be carried out by using chaotic dynamical systems as non-uniform random-number generators. Here superefficiency means that the expectation value of the square of the error…

chao-dyn · Physics 2007-05-23 Ken Umeno

Finding effective ways to exploit parallel computing to accelerate Markov chain Monte Carlo methods is an important problem in Bayesian computation and related disciplines. In this paper, we consider the zeroth-order setting where the…

Computation · Statistics 2026-01-28 Francesco Pozza , Giacomo Zanella

In big data context, traditional MCMC methods, such as Metropolis-Hastings algorithms and hybrid Monte Carlo, scale poorly because of their need to evaluate the likelihood over the whole data set at each iteration. In order to resurrect…

Computation · Statistics 2017-06-20 Changye Wu , Christian P. Robert

We introduce methodology for real-time inference in general-state-space hidden Markov models. Specifically, we extend recent advances in controlled sequential Monte Carlo (CSMC) methods-originally proposed for offline smoothing-to the…

Computation · Statistics 2025-08-04 Liwen Xue , Axel Finke , Adam M. Johansen

Operating a modern power grid reliably in case of SCADA/EMS failure or amid difficult times like COVID-19 pandemic is a challenging task for grid operators. In [11], a PMU-based emergency generation dispatch scheme has been proposed to help…

Physics and Society · Physics 2021-08-03 Song Zhang , Xiaochuan Luo , Eugene Litvinov

Quantum Monte Carlo (QMC) techniques are widely used in a variety of scientific problems and much work has been dedicated to developing optimized algorithms that can accelerate QMC on standard processors (CPU). With the advent of various…

Quantum Physics · Physics 2023-04-28 Shuvro Chowdhury , Kerem Y. Camsari , Supriyo Datta