English
Related papers

Related papers: Convergence of Random Batch Method with replacemen…

200 papers

We present an efficient Monte Carlo algorithm for the simulation of the two-dimensional Random Field Ising Model (RFIM). The method combines the event-driven, rejection-free character of the Bortz Kalos-Lebowitz (BKL) algorithm with Glauber…

Statistical Mechanics · Physics 2026-03-19 Luca Cattaneo , Federico Ettori , Giovanni Cerri , Paolo Biscari , Ezio Puppin

Due to the ever growing amounts of data leveraged for machine learning and scientific computing, it is increasingly important to develop algorithms that sample only a small portion of the data at a time. In the case of linear least-squares,…

Machine Learning · Computer Science 2025-12-18 Gil Goldshlager , Jiang Hu , Lin Lin

We investigate the Ising and Heisenberg models using the Block Renormalization Group Method (BRGM), focusing on its behavior across different system sizes. The BRGM reduces the number of spins by a factor of 1/2 (1/3) for the Ising…

In this paper we analyze the randomized block-coordinate descent (RBCD) methods proposed in [8,11] for minimizing the sum of a smooth convex function and a block-separable convex function. In particular, we extend Nesterov's technique…

Optimization and Control · Mathematics 2013-05-22 Zhaosong Lu , Lin Xiao

We introduce a new micro-macro Markov chain Monte Carlo method (mM-MCMC) to sample invariant distributions of molecular dynamics systems that exhibit a time-scale separation between the microscopic (fast) dynamics, and the macroscopic…

Numerical Analysis · Mathematics 2020-02-24 Hannes Vandecasteele , Giovanni Samaey

Randomized linear system solvers have become popular as they have the potential to reduce floating point complexity while still achieving desirable convergence rates. One particularly promising class of methods, random sketching solvers,…

Numerical Analysis · Mathematics 2020-12-23 Vivak Patel , Mohammad Jahangoshahi , Daniel Adrian Maldonado

The pseudo-marginal algorithm is a popular variant of the Metropolis--Hastings scheme which allows us to sample asymptotically from a target probability density $\pi$, when we are only able to estimate an unnormalized version of $\pi$…

Computation · Statistics 2017-07-20 George Deligiannidis , Arnaud Doucet , Michael K. Pitt

We introduce a novel and efficient sampling algorithm for the Multiplicative Attribute Graph Model (MAGM - Kim and Leskovec (2010)}). Our algorithm is \emph{strictly} more efficient than the algorithm proposed by Yun and Vishwanathan…

Machine Learning · Statistics 2012-02-29 Hyokun Yun , S. V. N. Vishwanathan

We analyze the convergence rate of the randomized Newton-like method introduced by Qu et. al. (2016) for smooth and convex objectives, which uses random coordinate blocks of a Hessian-over-approximation matrix $\bM$ instead of the true…

Numerical Analysis · Mathematics 2020-02-13 Mojmír Mutný , Michał Dereziński , Andreas Krause

Interacting particle methods are increasingly used to sample from complex and high-dimensional distributions. These stochastic particle integration techniques can be interpreted as an universal acceptance-rejection sequential particle…

Computational Finance · Quantitative Finance 2012-10-30 P. Del Moral , G. W. Peters , Ch. Vergé

In the following article we provide an exposition of exact computational methods to perform parameter inference from partially observed network models. In particular, we consider the duplication attachment (DA) model which has a likelihood…

Computation · Statistics 2013-06-20 Junshan Wang , Ajay Jasra , Maria De Iorio

Particle Markov Chain Monte Carlo (PMCMC) is a general computational approach to Bayesian inference for general state space models. Our article scales up PMCMC in terms of the number of observations and parameters by generating the…

Methodology · Statistics 2023-07-04 David Gunawan , Chris Carter , Robert Kohn

Particle dynamics and multi-agent systems provide accurate dynamical models for studying and forecasting the behavior of complex interacting systems. They often take the form of a high-dimensional system of differential equations…

Machine Learning · Computer Science 2023-08-09 Yuxuan Liu , Scott G. McCalla , Hayden Schaeffer

Wasserstein barycenter is the centroid of a collection of discrete probability distributions which minimizes the average of the $\ell_2$-Wasserstein distance. This paper focuses on the computation of Wasserstein barycenters under the case…

Optimization and Control · Mathematics 2021-01-19 Yitian Qian , Shaohua Pan

To minimise systematic errors in Monte Carlo simulations of charged particles, long range electrostatic interactions have to be calculated accurately and efficiently. Standard approaches, such as Ewald summation or the naive application of…

Computational Physics · Physics 2021-02-24 William Robert Saunders , James Grant , Eike Hermann Müller

We develop an accurate, highly efficient and scalable random batch sum-of-Gaussians (RBSOG) method for molecular dynamics simulations of systems with long-range interactions. The idea of the RBSOG method is based on a sum-of-Gaussians…

Computational Physics · Physics 2022-05-30 Jiuyang Liang , Zhenli Xu , Qi Zhou

Recent advances in random-walk particle-tracking have enabled direct simulation of mixing and reactions on particles by allowing the particles to interact with each other using a multi-point mass transfer scheme. The mass transfer scheme…

Computational Physics · Physics 2019-04-22 Nicholas B. Engdahl , Michael J. Schmidt , David A. Benson

Estimating the log-likelihood gradient with respect to the parameters of a Restricted Boltzmann Machine (RBM) typically requires sampling using Markov Chain Monte Carlo (MCMC) techniques. To save computation time, the Markov chains are only…

Machine Learning · Computer Science 2017-06-29 Oswin Krause , Asja Fischer , Christian Igel

Bayesian sampling is an important task in statistics and machine learning. Over the past decade, many ensemble-type sampling methods have been proposed. In contrast to the classical Markov chain Monte Carlo methods, these new methods deploy…

Numerical Analysis · Mathematics 2024-05-14 Shi Chen , Zhiyan Ding , Qin Li

This work proposes and analyzes a new class of numerical integrators for computing low-rank approximations to solutions of matrix differential equation. We combine an explicit Runge-Kutta method with repeated randomized low-rank…

Numerical Analysis · Mathematics 2024-09-11 Hei Yin Lam , Gianluca Ceruti , Daniel Kressner