English
Related papers

Related papers: Convergence of Random Batch Method with replacemen…

200 papers

We develop an accurate, highly efficient and scalable random batch Ewald (RBE) method to conduct simulations in the isothermal-isobaric ensemble (the NPT ensemble) for charged particles in a periodic box. After discretizing the Langevin…

Computational Physics · Physics 2022-10-19 Jiuyang Liang , Pan Tan , Liang Hong , Shi Jin , Zhenli Xu , Lei Li

We consider the problem of minimizing a sum of $n$ functions over a convex parameter set $\mathcal{C} \subset \mathbb{R}^p$ where $n\gg p\gg 1$. In this regime, algorithms which utilize sub-sampling techniques are known to be effective. In…

Machine Learning · Statistics 2015-12-03 Murat A. Erdogdu , Andrea Montanari

A new efficient ensemble prediction strategy is developed for a general turbulent model framework with emphasis on the nonlinear interactions between large and small scale variables. The high computational cost in running large ensemble…

Fluid Dynamics · Physics 2023-02-22 Di Qi , Jian-Guo Liu

The randomized Kaczmarz (RK) method is an iterative method for approximating the least-squares solution of large linear systems of equations. The standard RK method uses sequential updates, making parallel computation difficult. Here, we…

Numerical Analysis · Mathematics 2020-02-12 Jacob D. Moorman , Thomas K. Tu , Denali Molitor , Deanna Needell

In this paper, we present a numerical approach to solve the McKean-Vlasov equations, which are distribution-dependent stochastic differential equations, under some non-globally Lipschitz conditions for both the drift and diffusion…

Numerical Analysis · Mathematics 2023-05-30 Qian Guo , Jie He , Lei Li

We study approximations of evolving probability measures by an interacting particle system. The particle system dynamics is a combination of independent Markov chain moves and importance sampling/resampling steps. Under global regularity…

Probability · Mathematics 2011-12-12 Andreas Eberle , Carlo Marinelli

The restricted Boltzmann machine (RBM) is a neural network based on the Ising model, well known for its ability to learn probability distributions and stochastically generate new content. However, the high computational cost of Gibbs…

Optics · Physics 2026-03-13 Li Luo , Yisheng Fang , Wanyi Zhang , Zhichao Ruan

Machine learning is becoming widely used in analyzing the thermodynamics of many-body condensed matter systems. Restricted Boltzmann Machine (RBM) aided Monte Carlo simulations have sparked interest recently, as they manage to speed up…

Statistical Mechanics · Physics 2021-01-22 Daniel Alcalde Puente , Ilya M. Eremin

Restricted Boltzmann Machines (RBMs) offer a versatile architecture for unsupervised machine learning that can in principle approximate any target probability distribution with arbitrary accuracy. However, the RBM model is usually not…

Machine Learning · Computer Science 2022-09-27 Lennart Dabelow , Masahito Ueda

Existing block Kaczmarz methods face challenges in balancing computational efficiency and convergence for large sparse linear systems with scattered nonzero patterns, due to costly partitioning strategies and non-orthogonal projections. In…

Numerical Analysis · Mathematics 2025-06-24 Yu-Fang Liang , Hou-Biao Li

We establish quantitative convergence rates for stochastic particle approximation based on Nanbu-type Monte Carlo schemes applied to a broad class of collisional kinetic models. Using coupling techniques and stability estimates in the…

Numerical Analysis · Mathematics 2025-04-15 Giacomo Borghi , Lorenzo Pareschi

The simulation of complex systems, such as gas transport in large pipeline networks, often involves solving PDEs posed on intricate graph structures. Such problems require considerable computational and memory resources. The Random Batch…

Numerical Analysis · Mathematics 2025-09-01 Martín Hernández

We present a method for Monte Carlo sampling on systems with discrete variables (focusing in the Ising case), introducing a prior on the candidate moves in a Metropolis-Hastings scheme which can significantly reduce the rejection rate,…

Statistical Mechanics · Physics 2017-03-03 Carlo Baldassi

The Iterative Quasi-Monte Carlo (iQMC) method is a recently developed hybrid method for neutron transport simulations. iQMC replaces standard quadrature techniques used in deterministic linear solvers with Quasi-Monte Carlo simulation for…

Computational Physics · Physics 2025-01-13 Samuel Pasmann , Ilham Variansyah , C. T. Kelley , Ryan G. McClarren

A new Monte-Carlo method for long-range interacting systems is presented. This method consists of eliminating interactions stochastically with the detailed balance condition satisfied. When a pairwise interaction $V_{ij}$ of a $N$-particle…

Disordered Systems and Neural Networks · Physics 2015-05-13 Munetaka Sasaki , Fumitaka Matsubara

In this paper, we tackle the resolution of chance-constrained problems reformulated via Sample Average Approximation. The resulting data-driven deterministic reformulation takes the form of a large-scale mixed-integer program cursed with…

Optimization and Control · Mathematics 2023-06-27 Álvaro Porras , Concepción Domínguez , Juan M. Morales , Salvador Pineda

We propose a randomized nonmonotone block proximal gradient (RNBPG) method for minimizing the sum of a smooth (possibly nonconvex) function and a block-separable (possibly nonconvex nonsmooth) function. At each iteration, this method…

Optimization and Control · Mathematics 2015-03-24 Zhaosong Lu , Lin Xiao

Restricted Boltzmann machines (RBMs) are powerful machine learning models, but learning and some kinds of inference in the model require sampling-based approximations, which, in classical digital computers, are implemented using expensive…

Machine Learning · Statistics 2014-10-27 Vincent Dumoulin , Ian J. Goodfellow , Aaron Courville , Yoshua Bengio

In this paper, we propose a hierarchical random compression method (HRCM) for kernel matrices in fast kernel summations. The HRCM combines the hierarchical framework of the H-matrix and a randomized sampling technique of the column and row…

Numerical Analysis · Mathematics 2018-03-15 Duan Chen , Wei Cai

Restricted Boltzmann machines (RBMs) are energy-based models analogous to the Ising model and are widely applied in statistical machine learning. The standard inverse Ising problem with a complete dataset requires computing both data and…

Machine Learning · Statistics 2025-09-01 Kaiji Sekimoto , Muneki Yasuda