Related papers: On the condition for correct convergence in the co…
The exact estimation of latent variable models with big data is known to be challenging. The latents have to be integrated out numerically, and the dimension of the latent variables increases with the sample size. This paper develops a…
Sampling from a high-dimensional distribution is a fundamental task in statistics, engineering, and the sciences. A canonical approach is the Langevin Algorithm, i.e., the Markov chain for the discretized Langevin Diffusion. This is the…
Monte Carlo sampling techniques have broad applications in machine learning, Bayesian posterior inference, and parameter estimation. Often the target distribution takes the form of a product distribution over a dataset with a large number…
Stochastic quantization offers the opportunity to simulate field theories with a complex action. In some theories unstable trajectories are prevalent when a constant stepsize is employed. We construct algorithms for generating an adaptive…
We provide theoretical convergence guarantees for score-based generative models (SGMs) such as denoising diffusion probabilistic models (DDPMs), which constitute the backbone of large-scale real-world generative models such as DALL$\cdot$E…
Classically, the continuous-time Langevin diffusion converges exponentially fast to its stationary distribution $\pi$ under the sole assumption that $\pi$ satisfies a Poincar\'e inequality. Using this fact to provide guarantees for the…
Transition of a system between two states is an important but difficult problem in natural science. In this article we study the transition problem in the framework of transition path ensemble. Using the overdamped Langevin method, we…
QCD at nonzero baryon chemical potential suffers from the sign problem, due to the complex quark determinant. Complex Langevin dynamics can provide a solution, provided certain conditions are met. One of these conditions, holomorphicity of…
Hamiltonian Monte Carlo (HMC) sampling methods provide a mechanism for defining distant proposals with high acceptance probabilities in a Metropolis-Hastings framework, enabling more efficient exploration of the state space than standard…
We put forward a general framework for the study of a pathwise central limit theorem (CLT) and a moderate deviation principle (MDP) for stochastic partial differential equations perturbed with a small multiplicative linear noise by means of…
Cross-Correlation random matrices have emerged as a promising indicator of phase transitions in spin systems. The core concept is that the evolution of magnetization encapsulates thermodynamic information [R. da Silva, Int. J. Mod. Phys. C,…
Stochastic gradient Markov Chain Monte Carlo algorithms are popular samplers for approximate inference, but they are generally biased. We show that many recent versions of these methods (e.g. Chen et al. (2014)) cannot be corrected using…
We prove, under mild conditions, that the stochastic gradient Langevin dynamics converges to a limiting law as time tends to infinity, even in the case where the driving data sequence is dependent.
We study the design and implementation of numerical methods to solve the generalized Langevin equation (GLE) focusing on canonical sampling properties of numerical integrators. For this purpose, we cast the GLE in an extended phase space…
We discuss the problem of possible boundary terms at poles of the drift in the complex Langevin method, which spoil correctness of the method. For the simplest, however paradigmatic cases we can find complete answers. Lessons for more…
An noise-induced mechanism has been revealed by some authors recently for the homochirality in a chiral system. Motivated by such stochastic process, we study the noise-induced transition in the system. The chiral transition, say the…
Applying standard Markov chain Monte Carlo (MCMC) algorithms to large data sets is computationally expensive. Both the calculation of the acceptance probability and the creation of informed proposals usually require an iteration through the…
We consider point particle that collides with a periodic array of hard-core elastic scatterers where the length of the free flights is unbounded (the infinite-horizon Lorentz gas, LG). The Bleher central limit theorem (CLT) states that the…
We derive a family of correctness conditions for complex Langevin simulations. In particular, we show that if in a given theory the expectation values of all observables within a particular space satisfy the theory's Schwinger-Dyson…
We study the mixing properties of an important optimization algorithm of machine learning: the stochastic gradient Langevin dynamics (SGLD) with a fixed step size. The data stream is not assumed to be independent hence the SGLD is not a…