English
Related papers

Related papers: Computing large deviation rate functions of entrop…

200 papers

Interior point methods (IPMs) are a common approach for solving linear programs (LPs) with strong theoretical guarantees and solid empirical performance. The time complexity of these methods is dominated by the cost of solving a linear…

Optimization and Control · Mathematics 2022-02-04 Gregory Dexter , Agniva Chowdhury , Haim Avron , Petros Drineas

Despite the numerous uses of semidefinite programming (SDP) and its universal solvability via interior point methods (IPMs), it is rarely applied to practical large-scale problems. This mainly owes to the computational cost of IPMs that…

Optimization and Control · Mathematics 2024-03-19 Yifan Ran , Stefan Vlaski , Wei Dai

We develop and analyze a stochastic genetic interacting particle method (SGIP) for reaction-diffusion-advection (RDA) equations. The SGIP method employs operator splitting to approximate the advection-diffusion and reaction processes,…

Numerical Analysis · Mathematics 2026-01-07 Boyi Hu , Zhongjian Wang , Jack Xin , Zhiwen Zhang

Targeting to understand the underlying explainable factors behind observations and modeling the conditional generation process on these factors, we connect disentangled representation learning to Diffusion Probabilistic Models (DPMs) to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Tao Yang , Yuwang Wang , Yan Lv , Nanning Zheng

We use a semi-Markov process method to calculate large deviations of counting statistics for three open quantum systems, including a resonant two-level system and resonant three-level systems in the $\Lambda$- and $V$-configurations. In the…

Statistical Mechanics · Physics 2023-12-15 Fei Liu

Exploiting stochastic path integral theory, we obtain \emph{by simulation} substantial gains in efficiency for the computation of reaction rates in one-dimensional, bistable, overdamped stochastic systems. Using a well-defined measure of…

Computational Physics · Physics 2016-09-08 Daniel M. Zuckerman , Thomas B. Woolf

In this paper we combine an infeasible Interior Point Method (IPM) with the Proximal Method of Multipliers (PMM). The resulting algorithm (IP-PMM) is interpreted as a primal-dual regularized IPM, suitable for solving linearly constrained…

Optimization and Control · Mathematics 2021-02-01 Spyridon Pougkakiotis , Jacek Gondzio

Integration against a probability distribution given its unnormalized density is a central task in Bayesian inference and other fields. We introduce new methods for approximating such expectations with a small set of weighted samples --…

Machine Learning · Statistics 2026-05-15 Ayoub Belhadji , Daniel Sharp , Youssef M. Marzouk

Recently proposed generative models for discrete data, such as Masked Diffusion Models (MDMs), exploit conditional independence approximations to reduce the computational cost of popular Auto-Regressive Models (ARMs), at the price of some…

Machine Learning · Statistics 2025-12-18 Hugo Lavenant , Giacomo Zanella

The 1D Ising model is the simplest Hamiltonian-based model in statistical mechanics. The sim- plest interacting particle process is the Symmetric Exclusion Process (SEP), a 1D lattice gas of particles that hop symmetrically and cannot…

Statistical Mechanics · Physics 2018-10-11 Joshua D M Hellier , Graeme J Ackland

In this work, we derive particle schemes, based on micro-macro decomposition, for linear kinetic equations in the diffusion limit. Due to the particle approximation of the micro part, a splitting between the transport and the collision part…

Numerical Analysis · Mathematics 2017-01-19 Anaïs Crestetto , Nicolas Crouseilles , Mohammed Lemou

We propose a method for approximating the large deviation rate function of time-integrated observables of diffusion processes, used in statistical physics to characterize the fluctuations of nonequilibrium systems. The method is based on…

Statistical Mechanics · Physics 2026-01-15 Pelerine Tsobgni Nyawo , Hugo Touchette

Traditional numerical techniques for solving time-dependent partial-differential-equation (PDE) initial-value problems (IVPs) store a truncated representation of the function values and some number of their time derivatives at each time…

Numerical Analysis · Mathematics 2011-09-08 Hal Finkel

Diffusion Probabilistic Models stand as a critical tool in generative modelling, enabling the generation of complex data distributions. This family of generative models yields record-breaking performance in tasks such as image synthesis,…

We prove a large-deviation principle (LDP) for the sample paths of jump Markov processes in the small noise limit when, possibly, all the jump rates vanish uniformly, but slowly enough, in a region of the state space. We further discuss the…

Probability · Mathematics 2021-02-26 Andrea Agazzi , Luisa Andreis , Robert I. A. Patterson , D. R. Michiel Renger

For statistics of rare events in systems obeying a large-deviation principle, the rate function is a key quantity. When numerically estimating the rate function one is always restricted to finite system sizes. Thus, if the interest is in…

Data Analysis, Statistics and Probability · Physics 2024-12-06 Peter Werner , Alexander K. Hartmann

We present a finite volume method preserving the invariant region property (IRP) for the reaction-diffusion systems with quasimonotone functions, including nondecreasing, decreasing, and mixed quasimonotone systems. The diffusion terms and…

Numerical Analysis · Mathematics 2024-01-26 Huifang Zhou

Entropy production quantifies the breaking of time-reversal symmetry in non-equilibrium systems. Here, we develop a direct method to obtain closed, tractable expressions for entropy production in a broad class of dynamical density…

Statistical Mechanics · Physics 2026-02-03 Antonin Brossollet , Giulio Biroli

The meaning of thermodynamic descriptions is found in large-deviations scaling of the fluctuations probabilities. The primary large-deviations rate function is the entropy, which is the basis for both fluctuation theorems and for…

Statistical Mechanics · Physics 2015-05-27 Eric Smith

The estimation of entropy rates for stationary discrete-valued stochastic processes is a well studied problem in information theory. However, estimating the entropy rate for stationary continuous-valued stochastic processes has not received…

Information Theory · Computer Science 2021-05-26 Andrew Feutrill , Matthew Roughan