Related papers: Comparison between the DSMC and DSBGK Methods
Viscosity calculation from equilibrium molecular dynamics (MD) simulations relies on the traditional Green-Kubo (GK) framework, which integrates the stress autocorrelation function (SACF) over time. While the formalism is exact in the…
In two and three dimension we analyze discontinuous Galerkin methods for the acoustic problem. The acoustic fluid that we consider on this paper is inviscid, leading to a linear eigenvalue problem. The acoustic problem is written, in first…
SGD does not produce robust results on datasets with label noise. Because the gradients calculated according to the losses of the noisy samples cause the optimization process to go in the wrong direction. In this paper, as an alternative to…
We study the dynamics of a simple adaptive system in the presence of noise and periodic damping. The system is composed by two paths connecting a source and a sink, the dynamics is governed by equations that usually describe food search of…
In [Phys. Rev. 94 (1954), 511-525], P.L. Bhatnagar, E.P. Gross and M. Krook introduced a kinetic equation (the BGK equation), effective in physical situations where the Knudsen number is small compared to the scales where Boltzmann's…
Recent advancements in deep learning optimization have introduced new algorithms, such as Schedule-Free optimizers, AdEMAMix, MARS and Lion which modify traditional momentum mechanisms. In a separate line of work, theoretical acceleration…
Diffusion-based generative models (DBGMs) perturb data to a target noise distribution and reverse this process to generate samples. The choice of noising process, or inference diffusion process, affects both likelihoods and sample quality.…
Gene expression and its regulation is a nonequilibrium stochastic process. Different molecules are involved in several biochemical steps in this process with low copies. It is observed that the stochasticity in biochemical processes is…
We introduce a variational method for analyzing limit cycle oscillators in $\mathbb{R}^d$ driven by Gaussian noise. This allows us to derive exact stochastic differential equations (SDEs) for the amplitude and phase of the solution, which…
Stochastic simulation can make the molecular processes of cellular control more vivid than the traditional differential-equation approach by generating typical system histories instead of just statistical measures such as the mean and…
Stochastic gradient MCMC methods, such as stochastic gradient Langevin dynamics (SGLD), employ fast but noisy gradient estimates to enable large-scale posterior sampling. Although we can easily extend SGLD to distributed settings, it…
Recently, hybrid models have emerged that combine microscopic and mesoscopic regimes in a single stochastic reaction-diffusion simulation. Microscopic simulations track every individual molecule and are generally more accurate. Mesoscopic…
Accelerated coarse-graining (CG) algorithms for simulating heterogeneous chemical reactions on surface systems have recently gained much attention. In the present paper, we consider such an issue by investigating the oscillation behavior of…
The noise in stochastic gradient descent (SGD), caused by minibatch sampling, is poorly understood despite its practical importance in deep learning. This work presents the first systematic study of the SGD noise and fluctuations close to a…
Recent studies have demonstrated that noise in stochastic gradient descent (SGD) is closely related to generalization: A larger SGD noise, if not too large, results in better generalization. Since the covariance of the SGD noise is…
In this paper we analyze the behaviour of the stochastic gradient descent (SGD), a widely used method in supervised learning for optimizing neural network weights via a minimization of non-convex loss functions. Since the pioneering work of…
Dynamic mode decomposition (DMD) is a popular approach to analyzing and modeling fluid flows. In practice, datasets are almost always corrupted to some degree by noise. The vanilla DMD is highly noise-sensitive, which is why many…
Stochastic gradient descent (SGD) and its variants are mainstream methods to train deep neural networks. Since neural networks are non-convex, more and more works study the dynamic behavior of SGD and the impact to its generalization,…
Stochastic differential equations describe well many physical, biological and sociological systems, despite the simplification often made in their derivation. Here the usage of simple stochastic differential equations to characterize and…
Many modern production and measurement facilities incorporate multiphase systems at low pressures. In this region of flows at small, non-zero Knudsen- and low Mach numbers the classical mesoscopic Monte Carlo methods become increasingly…