English
Related papers

Related papers: An explicit splitting SAV scheme for the kinetic L…

200 papers

This paper develops a generalized scalar auxiliary variable (SAV) method for the time-dependent Ginzburg-Landau equations. The backward Euler is used for discretizing the temporal derivative of the time-dependent Ginzburg-Landau equations.…

Numerical Analysis · Mathematics 2022-10-18 Zhiyong Si

Motivated by applications to deep learning which often fail standard Lipschitz smoothness requirements, we examine the problem of sampling from distributions that are not log-concave and are only weakly dissipative, with log-gradients…

Machine Learning · Statistics 2024-05-29 Iosif Lytras , Panayotis Mertikopoulos

Efficient sampling from complex and high dimensional target distributions turns out to be a fundamental task in diverse disciplines such as scientific computing, statistics and machine learning. In this paper, we propose a new kind of…

Machine Learning · Statistics 2026-04-24 Xiaojie Wang , Bin Yang

The generalized Langevin equation is used as a model for various coarse-grained physical processes, e.g., the time evolution of the velocity of a given larger particle in an implicitly represented solvent, when the relevant time scales of…

Statistical Mechanics · Physics 2025-11-13 Niklas Bockius , Maximilian Braun , Kay Hofmann , Friederike Schmid , Martin Hanke

This paper proposes a new class of arbitrarily high-order conservative numerical schemes for the generalized Korteweg-de Vries (KdV) equation. This approach is based on the scalar auxiliary variable (SAV) method. The equation is…

Numerical Analysis · Mathematics 2022-05-25 Kai Yang

Sampling the parameter space of artificial neural networks according to a Boltzmann distribution provides insight into the geometry of low-loss solutions and offers an alternative to conventional loss minimization for training. However,…

Disordered Systems and Neural Networks · Physics 2026-03-17 Alessandro Zambon , Francesca Caruso , Riccardo Zecchina , Guido Tiana

We consider the stochastic variational inequality problem in which the map is expectation-valued in a component-wise sense. Much of the available convergence theory and rate statements for stochastic approximation schemes are limited to…

Optimization and Control · Mathematics 2019-11-25 Aswin Kannan , Uday V. Shanbhag

In this paper, we construct two kinds of exponential SAV approach with relaxation (R-ESAV) for dissipative system. The constructed schemes are linear and unconditionally energy stable. They can guarantee the positive property of SAV without…

Numerical Analysis · Mathematics 2023-03-02 Yanrong Zhang , Xiaoli Li

We study Langevin-type algorithms for sampling from Gibbs distributions such that the potentials are dissipative and their weak gradients have finite moduli of continuity not necessarily convergent to zero. Our main result is a…

Statistics Theory · Mathematics 2024-03-01 Shogo Nakakita

Stochastic-gradient sampling methods are often used to perform Bayesian inference on neural networks. It has been observed that the methods in which notions of differential geometry are included tend to have better performances, with the…

Machine Learning · Computer Science 2024-04-02 Hanlin Yu , Marcelo Hartmann , Bernardo Williams , Arto Klami

Stochastic gradients have been widely integrated into Langevin-based methods to improve their scalability and efficiency in solving large-scale sampling problems. However, the proximal sampler, which exhibits much faster convergence than…

Machine Learning · Statistics 2024-05-28 Xunpeng Huang , Difan Zou , Yi-An Ma , Hanze Dong , Tong Zhang

We present strongly convergent explicit and semi-implicit adaptive numerical schemes for systems of stiff stochastic differential equations (SDEs) where both the drift and diffusion are non-globally Lipschitz continuous. This stiffness may…

Numerical Analysis · Mathematics 2021-06-02 Cónall Kelly , Gabriel Lord

We propose an effective explicit numerical scheme for simulating solutions of stochastic differential equations with confining superlinear drift terms, driven by multiplicative heavy-tailed L\'evy noise. The scheme is designed to prevent…

Computational Physics · Physics 2026-01-21 Ilya Pavlyukevich , Olga Aryasova , Alexei Chechkin , Oleksii Kulyk

The efficient evaluation of high-dimensional integrals is of importance in both theoretical and practical fields of science, such as data science, statistical physics, and machine learning. However, exact computation methods suffer from the…

Statistics Theory · Mathematics 2017-12-15 Radislav Vaisman , Robert Salomone , Dirk P. Kroese

It is well-known that the Allen-Cahn equation not only satisfies the energy dissipation law but also possesses the maximum bound principle (MBP) in the sense that the absolute value of its solution is pointwise bounded for all time by some…

Numerical Analysis · Mathematics 2022-03-15 Lili Ju , Xiao Li , Zhonghua Qiao

In this work, we consider convex optimization problems with smooth objective function and nonsmooth functional constraints. We propose a new stochastic gradient algorithm, called Stochastic Halfspace Approximation Method (SHAM), to solve…

Optimization and Control · Mathematics 2024-12-04 Nitesh Kumar Singh , Ion Necoara

We develop a framework that allows the use of the multi-level Monte Carlo (MLMC) methodology (Giles2015) to calculate expectations with respect to the invariant measure of an ergodic SDE. In that context, we study the (over-damped) Langevin…

Numerical Analysis · Mathematics 2019-08-13 Michael B. Giles , Mateusz B. Majka , Lukasz Szpruch , Sebastian Vollmer , Konstantinos Zygalakis

In molecular dynamics, penalized overdamped Langevin dynamics are used to model the motion of a set of particles that follow constraints up to a parameter $\varepsilon$. The most used schemes for simulating these dynamics are the Euler…

Numerical Analysis · Mathematics 2022-10-10 Adrien Laurent

The viability of a variant of numerical stochastic perturbation theory, where the Langevin equation is replaced by the SMD algorithm, is examined. In particular, the convergence of the process to a unique stationary state is rigorously…

High Energy Physics - Lattice · Physics 2017-06-02 Mattia Dalla Brida , Martin Lüscher

This paper concerns the numerical approximation for the invariant distribution of Markovian switching L\'evy-driven stochastic differential equations. By combining the tamed-adaptive Euler-Maruyama scheme with the Multi-level Monte Carlo…

Probability · Mathematics 2024-11-07 Hoang-Viet Nguyen , Trung-Thuy Kieu , Duc-Trong Luong , Hoang-Long Ngo , Tran Ngoc Khue