English
Related papers

Related papers: SMD-based numerical stochastic perturbation theory

200 papers

Dimensional reduction is a key issue in finite temperature field theory. For example, when following the QCD Free Energy from low to high scales across the critical temperature, ultrasoft degrees of freedom can be captured by a 3d SU(3)…

High Energy Physics - Lattice · Physics 2016-09-01 F. Di Renzo , A. Mantovi , V. Miccio , Y. Schroder

The modified Method of Successive Approximations (MSA) is an iterative scheme for approximating solutions to stochastic control problems in continuous time based on Pontryagin Optimality Principle which, starting with an initial open loop…

Optimization and Control · Mathematics 2023-10-10 Deven Sethi , David Šiška

Stochastic mirror descent (SMD) is a fairly new family of algorithms that has recently found a wide range of applications in optimization, machine learning, and control. It can be considered a generalization of the classical stochastic…

Optimization and Control · Mathematics 2019-04-04 Navid Azizan , Babak Hassibi

Stein Variational Gradient Descent (SVGD) is an important alternative to the Langevin-type algorithms for sampling from probability distributions of the form $\pi(x) \propto \exp(-V(x))$. In the existing theory of Langevin-type algorithms…

Statistics Theory · Mathematics 2022-06-02 Lukang Sun , Avetik Karagulyan , Peter Richtarik

Stochastic gradient descent (SGD) is perhaps the most prevalent optimization method in modern machine learning. Contrary to the empirical practice of sampling from the datasets without replacement and with (possible) reshuffling at each…

Optimization and Control · Mathematics 2024-02-08 Xufeng Cai , Cheuk Yin Lin , Jelena Diakonikolas

In this paper, we investigate the problem of strong approximation of the solutions of stochastic differential equations (SDEs) when the drift coefficient is given in integral form. We investigate its upper error bounds, in terms of the…

Numerical Analysis · Mathematics 2025-11-20 Paweł Przybyłowicz , Michał Sobieraj

We review the method of stochastic quantization for a scalar field theory. We first give a brief survey for the case of self-interacting scalar fields, implementing the stochastic perturbation theory up to the one-loop level. The…

High Energy Physics - Theory · Physics 2008-11-26 G. Menezes , N. F. Svaiter

Shuffling strategies for stochastic gradient descent (SGD), including incremental gradient, shuffle-once, and random reshuffling, are supported by rigorous convergence analyses for arbitrary within-epoch permutations. In particular, random…

Machine Learning · Computer Science 2026-04-02 Lam M. Nguyen , Dzung T. Phan , Jayant Kalagnanam

The Schr\"odinger-Langevin (SL) equation is considered as an effective open quantum system formalism suitable for phenomenological applications involving a quantum subsystem interacting with a thermal bath. We focus on two open issues…

Quantum Physics · Physics 2016-03-17 Roland Katz , Pol Bernard Gossiaux

We analyze the qualitative properties and the order of convergence of a splitting scheme for a class of nonlinear stochastic Schr\"odinger equations driven by additive It\^o noise. The class of nonlinearities of interest includes nonlocal…

Numerical Analysis · Mathematics 2022-11-16 Charles-Edouard Bréhier , David Cohen

Effective training of deep neural networks suffers from two main issues. The first is that the parameter spaces of these models exhibit pathological curvature. Recent methods address this problem by using adaptive preconditioning for…

Machine Learning · Statistics 2015-12-25 Chunyuan Li , Changyou Chen , David Carlson , Lawrence Carin

It is shown how to adapt the non-perturbative coupled cluster method of many-body theory so that it may be successfully applied to Hamiltonian lattice $SU(N)$ gauge theories. The procedure involves first writing the wavefunctions for the…

High Energy Physics - Lattice · Physics 2009-10-22 C. H. Llewellyn Smith , N. J. Watson

This paper presents a comprehensive analysis of a broad range of variations of the stochastic proximal point method (SPPM). Proximal point methods have attracted considerable interest owing to their numerical stability and robustness…

Optimization and Control · Mathematics 2024-05-28 Peter Richtárik , Abdurakhmon Sadiev , Yury Demidovich

Stochastic Variational Method (SVM) is the generalization of the variation method to the case with stochastic variables. In the series of papers, we investigate the applicability of SVM as an alternative field quantization scheme. Here, we…

High Energy Physics - Theory · Physics 2015-09-29 T. Koide , T. Kodama

We study a multiscale stochastic optimal control problem subject to state constraints on the slow variable. To address this class of problems, we develop a rigorous theoretical framework based on singular perturbation analysis, tailored to…

Optimization and Control · Mathematics 2025-08-12 Anderson O. Calixto , Bernardo Freitas Paulo da Costa , Glauco Valle

In this paper we develop a Stochastic Gradient Langevin Dynamics (SGLD) algorithm tailored for solving a certain class of non-convex distributionally robust optimisation (DRO) problems. By deriving non-asymptotic convergence bounds, we…

Optimization and Control · Mathematics 2026-05-08 Ariel Neufeld , Matthew Ng Cheng En , Ying Zhang

We present several methods, which utilize symplectic integration techniques based on two and three part operator splitting, for numerically solving the equations of motion of the disordered, discrete nonlinear Schr\"odinger (DDNLS)…

Computational Physics · Physics 2016-04-11 Enrico Gerlach , Jan Meichsner , Charalampos Skokos

This paper develops a sliding mode control based frame work for equality constrained optimization by reformulation the first order Karush Kuhn Tucker conditions as control affine dynamical system. The optimization variables are treated as…

Optimization and Control · Mathematics 2026-05-01 Shyam Kamal , Baby Diana , Sunidhi Pandey , Sandip Ghosh , Thach Ngoc Dinh

The stochastic gradient descent (SGD) algorithm is the algorithm we use to train neural networks. However, it remains poorly understood how the SGD navigates the highly nonlinear and degenerate loss landscape of a neural network. In this…

Machine Learning · Computer Science 2025-06-13 Liu Ziyin , Hongchao Li , Masahito Ueda

Several numerical schemes are proposed for the solution of Nonequilibrium Langevin Dynamics (NELD), and the rate of convergence is analyzed. Due to the special deforming boundary conditions used, care must be taken when using standard…

Numerical Analysis · Mathematics 2017-09-26 Matthew Dobson , Abdel Kader Geraldo