English
Related papers

Related papers: Large Deviations for Nonlocal Stochastic Neural Fi…

200 papers

In this article, we analyze semi-discrete finite element approximation and full discretization of a fourth-order stochastic pseudo-parabolic equation in a bounded convex polygonal domain driven by additive Wiener noise. We use the finite…

Numerical Analysis · Mathematics 2026-03-11 Suprio Bhar , Mrinmay Biswas , Mangala Prasad

Supervised models of NLP rely on large collections of text which closely resemble the intended testing setting. Unfortunately matching text is often not available in sufficient quantity, and moreover, within any domain of text, data is…

Computation and Language · Computer Science 2019-06-10 Yitong Li , Timothy Baldwin , Trevor Cohn

The Adaptive Multilevel Splitting (AMS) algorithm is a powerful and versatile method for the simulation of rare events. It is based on an interacting (via a mutation-selection procedure) system of replicas, and depends on two integer…

Probability · Mathematics 2015-02-25 Charles-Edouard Bréhier

Numerical analysis of conserved field dynamics has been generally performed with pseudo spectral methods. Finite differences integration, the common procedure for non-conserved field dynamics, indeed struggles to implement a conservative…

Statistical Mechanics · Physics 2024-01-29 Andrea Cavagna , Javier Cristín , Irene Giardina , Mario Veca

Sample path large deviations for the laws of the solutions of stochastic nonlinear Schrodinger equations when the noise converges to zero are presented. The noise is a complex additive gaussian noise. It is white in time and colored space…

Analysis of PDEs · Mathematics 2007-11-08 Eric Gautier

We present an efficient nodal discontinuous Galerkin method for approximating nearly incompressible flows using the Boltzmann equations. The equations are discretized with Hermite polynomials in velocity space yielding a first order…

Numerical Analysis · Mathematics 2019-05-22 A. Karakus , N. Chalmers , J. S. Hesthaven , T. Warburton

The efficient simulation of the mean value of a non-linear functional of the solution to a linear stochastic partial differential equation (SPDE) with additive Gaussian noise is considered. A Galerkin finite element method is employed along…

Probability · Mathematics 2019-07-25 Andreas Petersson

The goal of this paper is to study the Moderate Deviation Principle (MDP) for a system of stochastic reaction-diffusion equations with a time-scale separation in slow and fast components and small noise in the slow component. Based on weak…

Probability · Mathematics 2022-02-03 Ioannis Gasteratos , Michael Salins , Konstantinos Spiliopoulos

Recent works have shown that high probability metrics with stochastic gradient descent (SGD) exhibit informativeness and in some cases advantage over the commonly adopted mean-square error-based ones. In this work we provide a formal…

Machine Learning · Computer Science 2022-11-03 Dragana Bajovic , Dusan Jakovetic , Soummya Kar

This article proposes for stochastic partial differential equations (SPDEs) driven by additive noise, a novel approach for the approximate parameterizations of the ``small'' scales by the ``large'' ones, along with the derivaton of the…

Analysis of PDEs · Mathematics 2013-11-14 Mickaël D. Chekroun , Honghu Liu , Shouhong Wang

We study large deviations in the context of stochastic gradient descent for one-hidden-layer neural networks with quadratic loss. We derive a quenched large deviation principle, where we condition on an initial weight measure, and an…

Probability · Mathematics 2025-01-14 Christian Hirsch , Daniel Willhalm

This paper proposes a fully discrete method called the symplectic dG full discretization for stochastic Maxwell equations driven by additive noises, based on a stochastic symplectic method in time and a discontinuous Galerkin (dG) method…

Numerical Analysis · Mathematics 2020-09-22 Chuchu Chen

We analyze the finite sample regret of a decreasing step size stochastic gradient algorithm. We assume correlated noise and use a perturbed Lyapunov function as a systematic approach for the analysis. Finally we analyze the escape time of…

Machine Learning · Computer Science 2024-10-14 George Yin , Vikram Krishnamurthy

Dynamic Mode Decomposition (DMD) is a data-driven method for approximating the spatiotemporal modes of a system. The eigenvectors and eigenvalues of the system are approximated from a series of time-snapshots of the state variables. The…

Computational Engineering, Finance, and Science · Computer Science 2026-04-17 William Bennett , Ryan G. McClarren , Ethan Smith , Melek Derman

This paper introduces a new method based on Deep Galerkin Methods (DGMs) for solving high-dimensional stochastic Mean Field Games (MFGs). We achieve this by using two neural networks to approximate the unknown solutions of the MFG system…

Machine Learning · Computer Science 2023-08-09 Mouhcine Assouli , Badr Missaoui

We study the large deviations principle for locally periodic stochastic differential equations with small noise and fast oscillating coefficients. There are three possible regimes depending on how fast the intensity of the noise goes to…

Probability · Mathematics 2012-04-05 Paul Dupuis , Konstantinos Spiliopoulos

Stochastic Gradient Langevin Dynamics infuses isotropic gradient noise to SGD to help navigate pathological curvature in the loss landscape for deep networks. Isotropic nature of the noise leads to poor scaling, and adaptive methods based…

Machine Learning · Computer Science 2019-06-13 Chandrasekaran Anirudh Bhardwaj

We prove a large deviation principle result for solutions of abstract stochastic evolution equations perturbed by small Levy noise. We use general large deviations theorems of Varadhan and Bryc, viscosity solutions of integro-partial…

Probability · Mathematics 2010-03-09 Andrzej Swiech , Jerzy Zabczyk

A high order one-step ADER-WENO finite volume scheme with Adaptive Mesh Refinement (AMR) in multiple space dimensions is presented. A high order one-step time discretization is achieved using a local space-time discontinuous Galerkin…

Instrumentation and Methods for Astrophysics · Physics 2014-01-27 Olindo Zanotti , Michael Dumbser , Arturo Hidalgo , Dinshaw Balsara

This thesis is devoted to the study of ergodicity and large deviations for the stochastic nonlinear wave (NLW) equation with smooth white noise in 3D. Under some standard growth and dissipativity assumptions on the nonlinearity, we show…

Analysis of PDEs · Mathematics 2015-11-30 Davit Martirosyan