English
Related papers

Related papers: Scalability of the second-order reliability method…

200 papers

The approximation of invariant measures for nonlinear ergodic stochastic differential equations (SDEs) is a central problem in scientific computing, with important applications in stochastic sampling, physics, and ecology. We first propose…

Numerical Analysis · Mathematics 2025-11-18 Shan Huang , Xiaoyue Li

Semilinear hyperbolic stochastic partial differential equations (SPDEs) find widespread applications in the natural and engineering sciences. However, the traditional Gaussian setting may prove too restrictive, as phenomena in mathematical…

Numerical Analysis · Mathematics 2023-07-04 Andrea Barth , Andreas Stein

In this study, we investigate the Shallow Water Equations incorporating source terms accounting for Manning friction and a non-flat bottom topology. Our primary focus is on developing and validating numerical schemes that serve a dual…

Numerical Analysis · Mathematics 2023-10-24 Guanlan Huang , Sebastiano Boscarino , Tao Xiong

Supervised dimensionality reduction strategies have been of great interest. However, current supervised dimensionality reduction approaches are difficult to scale for situations characterized by large datasets given the high computational…

Machine Learning · Computer Science 2018-11-09 Amir-Hossein Karimi , Alexander Wong , Ali Ghodsi

This paper proposes low-complexity algorithms for finding approximate second-order stationary points (SOSPs) of problems with smooth non-convex objective and linear constraints. While finding (approximate) SOSPs is computationally…

Optimization and Control · Mathematics 2019-07-11 Songtao Lu , Meisam Razaviyayn , Bo Yang , Kejun Huang , Mingyi Hong

A stochastic leap-frog algorithm for the numerical integration of Brownian motion stochastic differential equations with multiplicative noise is proposed and tested. The algorithm has a second-order convergence of moments in a finite time…

Computational Physics · Physics 2009-10-31 Ji Qiang , Salman Habib

There is a growing literature adopting a stochastic optimal control (SOC) perspective to fine-tune diffusion models and related generative policies. A prominent class of methods, known as iterative diffusion optimization, solves the SOC…

Optimization and Control · Mathematics 2026-03-24 Yuhang Mei , Amirhossein Taghvaei

This work proposes novel techniques for the efficient numerical simulation of parameterized, unsteady partial differential equations. Projection-based reduced order models (ROMs) such as the reduced basis method employ a (Petrov-)Galerkin…

Numerical Analysis · Mathematics 2023-12-05 Nicholas Mueller , Santiago Badia

Computable estimates for the error of finite element discretisations of parabolic problems in the $L^\infty(0,T; L^2)$ norm are developed, which exhibit constant effectivities (the ratio of the estimated error to the true error) with…

Numerical Analysis · Mathematics 2018-03-09 Oliver J. Sutton

This paper studies empirical risk minimization (ERM) problems for large-scale datasets and incorporates the idea of adaptive sample size methods to improve the guaranteed convergence bounds for first-order stochastic and deterministic…

Machine Learning · Computer Science 2017-09-05 Aryan Mokhtari , Alejandro Ribeiro

Irregular sampling intervals and missing values in real-world time series data present challenges for conventional methods that assume consistent intervals and complete data. Neural Ordinary Differential Equations (Neural ODEs) offer an…

Machine Learning · Computer Science 2025-01-28 YongKyung Oh , Dong-Young Lim , Sungil Kim

In this article we develop a high order accurate method to solve the incompressible boundary layer equations in a provably stable manner.~We first derive continuous energy estimates,~and then proceed to the discrete setting.~We formulate…

Numerical Analysis · Mathematics 2023-06-06 Mojalefa P. Nchupang , Arnaud G. Malan , Fredrik Laurén , Jan Nordström

We present a deep recurrent neural network architecture to solve a class of stochastic optimal control problems described by fully nonlinear Hamilton Jacobi Bellmanpartial differential equations. Such PDEs arise when one considers…

Machine Learning · Computer Science 2019-12-24 Marcus A Pereira , Ziyi Wang , Tianrong Chen , Emily Reed , Evangelos A Theodorou

A dynamic sampled stochastic approximated (DS-SA) extragradient method for stochastic variational inequalities (SVI) is proposed that is \emph{robust} with respect to an unknown Lipschitz constant $L$. To the best of our knowledge, it is…

Optimization and Control · Mathematics 2017-08-28 Alfredo Iusem , Alejandro Jofré , Roberto I. Oliveira , Philip Thompson

Diffusion Probabilistic Models (DPMs) have achieved considerable success in generation tasks. As sampling from DPMs is equivalent to solving diffusion SDE or ODE which is time-consuming, numerous fast sampling methods built upon improved…

Machine Learning · Computer Science 2025-06-26 Shuchen Xue , Mingyang Yi , Weijian Luo , Shifeng Zhang , Jiacheng Sun , Zhenguo Li , Zhi-Ming Ma

We consider stochastic convex optimization problems where the objective is an expectation over smooth functions. For this setting we suggest a novel gradient estimate that combines two recent mechanism that are related to notion of…

Machine Learning · Computer Science 2025-03-06 Tehila Dahan , Kfir Y. Levy

We consider stochastic approximations of sampling algorithms, such as Stochastic Gradient Langevin Dynamics (SGLD) and the Random Batch Method (RBM) for Interacting Particle Dynamcs (IPD). We observe that the noise introduced by the…

Probability · Mathematics 2023-10-10 Aniket Das , Dheeraj Nagaraj , Anant Raj

In this work, we study the stochastic optimal control problem (SOC) mainly from the probabilistic view point, i.e. via the Stochastic Maximum principle (SMP) \cite{Peng4}. We adopt the sample-wise backpropagation scheme proposed in…

Optimization and Control · Mathematics 2025-06-17 Hui Sun , Feng Bao

Sample average approximation (SAA), a popular method for tractably solving stochastic optimization problems, enjoys strong asymptotic performance guarantees in settings with independent training samples. However, these guarantees are not…

Optimization and Control · Mathematics 2021-12-13 Yafei Wang , Bo Pan , Wei Tu , Peng Liu , Bei Jiang , Chao Gao , Wei Lu , Shangling Jui , Linglong Kong

In this article we investigate the numerical solution of a scalar semilinear stochastic delay differential equation (SDDE) where the linear instantaneous feedback and nonlinear delayed feedback terms are perturbed by a pair of standard…

Numerical Analysis · Mathematics 2026-03-24 Cónall Kelly , Wenshi Tang