English
Related papers

Related papers: High-order BDF convolution quadrature for stochast…

200 papers

In this paper we consider the numerical approximation of a semilinear reaction-diffusion model problem (PDEs) by means of reduced order methods (ROMs) based on proper orthogonal decomposition (POD). We focus on the time integration of the…

Numerical Analysis · Mathematics 2026-03-05 Bosco García-Archilla , Alicia García-Mascaraque , Julia Novo

We develop a new randomized iterative algorithm---stochastic dual ascent (SDA)---for finding the projection of a given vector onto the solution space of a linear system. The method is dual in nature: with the dual being a non-strongly…

Numerical Analysis · Mathematics 2016-01-29 Robert Mansel Gower , Peter Richtarik

In this article, we consider the so-called modified Euler scheme for stochastic differential equations (SDEs) driven by fractional Brownian motions (fBm) with Hurst parameter $\frac13<H<\frac12$. This is a first-order time-discrete…

Probability · Mathematics 2017-03-13 Yanghui Liu , Samy Tindel

This paper introduces a new class of numerical methods for the time integration of evolution equations set as Cauchy problems of ODEs or PDEs. The systematic design of these methods mixes the Runge-Kutta collocation formalism with…

Analysis of PDEs · Mathematics 2021-11-19 Guillaume Dujardin , Ingrid Lacroix-Violet

Under mild assumptions stochastic gradient methods asymptotically achieve an optimal rate of convergence if the arithmetic mean of all iterates is returned as an approximate optimal solution. However, in the absence of stochastic noise, the…

Optimization and Control · Mathematics 2022-10-06 Melinda Hagedorn , Florian Jarre

In this paper, we propose a new approach for the time-discretization of the incompressible stochastic Stokes equations with multiplicative noise. Our new strategy is based on the classical Milstein method from stochastic differential…

Numerical Analysis · Mathematics 2022-12-08 Liet Vo

In this work, we establish the maximal $\ell^p$-regularity for several time stepping schemes for a fractional evolution model, which involves a fractional derivative of order $\alpha\in(0,2)$, $\alpha\neq 1$, in time. These schemes include…

Numerical Analysis · Mathematics 2017-03-30 Bangti Jin , Buyang Li , Zhi Zhou

We present and investigate a new type of implicit fractional linear multistep method of order two for fractional initial value problems. The method is obtained from the second order super convergence of the Gr\"unwald-Letnikov approximation…

Numerical Analysis · Mathematics 2022-01-25 H. M. Nasir , Khadija Al Hasani

We study convex composite optimization problems, where the objective function is given by the sum of a prox-friendly function and a convex function whose subgradients are estimated under heavy-tailed noise. Existing work often employs…

Optimization and Control · Mathematics 2025-10-14 Chuan He , Zhaosong Lu

The graduated optimization approach is a method for finding global optimal solutions for nonconvex functions by using a function smoothing operation with stochastic noise. This paper makes three contributions regarding graduated…

Machine Learning · Computer Science 2026-01-27 Naoki Sato , Hideaki Iiduka

We present two easy-to-implement gradient-free/zeroth-order methods to optimize a stochastic non-smooth function accessible only via a black-box. The methods are built upon efficient first-order methods in the heavy-tailed case, i.e., when…

Optimization and Control · Mathematics 2023-08-25 Nikita Kornilov , Alexander Gasnikov , Pavel Dvurechensky , Darina Dvinskikh

Although deep learning-based methods have dominated stereo matching leaderboards by yielding unprecedented disparity accuracy, their inference time is typically slow, on the order of seconds for a pair of 540p images. The main reason is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Yiran Zhong , Charles Loop , Wonmin Byeon , Stan Birchfield , Yuchao Dai , Kaihao Zhang , Alexey Kamenev , Thomas Breuel , Hongdong Li , Jan Kautz

This work aims to introduce a heuristic timestep-adaptive algorithm for Computational Fluid Dynamics (CFD) and Fluid-Structure Interaction (FSI) problems where the flow is dominated by the pressure. In such scenarios, many time-adaptive…

Numerical Analysis · Mathematics 2024-07-02 Ivan Prusak , Davide Torlo , Monica Nonino , Gianluigi Rozza

Derivative Free Optimization is known to be an efficient and robust method to tackle the black-box optimization problem. When it comes to noisy functions, classical comparison-based algorithms are slower than gradient-based algorithms. For…

Optimization and Control · Mathematics 2016-04-29 Marie-Liesse Cauwet , Olivier Teytaud

Langevin simulation provides an effective way to study collisional effects in beams by reducing the six-dimensional Fokker-Planck equation to a group of stochastic ordinary differential equations. These resulting equations usually have…

Accelerator Physics · Physics 2007-05-23 Ji Qiang , Salman Habib

Stochastic first-order methods are standard for training large-scale machine learning models. Random behavior may cause a particular run of an algorithm to result in a highly suboptimal objective value, whereas theoretical guarantees are…

Optimization and Control · Mathematics 2024-09-02 Eduard Gorbunov , Marina Danilova , Innokentiy Shibaev , Pavel Dvurechensky , Alexander Gasnikov

In this paper we investigate a discrete approximation in time and in space of a Hilbert space valued stochastic process $\{u(t)\}_{t\in [0,T]}$ satisfying a stochastic linear evolution equation with a positive-type memory term driven by an…

Numerical Analysis · Mathematics 2014-11-07 Mihály Kovács , Jacques Printems

We consider an unconstrained problem of minimizing a smooth convex function which is only available through noisy observations of its values, the noise consisting of two parts. Similar to stochastic optimization problems, the first part is…

Optimization and Control · Mathematics 2020-09-22 Eduard Gorbunov , Pavel Dvurechensky , Alexander Gasnikov

Numerical approximation of a stochastic partial integro-differential equation driven by a space- time white noise is studied by truncating a series representation of the noise, with finite element method for spatial discretization and…

Numerical Analysis · Mathematics 2017-11-07 Max Gunzburger , Buyang Li , Jilu Wang

We present a novel hyperviscosity formulation for stabilizing RBF-FD discretizations of the advection-diffusion equation. The amount of hyperviscosity is determined quasi-analytically for commonly-used explicit, implicit, and…

Numerical Analysis · Mathematics 2018-08-01 Varun Shankar , Aaron L. Fogelson