English
Related papers

Related papers: On Erlang mixture approximations for differential …

200 papers

Large-scale overlapping problems are prevalent in practical engineering applications, and the optimization challenge is significantly amplified due to the existence of shared variables. Decomposition-based cooperative coevolution (CC)…

Neural and Evolutionary Computing · Computer Science 2024-04-17 Maojiang Tian , Mingke Chen , Wei Du , Yang Tang , Yaochu Jin

In this article, we introduce and analyze a deep learning based approximation algorithm for SPDEs. Our approach employs neural networks to approximate the solutions of SPDEs along given realizations of the driving noise process. If applied…

Numerical Analysis · Mathematics 2025-10-21 Christian Beck , Sebastian Becker , Patrick Cheridito , Arnulf Jentzen , Ariel Neufeld

Asynchronous stochastic gradient descent (ASGD) is a popular parallel optimization algorithm in machine learning. Most theoretical analysis on ASGD take a discrete view and prove upper bounds for their convergence rates. However, the…

Machine Learning · Statistics 2018-05-09 Li He , Qi Meng , Wei Chen , Zhi-Ming Ma , Tie-Yan Liu

We provide two methods for computation of continuum backstepping kernels that arise in control of continua (ensembles) of linear hyperbolic PDEs and which can approximate backstepping kernels arising in control of a large-scale, PDE system…

Optimization and Control · Mathematics 2024-12-06 Jukka-Pekka Humaloja , Nikolaos Bekiaris-Liberis

Nonlinear partial differential equations (PDEs) are used to model dynamical processes in a large number of scientific fields, ranging from finance to biology. In many applications standard local models are not sufficient to accurately…

Numerical Analysis · Mathematics 2022-05-10 Victor Boussange , Sebastian Becker , Arnulf Jentzen , Benno Kuckuck , Loïc Pellissier

We introduce the Optimizing a Discrete Loss (ODIL) framework for the numerical solution of Partial Differential Equations (PDE) using machine learning tools. The framework formulates numerical methods as a minimization of discrete residuals…

Numerical Analysis · Mathematics 2024-01-23 Petr Karnakov , Sergey Litvinov , Petros Koumoutsakos

We derive computable error estimates for finite element approximations of linear elliptic partial differential equations (PDE) with rough stochastic coefficients. In this setting, the exact solutions contain high frequency content that…

Numerical Analysis · Mathematics 2018-09-18 Eric Joseph Hall , Håkon Hoel , Mattias Sandberg , Anders Szepessy , Raúl Tempone

Diffusion models (DMs) have achieved state-of-the-art generative performance but suffer from high sampling latency due to their sequential denoising nature. Existing solver-based acceleration methods often face significant image quality…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Ruoyu Wang , Ziyu Li , Beier Zhu , Liangyu Yuan , Hanwang Zhang , Xun Yang , Xiaojun Chang , Chi Zhang

Several statistical approaches based on reproducing kernels have been proposed to detect abrupt changes arising in the full distribution of the observations and not only in the mean or variance. Some of these approaches enjoy good…

Statistics Theory · Mathematics 2017-10-13 Alain Celisse , Guillemette Marot , Morgane Pierre-Jean , Guillem Rigaill

Stochastic differential equations (SDEs) provide a natural framework for modelling intrinsic stochasticity inherent in many continuous-time physical processes. When such processes are observed in multiple individuals or experimental units,…

Computation · Statistics 2016-05-19 Gavin A. Whitaker , Andrew Golightly , Richard J. Boys , Chris Sherlock

We develope a perturbation theory for stochastic differential equations (SDEs) by which we mean both stochastic ordinary differential equations (SODEs) and stochastic partial differential equations (SPDEs). In particular, we estimate the $…

Probability · Mathematics 2020-11-25 Martin Hutzenthaler , Arnulf Jentzen

We consider a symmetric mixture of linear regressions with random samples from the pairwise comparison design, which can be seen as a noisy version of a type of Euclidean distance geometry problem. We analyze the expectation-maximization…

Statistics Theory · Mathematics 2023-06-23 Abhishek Dhawan , Cheng Mao , Ashwin Pananjady

This paper considers the approximation of spatial convolution with a given radial integral kernel. Previous studies have demonstrated that approximating spatial convolution using a system of partial differential equations (PDEs) can…

Analysis of PDEs · Mathematics 2025-04-15 Hiroshi Ishii , Yoshitaro Tanaka

Most kernel-based methods, such as kernel or Gaussian process regression, kernel PCA, ICA, or $k$-means clustering, do not scale to large datasets, because constructing and storing the kernel matrix $\mathbf{K}_n$ requires at least…

Machine Learning · Statistics 2018-03-28 Daniele Calandriello , Alessandro Lazaric , Michal Valko

Some continuous optimization methods can be connected to ordinary differential equations (ODEs) by taking continuous limits, and their convergence rates can be explained by the ODEs. However, since such ODEs can achieve any convergence rate…

Numerical Analysis · Mathematics 2022-07-15 Kansei Ushiyama , Shun Sato , Takayasu Matsuo

Partial Differential Equations (PDE) are fundamental to model different phenomena in science and engineering mathematically. Solving them is a crucial step towards a precise knowledge of the behaviour of natural and engineered systems. In…

(Partial) differential equations (PDEs) are fundamental tools for describing natural phenomena, making their solution crucial in science and engineering. While traditional methods, such as the finite element method, provide reliable…

Machine Learning · Computer Science 2025-03-11 Viggo Moro , Luiz F. O. Chamon

The differential equation (DE) with proportional delay is a particular case of the time-dependent delay differential equation (DDE). In this paper, we solve non-linear DEs with proportional delay using the successive approximation method…

Classical Analysis and ODEs · Mathematics 2023-03-17 Prajakta Rajmane , Jayvant Patade , M. T. Gophane

An existence and uniqueness theorem for a class of stochastic delay differential equations is presented, and the convergence of Euler approximations for these equations is proved under general conditions. Moreover, the rate of almost sure…

Probability · Mathematics 2012-12-17 Istvan Gyöngy , Sotirios Sabanis

In this paper, we study a generalized finite element method for solving second-order elliptic partial differential equations with rough coefficients. The method uses local approximation spaces computed by solving eigenvalue problems on…

Numerical Analysis · Mathematics 2025-07-17 Christian Alber , Peter Bastian , Moritz Hauck , Robert Scheichl