English
Related papers

Related papers: Optimal approximation of stochastic integrals in a…

200 papers

In this paper, we consider a semi-linear stochastic strongly damped wave equation driven by additive Gaussian noise. Following a semigroup framework, we establish existence, uniqueness and space-time regularity of a mild solution to such…

Numerical Analysis · Mathematics 2020-08-10 Ruisheng Qi , Xiaojie Wang

Stochastic optimization is a vital field in the realm of mathematical optimization, finding applications in diverse areas ranging from operations research to machine learning. In this paper, we introduce a novel first-order optimization…

Optimization and Control · Mathematics 2024-09-17 Vladimir Solodkin , Savelii Chezhegov , Ruslan Nazikov , Aleksandr Beznosikov , Alexander Gasnikov

A recent paper of Melbourne & Stuart, A note on diffusion limits of chaotic skew product flows, Nonlinearity 24 (2011) 1361-1367, gives a rigorous proof of convergence of a fast-slow deterministic system to a stochastic differential…

Dynamical Systems · Mathematics 2015-06-15 Georg A. Gottwald , Ian Melbourne

Using quasi-Newton methods in stochastic optimization is not a trivial task given the difficulty of extracting curvature information from the noisy gradients. Moreover, pre-conditioning noisy gradient observations tend to amplify the noise.…

Optimization and Control · Mathematics 2024-04-02 Andre Carlon , Luis Espath , Raul Tempone

Many machine learning and optimization algorithms are built upon the framework of stochastic approximation (SA), for which the selection of step-size (or learning rate) $\{\alpha_n\}$ is crucial for success. An essential condition for…

Statistics Theory · Mathematics 2025-08-05 Caio Kalil Lauand , Sean Meyn

We present a novel stochastic version of the Barnes-Hut approximation. Regarding the level-of-detail (LOD) family of approximations as control variates, we construct an unbiased estimator of the kernel sum being approximated. Through…

Graphics · Computer Science 2025-06-04 Abhishek Madan , Nicholas Sharp , Francis Williams , Ken Museth , David I. W. Levin

In large-scale systems, complex internal relationships are often present. Such interconnected systems can be effectively described by low rank stochastic processes. When identifying a predictive model of low rank processes from sampling…

Machine Learning · Computer Science 2025-01-17 Wenqi Cao , Aming Li

Variational quantum algorithms (VQAs) offer the most promising path to obtaining quantum advantages via noisy intermediate-scale quantum (NISQ) processors. Such systems leverage classical optimization to tune the parameters of a…

Quantum Physics · Physics 2022-09-26 Sharu Theresa Jose , Osvaldo Simeone

It is common in pose graph optimization (PGO) algorithms to assume that noise in the translations and rotations of relative pose measurements is uncorrelated. However, existing work shows that in practice these measurements can be highly…

Optimization and Control · Mathematics 2025-07-01 William D. Warke , J. Humberto Ramos , Prashant Ganesh , Kevin M. Brink , Matthew T. Hale

To model modern large-scale datasets, we need efficient algorithms to infer a set of $P$ unknown model parameters from $N$ noisy measurements. What are fundamental limits on the accuracy of parameter inference, given finite signal-to-noise…

Machine Learning · Statistics 2016-09-07 Madhu Advani , Surya Ganguli

We present a quantum chemistry benchmark for noisy intermediate-scale quantum computers that leverages the variational quantum eigensolver, active space reduction, a reduced unitary coupled cluster ansatz, and reduced density purification…

This paper investigates how models of spatiotemporal dynamics in the form of nonlinear partial differential equations can be identified directly from noisy data using a combination of sparse regression and weak formulation. Using the…

Dynamical Systems · Mathematics 2020-01-08 Daniel R. Gurevich , Patrick A. K. Reinbold , Roman O. Grigoriev

In this paper, we consider a numerical approximation of the stochastic differential equation (SDE) $$X_{t}=x_{0}+ \int_{0}^{t} b(s, X_{s}) \mathrm{d}s + L_{t},~x_{0} \in \mathbb{R}^{d},~t \in [0,T],$$ where the drift coefficient $b:[0,T]…

Probability · Mathematics 2016-05-24 Olivier Menoukeu Pamen , Dai Taguchi

Modeling real-world systems requires accounting for noise - whether it arises from unpredictable fluctuations in financial markets, irregular rhythms in biological systems, or environmental variability in ecosystems. While the behavior of…

Machine Learning · Computer Science 2026-04-08 Matteo Bosso , Giovanni Franzese , Kushal Swamy , Maarten Theulings , Alejandro M. Aragón , Farbod Alijani

Recent studies found that many channels are affected by additive noise that is impulsive in nature and is best explained by heavy-tailed symmetric alpha-stable distributions. Dealing with impulsive noise environments comes with an added…

Information Theory · Computer Science 2016-10-07 Jihad Fahs , Ibrahim Abou-Faycal

Stochastic approximation is a class of algorithms that update a vector iteratively, incrementally, and stochastically, including, e.g., stochastic gradient descent and temporal difference learning. One fundamental challenge in analyzing a…

Machine Learning · Computer Science 2025-11-06 Shuze Daniel Liu , Shuhang Chen , Shangtong Zhang

Discrete stochastic optimization considers the problem of minimizing (or maximizing) loss functions defined on discrete sets, where only noisy measurements of the loss functions are available. The discrete stochastic optimization problem is…

Optimization and Control · Mathematics 2013-11-04 Qi Wang

We analyze a stochastic approximation algorithm for decision-dependent problems, wherein the data distribution used by the algorithm evolves along the iterate sequence. The primary examples of such problems appear in performative prediction…

Optimization and Control · Mathematics 2024-05-15 Joshua Cutler , Mateo Díaz , Dmitriy Drusvyatskiy

The quantum approximate optimization algorithm (QAOA) is a variational method for noisy, intermediate-scale quantum computers to solve combinatorial optimization problems. Quantifying performance bounds with respect to specific problem…

Quantum Physics · Physics 2021-11-30 Phillip C. Lotshaw , Travis S. Humble , Rebekah Herrman , James Ostrowski , George Siopsis

We propose an algorithm to actively estimate the parameters of a linear dynamical system. Given complete control over the system's input, our algorithm adaptively chooses the inputs to accelerate estimation. We show a finite time bound…

Machine Learning · Computer Science 2020-06-23 Andrew Wagenmaker , Kevin Jamieson