English
Related papers

Related papers: Stochastic Approximation, Cooperative Dynamics and…

200 papers

This article deals with the approximation of a stochastic partial differential equation (SPDE) via amplitude equations. We consider an SPDE with a cubic nonlinearity perturbed by a general multiplicative noise that preserves the constant…

Dynamical Systems · Mathematics 2019-10-08 Hongbo Fu , Dirk Blömker

When two players are engaged in a repeated game with unknown payoff matrices, they may use single-agent multi-armed bandit algorithms to choose the actions independent of each other. We show that when the players use Thompson sampling, the…

Computer Science and Game Theory · Computer Science 2025-09-30 Yi Xiong , Ningyuan Chen , Xuefeng Gao

Higher order schemes for stochastic partial differential equations that do not possess commutative noise require the simulation of iterated stochastic integrals. In this work, we propose a derivative-free Milstein type scheme to approximate…

Probability · Mathematics 2020-06-16 Claudine von Hallern , Andreas Rößler

This paper focuses on investigating an inexact stochastic model-based optimization algorithm that integrates preconditioning techniques for solving stochastic composite optimization problems. The proposed framework unifies and extends the…

Optimization and Control · Mathematics 2025-12-12 Chenglong Bao , Yancheng Yuan , Shulan Zhu

The success of adversarial formulations in machine learning has brought renewed motivation for smooth games. In this work, we focus on the class of stochastic Hamiltonian methods and provide the first convergence guarantees for certain…

A method of representation of a solution as segments of the series in powers of the step of the independent variable is expanded for solving complex systems of ordinary differential equations (ODE): the Lorenz system and other systems. A…

Numerical Analysis · Computer Science 2014-05-26 Vladimir Aristov , Andrey Stroganov

Minimax optimization problems have attracted a lot of attention over the past few years, with applications ranging from economics to machine learning. While advanced optimization methods exist for such problems, characterizing their…

Machine Learning · Computer Science 2024-02-21 Enea Monzio Compagnoni , Antonio Orvieto , Hans Kersting , Frank Norbert Proske , Aurelien Lucchi

We consider smooth stochastic convex optimization problems in the context of algorithms which are based on directional derivatives of the objective function. This context can be considered as an intermediate one between derivative-free…

Optimization and Control · Mathematics 2020-09-22 Pavel Dvurechensky , Eduard Gorbunov , Alexander Gasnikov

By interpreting the forward dynamics of the latent representation of neural networks as an ordinary differential equation, Neural Ordinary Differential Equation (Neural ODE) emerged as an effective framework for modeling a system dynamics…

Machine Learning · Computer Science 2020-10-19 Daehoon Gwak , Gyuhyeon Sim , Michael Poli , Stefano Massaroli , Jaegul Choo , Edward Choi

We consider the unconstrained optimization problem whose objective function is composed of a smooth and a non-smooth conponents where the smooth component is the expectation a random function. This type of problem arises in some interesting…

Optimization and Control · Mathematics 2011-07-01 Qihang Lin , Xi Chen , Javier Pena

Given a nonsmooth, nonconvex minimization problem, we consider algorithms that iteratively sample and minimize stochastic convex models of the objective function. Assuming that the one-sided approximation quality and the variation of the…

Optimization and Control · Mathematics 2018-07-03 Damek Davis , Dmitriy Drusvyatskiy , Kellie J. MacPhee

Numerical approximation of the long time behavior of a stochastic differential equation (SDE) is considered. Error estimates for time-averaging estimators are obtained and then used to show that the stationary behavior of the numerical…

Probability · Mathematics 2013-11-26 Jonathan C. Mattingly , Andrew M. Stuart , M. V. Tretyakov

We consider the problem of approximation of the solution of the backward stochastic differential equation in the Markovian case. We suppose that the trend coefficient of the diffusion process depends on some unknown parameter and the…

Statistics Theory · Mathematics 2013-05-17 Yury A. Kutoyants , Li Zhou

We investigate the convergence of symmetric stochastic differential games with interactions via control, where the volatility terms of both idiosyncratic and common noises are controlled. We apply the stochastic maximum principle, following…

Probability · Mathematics 2026-02-19 Erhan Bayraktar , Hiroaki Horikawa

Greedy algorithms are widely used for problems in machine learning such as feature selection and set function optimization. Unfortunately, for large datasets, the running time of even greedy algorithms can be quite high. This is because for…

Machine Learning · Statistics 2017-03-09 Rajiv Khanna , Ethan Elenberg , Alexandros G. Dimakis , Sahand Negahban , Joydeep Ghosh

Consider the following stochastic differential equation driven by multiplicative noise on $\mathbb{R}^d$ with a superlinearly growing drift coefficient, \begin{align*} \mathrm{d} X_t = b (X_t) \, \mathrm{d} t + \sigma (X_t) \, \mathrm{d}…

Probability · Mathematics 2025-05-07 Xiang Li , Yingjun Mo , Haoran Yang

For a wide class of polynomially nonlinear systems of partial differential equations we suggest an algorithmic approach to the s(trong)-consistency analysis of their finite difference approximations on Cartesian grids. First we apply the…

Symbolic Computation · Computer Science 2019-05-01 Vladimir P. Gerdt , Daniel Robertz

In performative prediction, the choice of a model influences the distribution of future data, typically through actions taken based on the model's predictions. We initiate the study of stochastic optimization for performative prediction.…

Machine Learning · Computer Science 2021-02-22 Celestine Mendler-Dünner , Juan C. Perdomo , Tijana Zrnic , Moritz Hardt

To approximate convolutions which occur in evolution equations with memory terms, a variable-stepsize algorithm is presented for which advancing N steps requires only O(N log(N)) operations and O(log(N)) active memory, in place of O(N^2)…

Numerical Analysis · Mathematics 2007-05-23 María López-Fernández , Christian Lubich , Achim Schädle

The promotion of cooperation on spatial lattices is an important issue in evolutionary game theory. This effect clearly depends on the update rule: it diminishes with stochastic imitative rules whereas it increases with unconditional…

Populations and Evolution · Quantitative Biology 2009-11-07 Carlos P. Roca , José A. Cuesta , Angel Sánchez