English
Related papers

Related papers: Approximating the value functions for stochastic d…

200 papers

This paper is devoted to studying the first-order variational analysis of non-convex and non-differentiable functions that may not be subdifferentially regular. To achieve this goal, we entirely rely on two concepts of directional…

Optimization and Control · Mathematics 2022-04-22 Ashkan Mohammadi

This paper is related to nonzero-sum stochastic differential games in the Markovian framework. We show existence of a Nash equilibrium point for the game when the drift is no longer bounded and only satisfies a linear growth condition. The…

Optimization and Control · Mathematics 2014-08-06 Said Hamadène , Rui Mu

We consider two-player zero-sum stochastic games and propose a two-timescale $Q$-learning algorithm with function approximation that is payoff-based, convergent, rational, and symmetric between the two players. In two-timescale…

Machine Learning · Computer Science 2023-12-11 Zaiwei Chen , Kaiqing Zhang , Eric Mazumdar , Asuman Ozdaglar , Adam Wierman

A heuristic formula for 5-point approximation of the first derivative of an unknown function whose values are measured with an error at unequally spaced points is proposed. The derivative at a given point is calculated using the effective…

Data Analysis, Statistics and Probability · Physics 2022-09-14 Emmanuil Beygelzimer , Yan Beygelzimer

We consider finite element approximations for a one dimensional second order stochastic differential equation of boundary value type driven by a fractional Brownian motion with Hurst index $H\le 1/2$. We make use of a sequence of…

Numerical Analysis · Mathematics 2020-06-08 Yanzhao Cao , Jialin Hong , Zhihui Liu

A mathematical smooth function means that the function has continuous derivatives to a certain degree C(k). We call it a k-smooth function or a smooth function if k can grow infinitively. Based on quantum physics, there is no such smooth…

Numerical Analysis · Mathematics 2010-05-21 Li Chen

We discuss the general framework of a stochastic two-player, hybrid differential game, and we apply it to the modelling of a "match race" between two sailing boats, namely a competition in which the goal of both players is to proceed in the…

Numerical Analysis · Mathematics 2019-06-27 Simone Cacace , Roberto Ferretti , Adriano Festa

The article is devoted to approximate, global and along curves differentiability of functions over non-archimedean infinite fields with non-trivial valuations. Fields with zero and non-zero characteristics are considered. Spaces of…

Classical Analysis and ODEs · Mathematics 2010-03-16 S. V. Ludkovsky

We consider second-order elliptic equations with oblique derivative boundary conditions, defined on a family of bounded domains in $\mathbb{C}$ that depend smoothly on a real parameter $\lambda \in [0,1]$. We derive sharp regularity…

Analysis of PDEs · Mathematics 2022-10-04 Ziming Shi

This paper is devoted to the equivalence of two type direct theorems in Approximation Theory: a) for smooth functions (Favard's estimates). b) for arbitrary continuous function (Jackson--Stechkin estimates). Specifically, we will show that…

Classical Analysis and ODEs · Mathematics 2008-09-02 A. G. Babenko , Yu. V. Kryakin

Understanding and analyzing markets is crucial, yet analytical equilibrium solutions remain largely infeasible. Recent breakthroughs in equilibrium computation rely on zeroth-order policy gradient estimation. These approaches commonly…

Computer Science and Game Theory · Computer Science 2023-03-17 Nils Kohring , Fabian R. Pieroth , Martin Bichler

We propose a novel study of the stochastic proximal gradient method for minimizing the sum of two convex functions, one of which is smooth. Under suitable assumptions and without requiring any boundedness or control of the variance of the…

Optimization and Control · Mathematics 2026-04-16 Javier I. Madariaga

We study a class of nonzero-sum stochastic differential games between two teams with agents in each team interacting through graphon aggregates. On the one hand, in each large population group, agents act together to optimize a common…

Optimization and Control · Mathematics 2025-06-16 De-xuan Xu , Zhun Gou , Nan-jing Huang

We define a random step size tug-of-war game, and show that the gradient of a value function exists almost everywhere. We also prove that the gradients of value functions are uniformly bounded and converge weakly to the gradient of the…

Analysis of PDEs · Mathematics 2020-04-24 Amal Attouchi , Hannes Luiro , Mikko Parviainen

This paper considers the estimation of quantiles via a smoothed version of the stochastic gradient descent (SGD) algorithm. By smoothing the score function in the conventional SGD quantile algorithm, we achieve monotonicity in the quantile…

Machine Learning · Statistics 2025-05-20 Likai Chen , Georg Keilbar , Wei Biao Wu

For functions belonging to the classes $C^{2}[0, 1]$ and $C^{3}[0, 1]$, we establish the lower estimate with an explicit constant in approximation by Bernstein polynomials in terms of the second order Ditzian-Totik modulus of smoothness.…

Classical Analysis and ODEs · Mathematics 2015-04-08 Sorin Gal , Gancho Tachev

The paper is concerned with two-person games with saddle point. We investigate the limits of value functions for long-time-average payoff, discounted average payoff, and the payoff that follows a probability density. Most of our assumptions…

Optimization and Control · Mathematics 2015-01-29 Dmitry Khlopin

We investigate a two-player zero-sum stochastic differential game problem with the state process being constrained in a connected bounded closed domain, and the cost functional described by the solution of a generalized backward stochastic…

Probability · Mathematics 2017-05-12 Lishun Xiao , Dejian Tian

We analyze a zero-sum stochastic differential game between two competing players who can choose unbounded controls. The payoffs of the game are defined through backward stochastic differential equations. We prove that each player's priority…

Probability · Mathematics 2013-03-14 Erhan Bayraktar , Song Yao

Stochastic dynamical systems often contain nonlinearities which make it hard to compute probability density functions or statistical moments of these systems. For the moment computations, nonlinearities in the dynamics lead to unclosed…

Optimization and Control · Mathematics 2017-03-28 Khem Raj Ghusinga , Mohammad Soltani , Andrew Lamperski , Sairaj Dhople , Abhyudai Singh