English
Related papers

Related papers: An algorithm to solve optimal stopping problems fo…

200 papers

We consider an optimal stopping problem with n correlated offers where the goal is to design a (randomized) stopping strategy that maximizes the expected value of the offer in the sequence at which we stop. Instead of assuming to know the…

Optimization and Control · Mathematics 2025-07-08 Pieter Kleer , Daan Noordenbos

We present and analyze a discontinuous Petrov-Galerkin method with optimal test functions for a reaction-dominated diffusion problem in two and three space dimensions. We start with an ultra-weak formulation that comprises parameters…

Numerical Analysis · Mathematics 2017-05-30 Norbert Heuer , Michael Karkulik

In this paper, we study the optimal stopping problem in the so-called exploratory framework, in which the agent takes actions randomly conditioning on current state and an entropy-regularized term is added to the reward functional. Such a…

Optimization and Control · Mathematics 2023-09-04 Yuchao Dong

In this paper, we aim to develop the theory of optimal stochastic control for branching diffusion processes where both the movement and the reproduction of the particles depend on the control. More precisely, we study the problem of…

Probability · Mathematics 2016-09-19 Julien Claisse

We study the problem of computing the value function from a discretely-observed trajectory of a continuous-time diffusion process. We develop a new class of algorithms based on easily implementable numerical schemes that are compatible with…

Machine Learning · Computer Science 2024-07-09 Wenlong Mou , Yuhua Zhu

We formulate an optimal stopping problem for a geometric Brownian motion where the probability scale is distorted by a general nonlinear function. The problem is inherently time inconsistent due to the Choquet integration involved. We…

Probability · Mathematics 2022-01-07 Zuo Quan Xu , Xun Yu Zhou

Diffusion models excel at modeling complex data distributions, including those of images, proteins, and small molecules. However, in many cases, our goal is to model parts of the distribution that maximize certain properties: for example,…

Many problems in geometric optics or convex geometry can be recast as optimal transport problems: this includes the far-field reflector problem, Alexandrov's curvature prescription problem, etc. A popular way to solve these problems…

Numerical Analysis · Mathematics 2017-03-08 Jun Kitagawa , Quentin Mérigot , Boris Thibert

We consider a decision maker who must choose an action in order to maximize a reward function that depends also on an unknown parameter {\Theta}. The decision maker can delay taking the action in order to experiment and gather additional…

Machine Learning · Statistics 2021-06-22 Victor F. Araman , Rene Caldentey

Controlled one-dimensional diffusion processes, with infinitesimal variance (instead of the infinitesimal mean) depending on the control variable, are considered in an interval located on the positive half-line. The process is controlled…

Probability · Mathematics 2007-05-23 Mario Lefebvre

We study stochastic optimal control problems for (possibly degenerate) McKean-Vlasov controlled diffusions and obtain discrete-time as well as finite interacting particle approximations. (i) Under mild assumptions, we first prove the…

Optimization and Control · Mathematics 2025-10-27 Somnath Pradhan , Serdar Yuksel

We present a novel artificial diffusion method to circumvent the instabilities associated with the standard finite element approximation of convection-diffusion equations. Motivated by the micromorphic approach, we introduce an auxiliary…

Numerical Analysis · Mathematics 2025-06-19 Soheil Firooz , B. Daya Reddy , Paul Steinmann

In this work, we consider the numerical recovery of a spatially dependent diffusion coefficient in a subdiffusion model from distributed observations. The subdiffusion model involves a Caputo fractional derivative of order $\alpha\in(0,1)$…

Numerical Analysis · Mathematics 2021-01-12 Bangti Jin , Zhi Zhou

Feedback particle filter (FPF) is a numerical algorithm to approximate the solution of the nonlinear filtering problem in continuous-time settings. In any numerical implementation of the FPF algorithm, the main challenge is to numerically…

Optimization and Control · Mathematics 2019-10-01 Amirhossein Taghvaei , Prashant G. Mehta , Sean P. Meyn

This paper presents a space-time interface-fitted finite element method for solving a parabolic advection-diffusion problem with a nonstationary interface. The jumping diffusion coefficient gives rise to the discontinuity of the solution…

Numerical Analysis · Mathematics 2025-01-13 Quang Huy Nguyen , Van Chien Le , Phuong Cuc Hoang , Thi Thanh Mai Ta

Preservation of the maximum principle is studied for the combination of the linear finite element method in space and the $\theta$-method in time for solving time dependent anisotropic diffusion problems. It is shown that the numerical…

Numerical Analysis · Mathematics 2013-10-23 Xianping Li , Weizhang Huang

The objective in this paper is to obtain fast converging reinforcement learning algorithms to approximate solutions to the problem of discounted cost optimal stopping in an irreducible, uniformly ergodic Markov chain, evolving on a compact…

Systems and Control · Computer Science 2019-10-01 Shuhang Chen , Adithya M. Devraj , Ana Bušić , Sean P. Meyn

This paper develops a quantized Q-learning algorithm for the optimal control of controlled diffusion processes on $\mathbb{R}^d$ under both discounted and ergodic (average) cost criteria. We first establish near-optimality of finite-state…

Optimization and Control · Mathematics 2026-03-16 Erhan Bayraktar , Ali D. Kara , Somnath Pradhan , Serdar Yuksel

The standard theory of optimal stopping is based on the idealised assumption that the underlying process is essentially known. In this paper, we drop this restriction and study data-driven optimal stopping for a general diffusion process,…

Statistics Theory · Mathematics 2023-12-12 Sören Christensen , Niklas Dexheimer , Claudia Strauch

In this article, we study the optimization of resource distributions in a one-dimensional logistic diffusive model. The goal is to determine a distribution on a bounded one-dimensional domain that maximizes the total population at…

Analysis of PDEs · Mathematics 2025-11-21 Junyoung Heo , Yubin Lee