English
Related papers

Related papers: Learning to Stop: Deep Learning for Mean Field Opt…

200 papers

Distribution Regression on path-space refers to the task of learning functions mapping the law of a stochastic process to a scalar target. The learning procedure based on the notion of path-signature, i.e. a classical transform from rough…

Probability · Mathematics 2023-04-05 Blanka Horvath , Maud Lemercier , Chong Liu , Terry Lyons , Cristopher Salvi

A method based on deep artificial neural networks and empirical risk minimization is developed to calculate the boundary separating the stopping and continuation regions in optimal stopping. The algorithm parameterizes the stopping boundary…

Pricing of Securities · Quantitative Finance 2023-05-26 A. Max Reppen , H. Mete Soner , Valentin Tissot-Daguette

Nowadays many financial derivatives, such as American or Bermudan options, are of early exercise type. Often the pricing of early exercise options gives rise to high-dimensional optimal stopping problems, since the dimension corresponds to…

Computational Engineering, Finance, and Science · Computer Science 2021-08-10 Sebastian Becker , Patrick Cheridito , Arnulf Jentzen , Timo Welti

Deep Neural Networks (DNNs) approaches for the Optimal Power Flow (OPF) problem received considerable attention recently. A key challenge of these approaches lies in ensuring the feasibility of the predicted solutions to physical system…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Tianyu Zhao , Xiang Pan , Minghua Chen , Andreas Venzke , Steven H. Low

In distributed model predictive control (DMPC), where a centralized optimization problem is solved in distributed fashion using dual decomposition, it is important to keep the number of iterations in the solution algorithm, i.e. the amount…

Optimization and Control · Mathematics 2013-07-11 Pontus Giselsson , Anders Rantzer

We introduce the concept of {\it mean-field optimal control} which is the rigorous limit process connecting finite dimensional optimal control problems with ODE constraints modeling multi-agent interactions to an infinite dimensional…

Optimization and Control · Mathematics 2019-02-20 Massimo Fornasier , Francesco Solombrino

Multi-agent pathfinding (MAPF) is the problem of finding a set of conflict-free paths for a set of agents. Typically, the agents' moves are limited to a pre-defined graph of possible locations and allowed transitions between them, e.g. a…

Artificial Intelligence · Computer Science 2024-09-02 Konstantin Yakovlev , Anton Andreychuk , Roni Stern

The incorporation of macro-actions (temporally extended actions) into multi-agent decision problems has the potential to address the curse of dimensionality associated with such decision problems. Since macro-actions last for stochastic…

Artificial Intelligence · Computer Science 2019-05-30 Kunal Menda , Yi-Chun Chen , Justin Grana , James W. Bono , Brendan D. Tracey , Mykel J. Kochenderfer , David Wolpert

This study proposes an end-to-end framework for solving multi-objective optimization problems (MOPs) using Deep Reinforcement Learning (DRL), that we call DRL-MOA. The idea of decomposition is adopted to decompose the MOP into a set of…

Neural and Evolutionary Computing · Computer Science 2020-04-28 Kaiwen Li , Tao Zhang , Rui Wang

We study automated intrusion prevention using reinforcement learning. Following a novel approach, we formulate the problem of intrusion prevention as an (optimal) multiple stopping problem. This formulation gives us insight into the…

Machine Learning · Computer Science 2024-04-23 Kim Hammar , Rolf Stadler

The paper focuses on mean-field type multi-agent control problems with finite state and action spaces where the dynamics and cost structures are symmetric and homogeneous, and are affected by the distribution of the agents. A standard…

Optimization and Control · Mathematics 2025-07-03 Erhan Bayraktar , Ali D. Kara

With the expansion of the scale of robotics applications, the multi-goal multi-agent pathfinding (MG-MAPF) problem began to gain widespread attention. This problem requires each agent to visit pre-assigned multiple goal points at least once…

Multiagent Systems · Computer Science 2024-05-01 Mingkai Tang , Yuanhang Li , Hongji Liu , Yingbing Chen , Ming Liu , Lujia Wang

We initiate the study of dynamic regret minimization for goal-oriented reinforcement learning modeled by a non-stationary stochastic shortest path problem with changing cost and transition functions. We start by establishing a lower bound…

Machine Learning · Computer Science 2022-05-27 Liyu Chen , Haipeng Luo

In multi-agent safety-critical scenarios, traditional autonomous driving frameworks face significant challenges in balancing safety constraints and task performance. These frameworks struggle to quantify dynamic interaction risks in…

Robotics · Computer Science 2025-04-10 Kaifeng Wang , Yinsong Chen , Qi Liu , Xueyuan Li , Xin Gao

Learning in general-sum games often yields collectively sub-optimal results. Addressing this, opponent shaping (OS) methods actively guide the learning processes of other agents, empirically leading to improved individual and group…

Machine Learning · Computer Science 2024-02-09 Kitty Fung , Qizhen Zhang , Chris Lu , Jia Wan , Timon Willi , Jakob Foerster

Autonomous driving is a multi-agent setting where the host vehicle must apply sophisticated negotiation skills with other road users when overtaking, giving way, merging, taking left and right turns and while pushing ahead in unstructured…

Artificial Intelligence · Computer Science 2016-10-12 Shai Shalev-Shwartz , Shaked Shammah , Amnon Shashua

Recent advances in deep learning has witnessed many innovative frameworks that solve high dimensional mean-field games (MFG) accurately and efficiently. These methods, however, are restricted to solving single-instance MFG and demands…

Machine Learning · Computer Science 2024-04-25 Han Huang , Rongjie Lai

We study infinite horizon discounted Mean Field Control (MFC) problems with common noise through the lens of Mean Field Markov Decision Processes (MFMDP). We allow the agents to use actions that are randomized not only at the individual…

Optimization and Control · Mathematics 2021-10-14 René Carmona , Mathieu Laurière , Zongjun Tan

In this paper a deep reinforcement based multi-agent path planning approach is introduced. The experiments are realized in a simulation environment and in this environment different multi-agent path planning problems are produced. The…

Machine Learning · Computer Science 2021-10-05 Mert Çetinkaya

Co-optimizing safety and performance in large-scale multi-agent systems remains a fundamental challenge. Existing approaches based on multi-agent reinforcement learning (MARL), safety filtering, or Model Predictive Control (MPC) either lack…

Robotics · Computer Science 2025-09-30 Manan Tayal , Aditya Singh , Shishir Kolathaya , Somil Bansal