English
Related papers

Related papers: Quantifying the Impact of Non-Stationarity in Rein…

200 papers

Modeling of real-world biological multi-agents is a fundamental problem in various scientific and engineering fields. Reinforcement learning (RL) is a powerful framework to generate flexible and diverse behaviors in cyberspace; however,…

Artificial Intelligence · Computer Science 2023-12-20 Keisuke Fujii , Kazushi Tsutsui , Atom Scott , Hiroshi Nakahara , Naoya Takeishi , Yoshinobu Kawahara

When multiple agents learn in a decentralized manner, the environment appears non-stationary from the perspective of an individual agent due to the exploration and learning of the other agents. Recently proposed deep multi-agent…

Machine Learning · Computer Science 2020-06-16 Xueguang Lyu , Christopher Amato

Autonomous driving has garnered significant attention in recent years, especially in optimizing vehicle performance under varying conditions. This paper addresses the challenge of maintaining maximum speed stability in low-speed autonomous…

Artificial Intelligence · Computer Science 2024-12-30 Benny Bao-Sheng Li , Elena Wu , Hins Shao-Xuan Yang , Nicky Yao-Jin Liang

Adaptive traffic signal control (ATSC) in urban traffic networks poses a challenging task due to the complicated dynamics arising in traffic systems. In recent years, several approaches based on multi-agent deep reinforcement learning…

Multiagent Systems · Computer Science 2021-07-07 Paolo Fazzini , Marco Torre , Valeria Rizza , Francesco Petracchini

Reinforcement learning (RL) constitutes a promising solution for alleviating the problem of traffic congestion. In particular, deep RL algorithms have been shown to produce adaptive traffic signal controllers that outperform conventional…

Machine Learning · Statistics 2019-07-23 Filipe Rodrigues , Carlos Lima Azevedo

While reinforcement learning (RL) has the potential to enable robots to autonomously acquire a wide range of skills, in practice, RL usually requires manual, per-task engineering of reward functions, especially in real world settings where…

Robotics · Computer Science 2019-02-15 Tianhe Yu , Gleb Shevchuk , Dorsa Sadigh , Chelsea Finn

Urban traffic congestion presents a significant challenge for modern cities, which impacts mobility and sustainability. Traditional traffic light control systems often fail to adapt to dynamic conditions, leading to inefficiencies. This…

Machine Learning · Computer Science 2026-05-12 Matteo Cederle , Giacomo Scatto , Gian Antonio Susto

Modelling pedestrian-driver interactions is critical for understanding human road user behaviour and developing safe autonomous vehicle systems. Existing approaches often rely on rule-based logic, game-theoretic models, or 'black-box'…

Artificial Intelligence · Computer Science 2025-11-03 Yueyang Wang , Mehmet Dogar , Gustav Markkula

The issue of traffic congestion poses a significant obstacle to the development of global cities. One promising solution to tackle this problem is intelligent traffic signal control (TSC). Recently, TSC strategies leveraging reinforcement…

Human-Computer Interaction · Computer Science 2024-10-03 Yutian Zhang , Guohong Zheng , Zhiyuan Liu , Quan Li , Haipeng Zeng

Reinforcement learning (RL) using world models has found significant recent successes. However, when a sudden change to world mechanics or properties occurs then agent performance and reliability can dramatically decline. We refer to the…

Artificial Intelligence · Computer Science 2025-05-29 Geigh Zollicoffer , Kenneth Eaton , Jonathan Balloch , Julia Kim , Wei Zhou , Robert Wright , Mark O. Riedl

In reinforcement learning (RL) research, it is common to assume access to direct online interactions with the environment. However in many real-world applications, access to the environment is limited to a fixed offline dataset of logged…

Machine Learning · Computer Science 2019-11-27 Yifan Wu , George Tucker , Ofir Nachum

Online recommender systems often face long delays in receiving feedback, especially when optimizing for some long-term metrics. While mitigating the effects of delays in learning is well-understood in stationary environments, the problem…

Machine Learning · Statistics 2020-08-12 Claire Vernade , Andras Gyorgy , Timothy Mann

The growing complexity and capacity demands for mobile networks necessitate innovative techniques for optimizing resource usage. Meanwhile, recent breakthroughs have brought Reinforcement Learning (RL) into the domain of continuous control…

Networking and Internet Architecture · Computer Science 2022-10-28 Vegard Edvardsen , Gard Spreemann , Jeriek Van den Abeele

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

Multi-agent systems are prevalent in a wide range of domains including power systems, vehicular networks, and robotics. Two important problems to solve in these types of systems are how the intentions of non-coordinating agents can be…

Multiagent Systems · Computer Science 2025-09-30 Benjamin Alcorn , Eman Hammad

Training reinforcement learning (RL) agents often requires significant computational resources and prolonged training durations. To address this challenge, we build upon prior work that introduced a neural architecture with…

Machine Learning · Computer Science 2025-06-24 Junaid Muzaffar , Khubaib Ahmed , Ingo Frommholz , Zeeshan Pervez , Ahsan ul Haq

Reinforcement Learning (RL) agents typically learn memoryless policies---policies that only consider the last observation when selecting actions. Learning memoryless policies is efficient and optimal in fully observable environments.…

Offline Reinforcement Learning (RL) is structured to derive policies from static trajectory data without requiring real-time environment interactions. Recent studies have shown the feasibility of framing offline RL as a sequence modeling…

Machine Learning · Computer Science 2023-09-01 Abdelghani Ghanem , Philippe Ciblat , Mounir Ghogho

Reinforcement learning (RL) has emerged as a promising solution for addressing traffic signal control (TSC) challenges. While most RL-based TSC systems typically employ an online approach, facilitating frequent active interaction with the…

Machine Learning · Computer Science 2024-05-03 Liang Zhang , Yutong Zhang , Jianming Deng , Chen Li

Offline Reinforcement Learning (RL) enables policy learning without active interactions, making it especially appealing for self-driving tasks. Recent successes of Transformers inspire casting offline RL as sequence modeling, which,…

Machine Learning · Computer Science 2024-10-08 Zenan Li , Fan Nie , Qiao Sun , Fang Da , Hang Zhao