English
Related papers

Related papers: Decision-Making under On-Ramp merge Scenarios by D…

200 papers

We propose a multi-agent based computational framework for modeling decision-making and strategic interaction at micro level for smart vehicles in a smart world. The concepts of Markov game and best response dynamics are heavily leveraged.…

Multiagent Systems · Computer Science 2022-01-05 Qi Dai , Xunnong Xu , Wen Guo , Suzhou Huang , Dimitar Filev

During recent years, deep reinforcement learning (DRL) has made successful incursions into complex decision-making applications such as robotics, autonomous driving or video games. Off-policy algorithms tend to be more sample-efficient than…

Machine Learning · Computer Science 2021-12-06 Jesus Bujalance Martin , Raphael Chekroun , Fabien Moutarde

As an important branch of embodied artificial intelligence, mobile manipulators are increasingly applied in intelligent services, but their redundant degrees of freedom also limit efficient motion planning in cluttered environments. To…

Robotics · Computer Science 2025-04-01 Chenyu Zhang , Shiying Sun , Kuan Liu , Chuanbao Zhou , Xiaoguang Zhao , Min Tan , Yanlong Huang

Soft Actor-Critic (SAC) is widely used in practical applications and is now one of the most relevant off-policy online model-free reinforcement learning (RL) methods. The technique of n-step returns is known to increase the convergence…

Machine Learning · Computer Science 2025-12-16 Jakub Łyskawa , Jakub Lewandowski , Paweł Wawrzyński

We consider the sequential decision-making problem of making proactive request assignment and rejection decisions for a profit-maximizing operator of an autonomous mobility on demand system. We formalize this problem as a Markov decision…

Machine Learning · Computer Science 2023-05-11 Tobias Enders , James Harrison , Marco Pavone , Maximilian Schiffer

Reinforcement Learning (RL) has been widely applied to many control tasks and substantially improved the performances compared to conventional control methods in many domains where the reward function is well defined. However, for many…

Machine Learning · Computer Science 2024-03-22 Baohe Zhang , Yuan Zhang , Lilli Frison , Thomas Brox , Joschka Bödecker

Real-world applications require RL algorithms to act safely. During learning process, it is likely that the agent executes sub-optimal actions that may lead to unsafe/poor states of the system. Exploration is particularly brittle in…

Machine Learning · Statistics 2019-06-17 Elena Smirnova , Elvis Dohmatob , Jérémie Mary

This research is concerned with the novel application and investigation of `Soft Actor Critic' (SAC) based Deep Reinforcement Learning (DRL) to control the cooling setpoint (and hence cooling loads) of a large commercial building to harness…

Machine Learning · Computer Science 2021-07-08 Anjukan Kathirgamanathan , Eleni Mangina , Donal P. Finn

Soft actor-critic (SAC) is a popular algorithm for max-entropy reinforcement learning. In practice, the energy-based policies in SAC are often approximated using simple policy classes for efficiency, sacrificing the expressiveness and…

Machine Learning · Computer Science 2026-01-01 Yuyang Zhang , Yang Hu , Bo Dai , Na Li

The steady increase in the number of vehicles operating on the highways continues to exacerbate congestion, accidents, energy consumption, and greenhouse gas emissions. Emerging mobility systems, e.g., connected and automated vehicles…

Systems and Control · Electrical Eng. & Systems 2022-06-13 Sai Krishna Sumanth Nakka , Behdad Chalaki , Andreas Malikopoulos

Deploying controllers trained with Reinforcement Learning (RL) on real robots can be challenging: RL relies on agents' policies being modeled as Markov Decision Processes (MDPs), which assume an inherently discrete passage of time. The use…

Robotics · Computer Science 2024-04-03 Dong Wang , Giovanni Beltrame

Traditional Reinforcement Learning (RL) suffers from replicating human-like behaviors, generalizing effectively in multi-agent scenarios, and overcoming inherent interpretability issues.These tasks are compounded when deep environment…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Miao Zhang , Zhenlong Fang , Tianyi Wang , Qian Zhang , Shuai Lu , Junfeng Jiao , Tianyu Shi

In future intelligent transportation systems, autonomous cooperative planning (ACP), becomes a promising technique to increase the effectiveness and security of multi-vehicle interactions. However, multiple uncertainties cannot be fully…

Robotics · Computer Science 2026-04-23 Shiyao Zhang , Liwei Deng , Shuyu Zhang , Weijie Yuan , Hong Zhang

In the domain of autonomous driving, the offline Reinforcement Learning~(RL) approaches exhibit notable efficacy in addressing sequential decision-making problems from offline datasets. However, maintaining safety in diverse safety-critical…

Robotics · Computer Science 2024-03-26 Haohong Lin , Wenhao Ding , Zuxin Liu , Yaru Niu , Jiacheng Zhu , Yuming Niu , Ding Zhao

Humans make daily routine decisions based on their internal states in intricate interaction scenarios. This paper presents a probabilistically reconstructive learning approach to identify the internal states of multi-vehicle sequential…

Robotics · Computer Science 2021-08-17 Huanjie Wang , Wenshuo Wang , Shihua Yuan , Xueyuan Li

An open question in autonomous driving is how best to use simulation to validate the safety of autonomous vehicles. Existing techniques rely on simulated rollouts, which can be inefficient for finding rare failure events, while other…

Robotics · Computer Science 2020-06-29 Anthony Corso , Ritchie Lee , Mykel J. Kochenderfer

The reaction-diffusion master equation (RDME) is a model that allows for efficient on-lattice simulation of spatially resolved stochastic chemical kinetics. Compared to off-lattice hard-sphere simulations with Brownian Dynamics (BD) or…

Numerical Analysis · Mathematics 2017-09-06 Stefan Hellander , Andreas Hellander , Linda Petzold

The paper explores the application of a continuous action space soft actor-critic (SAC) reinforcement learning model to the area of automated market-making. The reinforcement learning agent receives a simulated flow of client trades, thus…

Pricing of Securities · Quantitative Finance 2020-08-28 Alexey Bakshaev

Since the advent of autonomous driving technology, it has experienced remarkable progress over the last decade. However, most existing research still struggles to address the challenges posed by environments where multiple vehicles have to…

Multiagent Systems · Computer Science 2025-08-01 Jing Wang , Yan Jin , Fei Ding , Chongfeng Wei

Soft actor-critic (SAC) in reinforcement learning is expected to be one of the next-generation robot control schemes. Its ability to maximize policy entropy would make a robotic controller robust to noise and perturbation, which is useful…

Machine Learning · Computer Science 2023-07-04 Taisuke Kobayashi