English
Related papers

Related papers: Augmenting Reinforcement Learning with Transformer…

200 papers

Efficient traffic signal control is essential for managing urban transportation, minimizing congestion, and improving safety and sustainability. Reinforcement Learning (RL) has emerged as a promising approach to enhancing adaptive traffic…

Machine Learning · Computer Science 2024-09-18 Xiaoyu Wang , Ayal Taitler , Scott Sanner , Baher Abdulhai

The problem with existing camera-based Deep Reinforcement Learning approaches is twofold: they rarely integrate high-level scene context into the feature representation, and they rely on rigid, fixed reward functions. To address these…

Robotics · Computer Science 2026-02-06 Vinal Asodia , Iman Sharifi , Saber Fallah

The issue of traffic congestion poses a significant obstacle to the development of global cities. One promising solution to tackle this problem is intelligent traffic signal control (TSC). Recently, TSC strategies leveraging reinforcement…

Human-Computer Interaction · Computer Science 2024-10-03 Yutian Zhang , Guohong Zheng , Zhiyuan Liu , Quan Li , Haipeng Zeng

Deep reinforcement learning (RL) algorithms can use high-capacity deep networks to learn directly from image observations. However, these high-dimensional observation spaces present a number of challenges in practice, since the policy must…

Machine Learning · Computer Science 2020-10-27 Alex X. Lee , Anusha Nagabandi , Pieter Abbeel , Sergey Levine

We present an approach for reconfiguration of dynamic visual sensor networks with deep reinforcement learning (RL). Our RL agent uses a modified asynchronous advantage actor-critic framework and the recently proposed Relational Network…

Machine Learning · Computer Science 2018-08-14 Paul Jasek , Bernard Abayowa

Predicting motion of surrounding agents is critical to real-world applications of tactical path planning for autonomous driving. Due to the complex temporal dependencies and social interactions of agents, on-line trajectory prediction is a…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Jingwen Zhao , Xuanpeng Li , Qifan Xue , Weigong Zhang

For autonomous vehicles, effective behavior planning is crucial to ensure safety of the ego car. In many urban scenarios, it is hard to create sufficiently general heuristic rules, especially for challenging scenarios that some new human…

Robotics · Computer Science 2020-11-11 Zhiqian Qiao , Jeff Schneider , John M. Dolan

The transformer architecture and variants presented remarkable success across many machine learning tasks in recent years. This success is intrinsically related to the capability of handling long sequences and the presence of…

Machine Learning · Computer Science 2022-06-15 Luckeciano C. Melo

Transformer-based models have demonstrated their effectiveness in automatic speech recognition (ASR) tasks and even shown superior performance over the conventional hybrid framework. The main idea of Transformers is to capture the…

Sound · Computer Science 2022-07-05 Kun Wei , Pengcheng Guo , Ning Jiang

This paper proposes a self-regularised minimum latency training (SR-MLT) method for streaming Transformer-based automatic speech recognition (ASR) systems. In previous works, latency was optimised by truncating the online attention weights…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-25 Mohan Li , Rama Doddipatla , Catalin Zorila

Lane change decision-making is a complex task due to intricate vehicle-vehicle and vehicle-infrastructure interactions. Existing algorithms for lane-change control often depend on vehicles with a certain level of autonomy (e.g., autonomous…

Systems and Control · Electrical Eng. & Systems 2024-12-09 Ke Sun , Huan Yu

Traffic signal control aims to coordinate traffic signals across intersections to improve the traffic efficiency of a district or a city. Deep reinforcement learning (RL) has been applied to traffic signal control recently and demonstrated…

Machine Learning · Computer Science 2024-04-02 Liwen Zhu , Peixi Peng , Zongqing Lu , Xiangqian Wang , Yonghong Tian

Reinforcement learning (RL) algorithms find applications in inventory control, recommender systems, vehicular traffic management, cloud computing and robotics. The real-world complications of many tasks arising in these domains makes them…

Machine Learning · Computer Science 2021-06-03 Sindhu Padakandla

Deep reinforcement learning (RL) has recently led to many breakthroughs on a range of complex control tasks. However, the agent's decision-making process is generally not transparent. The lack of interpretability hinders the applicability…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Wenjie Shi , Gao Huang , Shiji Song , Zhuoyuan Wang , Tingyu Lin , Cheng Wu

The Scene Representation Transformer (SRT) is a recent method to render novel views at interactive rates. Since SRT uses camera poses with respect to an arbitrarily chosen reference camera, it is not invariant to the order of the input…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Aleksandr Safin , Daniel Duckworth , Mehdi S. M. Sajjadi

Motion planning framed as optimisation in structured latent spaces has recently emerged as competitive with traditional methods in terms of planning success while significantly outperforming them in terms of computational speed. However,…

Robotics · Computer Science 2023-03-07 Jun Yamada , Chia-Man Hung , Jack Collins , Ioannis Havoutis , Ingmar Posner

Realistic and interactive traffic simulation is essential for training and evaluating autonomous driving systems. However, most existing data-driven simulation methods rely on static initialization or log-replay data, limiting their ability…

Robotics · Computer Science 2026-03-04 Zhenghao Peng , Yuxin Liu , Bolei Zhou

In autonomous driving, end-to-end planners directly utilize raw sensor data, enabling them to extract richer scene features and reduce information loss compared to traditional planners. This raises a crucial research question: how can we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Yingyan Li , Lue Fan , Jiawei He , Yuqi Wang , Yuntao Chen , Zhaoxiang Zhang , Tieniu Tan

Autonomous spacecraft control for mission phases such as launch, ascent, stage separation, and orbit insertion remains a critical challenge due to the need for adaptive policies that generalize across dynamically distinct regimes. While…

Machine Learning · Computer Science 2025-11-17 Amit Jain , Victor Rodriguez-Fernandez , Richard Linares

When autonomous vehicles are deployed on public roads, they will encounter countless and diverse driving situations. Many manually designed driving policies are difficult to scale to the real world. Fortunately, reinforcement learning has…

Robotics · Computer Science 2023-05-09 Letian Wang , Jie Liu , Hao Shao , Wenshuo Wang , Ruobing Chen , Yu Liu , Steven L. Waslander