English
Related papers

Related papers: Efficient Planning in a Compact Latent Action Spac…

200 papers

Reinforcement Learning (RL) offers a promising framework for autonomous driving by enabling agents to learn control policies through interaction with environments. However, large and high-dimensional action spaces often used to support…

Robotics · Computer Science 2025-07-08 Elahe Delavari , Feeza Khan Khanzada , Jaerock Kwon

Supervised learning approaches to offline reinforcement learning, particularly those utilizing the Decision Transformer, have shown effectiveness in continuous environments and for sparse rewards. However, they often struggle with…

Machine Learning · Computer Science 2024-09-17 Joseph Clinton , Robert Lieck

An effective approach to solving long-horizon tasks in robotics domains with continuous state and action spaces is bilevel planning, wherein a high-level search over an abstraction of an environment is used to guide low-level…

Artificial Intelligence · Computer Science 2023-09-06 Nishanth Kumar , Willie McClinton , Rohan Chitnis , Tom Silver , Tomás Lozano-Pérez , Leslie Pack Kaelbling

In this paper, we present an approach for integrated task and motion planning based on an AND/OR graph network, which is used to represent task-level states and actions, and we leverage it to implement different classes of task and motion…

Robotics · Computer Science 2025-03-12 Hossein Karami , Antony Thomas , Fulvio Mastrogiovanni

Reinforcement Learning methods are capable of solving complex problems, but resulting policies might perform poorly in environments that are even slightly different. In robotics especially, training and deployment conditions often vary and…

Machine Learning · Computer Science 2018-09-17 Isac Arnekvist , Danica Kragic , Johannes A. Stork

Scalable multi-agent driving simulation requires behavior models that are both realistic and computationally efficient. We address this by optimizing the behavior model that controls individual traffic participants. To improve efficiency,…

Robotics · Computer Science 2026-04-15 Fabian Konstantinidis , Moritz Sackmann , Ulrich Hofmann , Christoph Stiller

Vision-Language-Action (VLA) models have emerged as a promising paradigm for building embodied agents that ground perception and language into action. However, most existing approaches rely on direct action prediction, lacking the ability…

Robotics · Computer Science 2026-04-21 Runze Li , Hongyin Zhang , Junxi Jin , Qixin Zeng , Zifeng Zhuang , Yiqi Tang , Shangke Lyu , Donglin Wang

Offline reinforcement learning methods hold the promise of learning policies from pre-collected datasets without the need to query the environment for new transitions. This setting is particularly well-suited for continuous control robotic…

Machine Learning · Computer Science 2022-03-18 Xi Chen , Ali Ghadirzadeh , Tianhe Yu , Yuan Gao , Jianhao Wang , Wenzhe Li , Bin Liang , Chelsea Finn , Chongjie Zhang

Planning - the ability to analyze the structure of a problem in the large and decompose it into interrelated subproblems - is a hallmark of human intelligence. While deep reinforcement learning (RL) has shown great promise for solving…

Artificial Intelligence · Computer Science 2021-07-02 Lunjun Zhang , Ge Yang , Bradly C. Stadie

The objective of lifelong reinforcement learning (RL) is to optimize agents which can continuously adapt and interact in changing environments. However, current RL approaches fail drastically when environments are non-stationary and…

Machine Learning · Computer Science 2021-06-17 Kevin Lu , Aditya Grover , Pieter Abbeel , Igor Mordatch

Solving robotic navigation tasks via reinforcement learning (RL) is challenging due to their sparse reward and long decision horizon nature. However, in many navigation tasks, high-level (HL) task representations, like a rough floor plan,…

Robotics · Computer Science 2021-11-08 Jan Wöhlke , Felix Schmitt , Herke van Hoof

In this paper, we propose using deep neural architectures (i.e., vision transformers and ResNet) as heuristics for sequential decision-making in robotic manipulation problems. This formulation enables predicting the subset of objects that…

Robotics · Computer Science 2023-08-02 Hongyou Zhou , Ingmar Schubert , Marc Toussaint , Ozgur S. Oguz

Optimal action selection in decision problems characterized by sparse, delayed rewards is still an open challenge. For these problems, current deep reinforcement learning methods require enormous amounts of data to learn controllers that…

Artificial Intelligence · Computer Science 2018-06-18 Miquel Junyent , Anders Jonsson , Vicenç Gómez

Mobile robots are often tasked with repeatedly navigating through an environment whose traversability changes over time. These changes may exhibit some hidden structure, which can be learned. Many studies consider reactive algorithms for…

Robotics · Computer Science 2020-12-07 Florence Tsang , Tristan Walker , Ryan A. MacDonald , Armin Sadeghi , Stephen L. Smith

When autonomous vehicles are deployed on public roads, they will encounter countless and diverse driving situations. Many manually designed driving policies are difficult to scale to the real world. Fortunately, reinforcement learning has…

Robotics · Computer Science 2023-05-09 Letian Wang , Jie Liu , Hao Shao , Wenshuo Wang , Ruobing Chen , Yu Liu , Steven L. Waslander

Urban air mobility is the new mode of transportation aiming to provide a fast and secure way of travel by utilizing the low-altitude airspace. This goal cannot be achieved without the implementation of new flight regulations which can…

Robotics · Computer Science 2023-01-25 Asal Mehditabrizi , Mahdi Samadzad , Sina Sabzekar

End-to-end autonomous driving systems powered by Vision-Language-Action (VLA) models achieve strong performance on common driving scenarios, yet remain brittle in rare but safety-critical long-tail situations such as active construction…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Ruiyang Zhu , Yuehan He , Boyuan Zheng , Zesen Zhao , Ahmad Chalhoub , Qingzhao Zhang , Z. Morley Mao

Reinforcement learning (RL), with its ability to explore and optimize policies in complex, dynamic decision-making tasks, has emerged as a promising approach to addressing motion planning (MoP) challenges in autonomous driving (AD). Despite…

Machine Learning · Computer Science 2025-04-01 Zhuoren Li , Guizhe Jin , Ran Yu , Zhiwen Chen , Nan Li , Wei Han , Lu Xiong , Bo Leng , Jia Hu , Ilya Kolmanovsky , Dimitar Filev

Fast and efficient sampling-based motion planning (SMP) is an integral component of many robotic systems, such as autonomous cars. A popular technique to improve the efficiency of these planners is to restrict search space in the planning…

Robotics · Computer Science 2022-11-15 Jacob J. Johnson , Uday S. Kalra , Ankit Bhatia , Linjun Li , Ahmed H. Qureshi , Michael C. Yip

Task and motion planning is one of the key problems in robotics today. It is often formulated as a discrete task allocation problem combined with continuous motion planning. Many existing approaches to TAMP involve explicit descriptions of…

Robotics · Computer Science 2023-09-28 Jimmy Envall , Roi Poranne , Stelian Coros