English
Related papers

Related papers: Data-Efficient Policy Selection for Navigation in …

200 papers

Mastering deep reinforcement learning (DRL) proves challenging in tasks featuring scant rewards. These limited rewards merely signify whether the task is partially or entirely accomplished, necessitating various exploration actions before…

Machine Learning · Computer Science 2024-04-11 Guojian Wang , Faguo Wu , Xiao Zhang

Robotic agents must master common sense and long-term sequential decisions to solve daily tasks through natural language instruction. The developments in Large Language Models (LLMs) in natural language processing have inspired efforts to…

Robotics · Computer Science 2024-09-16 Yaran Chen , Wenbo Cui , Yuanwen Chen , Mining Tan , Xinyao Zhang , Dongbin Zhao , He Wang

Long-range navigation is commonly addressed through hierarchical pipelines in which a global planner generates a path, decomposed into waypoints, and followed sequentially by a local planner. These systems are sensitive to global path…

Robotics · Computer Science 2026-03-17 Mateo Haro , Julia Richter , Fan Yang , Cesar Cadena , Marco Hutter

In this paper, we consider a transfer reinforcement learning problem involving agents with different action spaces. Specifically, for any new unseen task, the goal is to use a successful demonstration of this task by an expert agent in its…

Machine Learning · Computer Science 2024-10-21 Kavinayan P. Sivakumar , Yan Zhang , Zachary Bell , Scott Nivison , Michael M. Zavlanos

First-order Policy Gradient (FoPG) algorithms such as Backpropagation through Time and Analytical Policy Gradients leverage local simulation physics to accelerate policy search, significantly improving sample efficiency in robot control…

Robotics · Computer Science 2024-10-07 Jing Yuan Luo , Yunlong Song , Victor Klemm , Fan Shi , Davide Scaramuzza , Marco Hutter

Enabling robots to autonomously navigate complex environments is essential for real-world deployment. Prior methods approach this problem by having the robot maintain an internal map of the world, and then use a localization and planning…

Machine Learning · Computer Science 2018-05-21 Gregory Kahn , Adam Villaflor , Bosen Ding , Pieter Abbeel , Sergey Levine

Despite recent progress improving the efficiency and quality of motion planning, planning collision-free and dynamically-feasible trajectories in partially-mapped environments remains challenging, since constantly replanning as unseen…

Robotics · Computer Science 2023-06-16 Abhish Khanal , Hoang-Dung Bui , Gregory J. Stein , Erion Plaku

Most of the existing works for reinforcement learning (RL) with general function approximation (FA) focus on understanding the statistical complexity or regret bounds. However, the computation complexity of such approaches is far from being…

Machine Learning · Computer Science 2023-04-19 Dingwen Kong , Ruslan Salakhutdinov , Ruosong Wang , Lin F. Yang

Offline reinforcement learning (RL) can be used to improve future performance by leveraging historical data. There exist many different algorithms for offline RL, and it is well recognized that these algorithms, and their hyperparameter…

Machine Learning · Computer Science 2023-01-18 Allen Nie , Yannis Flet-Berliac , Deon R. Jordan , William Steenbergen , Emma Brunskill

Off-policy evaluation estimates how a target policy would perform using data collected by a different behavior policy, which is crucial when online testing is costly or risky, such as in recommendation or healthcare. Standard importance…

Machine Learning · Computer Science 2026-05-29 Ziwen Xie , Shaowen Xiang , Hongyu He , Dianbo Liu

Reinforcement learning (RL) has emerged as a promising strategy for finetuning small language models (SLMs) to solve targeted tasks such as math and coding. However, RL algorithms tend to be resource-intensive, taking a significant amount…

Machine Learning · Computer Science 2025-10-07 Lianghuan Huang , Sagnik Anupam , Insup Lee , Shuo Li , Osbert Bastani

Integrating artificial intelligence (AI) into sampling-based motion planning provides new possibilities for improving autonomous navigation efficiency. In this paper, three algorithms, namely RRT*, Neural RRT*, and Neural Informed RRT*, are…

Robotics · Computer Science 2026-05-28 Hichem Cheriet , Badra Khellat Kihel , Samira Chouraqui

We present an end-to-end imitation learning system for agile, off-road autonomous driving using only low-cost sensors. By imitating a model predictive controller equipped with advanced sensors, we train a deep neural network control policy…

Robotics · Computer Science 2019-08-12 Yunpeng Pan , Ching-An Cheng , Kamil Saigol , Keuntaek Lee , Xinyan Yan , Evangelos Theodorou , Byron Boots

Offline policy improvement faces an inherent conflict between maximizing value and fitting the data distribution. While in-sample weighted regression is stable, it suffers from over-conservatism that suppresses high-value actions in the…

Machine Learning · Computer Science 2026-05-28 Jiaxin Zhao , Weihang Pan , Xun Liang , Binbin Lin

We propose a multi-time-scale predictive representation learning method to efficiently learn robust driving policies in an offline manner that generalize well to novel road geometries, and damaged and distracting lane conditions which are…

Robotics · Computer Science 2021-03-16 Daniel Graves , Nhat M. Nguyen , Kimia Hassanzadeh , Jun Jin , Jun Luo

Reinforcement learning in partially observable domains is challenging due to the lack of observable state information. Thankfully, learning offline in a simulator with such state information is often possible. In particular, we propose a…

Robotics · Computer Science 2022-11-11 Hai Nguyen , Andrea Baisero , Dian Wang , Christopher Amato , Robert Platt

In some applications of reinforcement learning, a dataset of pre-collected experience is already available but it is also possible to acquire some additional online data to help improve the quality of the policy. However, it may be…

Machine Learning · Computer Science 2023-07-11 Ruiqi Zhang , Andrea Zanette

As trajectories sampled by policies used by reinforcement learning (RL) and generative flow networks (GFlowNets) grow longer, credit assignment and exploration become more challenging, and the long planning horizon hinders mode discovery…

Policies developed through Reinforcement Learning (RL) and Imitation Learning (IL) have shown great potential in continuous control tasks, but real-world applications often require adapting trained policies to unforeseen requirements. While…

Robotics · Computer Science 2025-03-17 Pengcheng Wang , Chenran Li , Catherine Weaver , Kenta Kawamoto , Masayoshi Tomizuka , Chen Tang , Wei Zhan

In many domains of empirical sciences, discovering the causal structure within variables remains an indispensable task. Recently, to tackle with unoriented edges or latent assumptions violation suffered by conventional methods, researchers…

Machine Learning · Computer Science 2024-12-30 Shixuan Liu , Yanghe Feng , Keyu Wu , Guangquan Cheng , Jincai Huang , Zhong Liu