English
Related papers

Related papers: DyPNIPP: Predicting Environment Dynamics for RL-ba…

200 papers

In this paper, we present a novel guidance scheme based on model-based deep reinforcement learning (RL) technique. With model-based deep RL method, a deep neural network is trained as a predictive model of guidance dynamics which is…

Robotics · Computer Science 2019-04-16 Chen Liang , Weihong Wang , Zhenghua Liu , Chao Lai , Benchun Zhou

The need for efficient monitoring of spatio-temporal dynamics in large environmental applications, such as the water quality monitoring in rivers and lakes, motivates the use of robotic sensors in order to achieve sufficient spatial…

Robotics · Computer Science 2014-01-16 Amarjeet Singh , Andreas Krause , Carlos Guestrin , William J. Kaiser

In this paper, a deep reinforcement learning (DRL) method is proposed to address the problem of UAV navigation in an unknown environment. However, DRL algorithms are limited by the data efficiency problem as they typically require a huge…

Robotics · Computer Science 2020-08-07 Lei He , Nabil Aouf , James F. Whidborne , Bifeng Song

Autonomous navigation guided by natural language instructions is essential for improving human-robot interaction and enabling complex operations in dynamic environments. While large language models (LLMs) are not inherently designed for…

Robotics · Computer Science 2024-12-04 Pranav Doma , Aliasghar Arab , Xuesu Xiao

Coverage path planning (CPP) is the problem of finding a path that covers the entire free space of a confined area, with applications ranging from robotic lawn mowing to search-and-rescue. While for known environments, offline methods can…

Robotics · Computer Science 2025-08-26 Arvi Jonnarth , Ola Johansson , Jie Zhao , Michael Felsberg

Long-range navigation is commonly addressed through hierarchical pipelines in which a global planner generates a path, decomposed into waypoints, and followed sequentially by a local planner. These systems are sensitive to global path…

Robotics · Computer Science 2026-03-17 Mateo Haro , Julia Richter , Fan Yang , Cesar Cadena , Marco Hutter

Traditionally, prediction and planning in autonomous driving (AD) have been treated as separate, sequential modules. Recently, there has been a growing shift towards tighter integration of these components, known as Integrated Prediction…

Two common approaches to sequential decision-making are AI planning (AIP) and reinforcement learning (RL). Each has strengths and weaknesses. AIP is interpretable, easy to integrate with symbolic knowledge, and often efficient, but requires…

Artificial Intelligence · Computer Science 2022-09-30 Junkyu Lee , Michael Katz , Don Joven Agravante , Miao Liu , Geraud Nangue Tasse , Tim Klinger , Shirin Sohrabi

Robots are extending their presence in domestic environments every day, being more common to see them carrying out tasks in home scenarios. In the future, robots are expected to increasingly perform more complex tasks and, therefore, be…

Artificial Intelligence · Computer Science 2020-09-22 Ithan Moreira , Javier Rivas , Francisco Cruz , Richard Dazeley , Angel Ayala , Bruno Fernandes

In a conventional supervised learning setting, a machine learning model has access to examples of all object classes that are desired to be recognized during the inference stage. This results in a fixed model that lacks the flexibility to…

Computer Vision and Pattern Recognition · Computer Science 2020-01-27 Jathushan Rajasegaran , Munawar Hayat , Salman Khan , Fahad Shahbaz Khan , Ling Shao , Ming-Hsuan Yang

This paper tackles the task of goal-conditioned dynamic manipulation of deformable objects. This task is highly challenging due to its complex dynamics (introduced by object deformation and high-speed action) and strict task requirements…

Robotics · Computer Science 2022-04-25 Cheng Chi , Benjamin Burchfiel , Eric Cousineau , Siyuan Feng , Shuran Song

The growing demand for parking has increased the need for automated parking planning methods that can operate reliably in confined spaces. In restricted and complex environments, high-precision maneuvers are required to achieve a high…

Robotics · Computer Science 2025-10-17 Mingyang Jiang , Yueyuan Li , Jiaru Zhang , Songan Zhang , Ming Yang

Robust planning in interactive scenarios requires predicting the uncertain future to make risk-aware decisions. Unfortunately, due to long-tail safety-critical events, the risk is often under-estimated by finite-sampling approximations of…

Machine Learning · Computer Science 2023-01-13 Haruki Nishimura , Jean Mercat , Blake Wulfe , Rowan McAllister , Adrien Gaidon

Data preparation is a foundational yet notoriously challenging component of the machine learning lifecycle, characterized by a vast combinatorial search space. While reinforcement learning (RL) offers a promising direction, state-of-the-art…

Databases · Computer Science 2025-07-29 Jing Chang , Chang Liu , Jinbin Huang , Shuyuan Zheng , Rui Mao , Jianbin Qin

Imitation learning (IL) has achieved considerable success in solving complex sequential decision-making problems. However, current IL methods mainly assume that the environment for learning policies is the same as the environment for…

Machine Learning · Computer Science 2023-10-24 Siyuan Li , Xun Wang , Rongchang Zuo , Kewu Sun , Lingfei Cui , Jishiyu Ding , Peng Liu , Zhe Ma

Computing kinodynamically feasible motion plans and repairing them on-the-fly as the environment changes is a challenging, yet relevant problem in robot-navigation. We propose a novel online single-query sampling-based motion re-planning…

Robotics · Computer Science 2024-06-14 Mohamed Khalid M Jaffar , Michael Otte

Model-based reinforcement learning (RL) is anticipated to exhibit higher sample efficiency compared to model-free RL by utilizing a virtual environment model. However, it is challenging to obtain sufficiently accurate representations of the…

Artificial Intelligence · Computer Science 2026-01-19 Zihao Sheng , Zilin Huang , Sikai Chen

Reinforcement learning (RL) approaches based on Markov Decision Processes (MDPs) are predominantly applied in the robot joint space, often relying on limited task-specific information and partial awareness of the 3D environment. In…

Robotics · Computer Science 2026-03-09 Bingkun Huang , Yuhe Gong , Zewen Yang , Tianyu Ren , Luis Figueredo

Accurate prediction is important for operating an autonomous vehicle in interactive scenarios. Prediction must be fast, to support multiple requests from a planner exploring a range of possible futures. The generated predictions must…

Robotics · Computer Science 2023-08-11 Anthony Knittel , Majd Hawasly , Stefano V. Albrecht , John Redford , Subramanian Ramamoorthy

Domain-Independent Dynamic Programming (DIDP) is a state-space search paradigm based on dynamic programming for combinatorial optimization. In its current implementation, DIDP guides the search using user-defined dual bounds. Reinforcement…

Artificial Intelligence · Computer Science 2025-05-15 Minori Narita , Ryo Kuroiwa , J. Christopher Beck