English
Related papers

Related papers: HEADER: Hierarchical Robot Exploration via Attenti…

200 papers

In multi-robot collaborative area search, a key challenge is to dynamically balance the two objectives of exploring unknown areas and covering specific targets to be rescued. Existing methods are often constrained by homogeneous graph…

Robotics · Computer Science 2026-01-08 Lina Zhu , Jiyu Cheng , Yuehu Liu , Wei Zhang

In this paper, we propose a novel hierarchical framework for robot navigation in dynamic environments with heterogeneous constraints. Our approach leverages a graph neural network trained via reinforcement learning (RL) to efficiently…

Robotics · Computer Science 2025-07-24 Huajian Liu , Yixuan Feng , Wei Dong , Kunpeng Fan , Chao Wang , Yongzhuo Gao

Hierarchical reinforcement learning (HRL) improves the efficiency of long-horizon reinforcement-learning tasks with sparse rewards by decomposing the task into a hierarchy of subgoals. The main challenge of HRL is efficient discovery of the…

Machine Learning · Computer Science 2025-07-08 Sadegh Khorasani , Saber Salehkaleybar , Negar Kiyavash , Matthias Grossglauser

Graph neural network, as a powerful graph representation technique based on deep learning, has shown superior performance and attracted considerable research interest. However, it has not been fully considered in graph neural network for…

Social and Information Networks · Computer Science 2021-01-21 Xiao Wang , Houye Ji , Chuan Shi , Bai Wang , Peng Cui , P. Yu , Yanfang Ye

In reinforcement learning, pre-trained low-level skills have the potential to greatly facilitate exploration. However, prior knowledge of the downstream task is required to strike the right balance between generality (fine-grained control)…

Machine Learning · Computer Science 2021-10-22 Jonas Gehring , Gabriel Synnaeve , Andreas Krause , Nicolas Usunier

Recent advances in large language models have shown that autoregressive modeling can generate complex and novel sequences that have many real-world applications. However, these models must generate outputs autoregressively, which becomes…

Machine Learning · Computer Science 2023-06-05 Asier Mujika

Continual lifelong learning is an machine learning framework inspired by human learning, where learners are trained to continuously acquire new knowledge in a sequential manner. However, the non-stationary nature of streaming training data…

Machine Learning · Computer Science 2024-05-14 Xingyu Li , Bo Tang , Haifeng Li

Goal-oriented reinforcement learning has recently been a practical framework for robotic manipulation tasks, in which an agent is required to reach a certain goal defined by a function on the state space. However, the sparsity of such…

Machine Learning · Computer Science 2019-12-19 Zhizhou Ren , Kefan Dong , Yuan Zhou , Qiang Liu , Jian Peng

Cognitive Psychology and related disciplines have identified several critical mechanisms that enable intelligent biological agents to learn to solve complex problems. There exists pressing evidence that the cognitive mechanisms that enable…

Artificial Intelligence · Computer Science 2022-08-19 Manfred Eppe , Christian Gumbsch , Matthias Kerzel , Phuong D. H. Nguyen , Martin V. Butz , Stefan Wermter

In this work, we propose an attention-based deep reinforcement learning approach to address the adaptive informative path planning (IPP) problem in 3D space, where an aerial robot equipped with a downward-facing sensor must dynamically…

Robotics · Computer Science 2025-06-11 Rui Zhao , Xingjian Zhang , Yuhong Cao , Yizhuo Wang , Guillaume Sartoretti

Effective exploration continues to be a significant challenge that prevents the deployment of reinforcement learning for many physical systems. This is particularly true for systems with continuous and high-dimensional state and action…

Machine Learning · Computer Science 2022-07-21 Trevor Ablett , Bryan Chan , Jonathan Kelly

In the realm of heterogeneous mixed autonomy, vehicles experience dynamic spatial correlations and nonlinear temporal interactions in a complex, non-Euclidean space. These complexities pose significant challenges to traditional…

Multiagent Systems · Computer Science 2024-08-19 Xin Gao , Zhaoyang Ma , Xueyuan Li , Xiaoqiang Meng , Zirui Li

Decision-making AI agents are often faced with two important challenges: the depth of the planning horizon, and the branching factor due to having many choices. Hierarchical reinforcement learning methods aim to solve the first problem, by…

Machine Learning · Computer Science 2022-01-25 Andrei Nica , Khimya Khetarpal , Doina Precup

Autonomous robot exploration requires a robot to efficiently explore and map unknown environments. Compared to conventional methods that can only optimize paths based on the current robot belief, learning-based methods show the potential to…

Robotics · Computer Science 2024-10-23 Yuhong Cao , Jeric Lew , Jingsong Liang , Jin Cheng , Guillaume Sartoretti

Object packing by autonomous robots is an im-portant challenge in warehouses and logistics industry. Most conventional data-driven packing planning approaches focus on regular cuboid packing, which are usually heuristic and limit the…

Robotics · Computer Science 2022-11-18 Sichao Huang , Ziwei Wang , Jie Zhou , Jiwen Lu

Depth information which specifies the distance between objects and current position of the robot is essential for many robot tasks such as navigation. Recently, researchers have proposed depth completion frameworks to provide dense depth…

Robotics · Computer Science 2025-07-22 Kevin Christiansen Marsim , Jinwoo Jeon , Yeeun Kim , Myeongwoo Jeong , Hyun Myung

Inferential decision-making algorithms typically assume that an underlying probabilistic model of decision alternatives and outcomes may be learned a priori or online. Furthermore, when applied to robots in real-world settings they often…

Robotics · Computer Science 2023-09-15 Yucheng Chen , Pingping Zhu , Anthony Alers , Tobias Egner , Marc A. Sommer , Silvia Ferrari

The exploration \& exploitation dilemma poses significant challenges in reinforcement learning (RL). Recently, curiosity-based exploration methods achieved great success in tackling hard-exploration problems. However, they necessitate…

Machine Learning · Computer Science 2024-12-06 Yiran Wang , Chenshu Liu , Yunfan Li , Sanae Amani , Bolei Zhou , Lin F. Yang

Long-horizon precision manipulation in laboratory automation, such as pipette tip attachment and liquid transfer, requires policies that respect strict procedural logic while operating in continuous, high-dimensional state spaces. However,…

Robotics · Computer Science 2026-03-03 Yibo Qiu , Shu'ang Sun , Haoliang Ye , Ronald X Xu , Mingzhai Sun

Interaction-aware planning for autonomous driving requires an exploration of a combinatorial solution space when using conventional search- or optimization-based motion planners. With Deep Reinforcement Learning, optimal driving strategies…

Robotics · Computer Science 2021-02-08 Julian Bernhard , Robert Gieselmann , Klemens Esterle , Alois Knoll