English
Related papers

Related papers: On the Complexity of Exploration in Goal-Driven Na…

200 papers

Most reinforcement learning algorithms seek a single optimal strategy that solves a given task. However, it can often be valuable to learn a diverse set of solutions, for instance, to make an agent's interaction with users more engaging, or…

Machine Learning · Computer Science 2024-01-09 Wentse Chen , Shiyu Huang , Yuan Chiang , Tim Pearce , Wei-Wei Tu , Ting Chen , Jun Zhu

We present a lightweight, decentralized algorithm for navigating multiple nonholonomic agents through challenging environments with narrow passages. Our key idea is to allow agents to yield to each other in large open areas instead of…

Robotics · Computer Science 2023-03-17 Liang He , Zherong Pan , Dinesh Manocha

Recent advancements in reinforcement learning have made significant impacts across various domains, yet they often struggle in complex multi-agent environments due to issues like algorithm instability, low sampling efficiency, and the…

Multiagent Systems · Computer Science 2024-08-22 Cheng Xu , Changtian Zhang , Yuchen Shi , Ran Wang , Shihong Duan , Yadong Wan , Xiaotong Zhang

Embodied AI has been recently gaining attention as it aims to foster the development of autonomous and intelligent agents. In this paper, we devise a novel embodied setting in which an agent needs to explore a previously unknown environment…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Roberto Bigazzi , Federico Landi , Marcella Cornia , Silvia Cascianelli , Lorenzo Baraldi , Rita Cucchiara

We have observed significant progress in visual navigation for embodied agents. A common assumption in studying visual navigation is that the environments are static; this is a limiting assumption. Intelligent navigation may involve…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Kuo-Hao Zeng , Luca Weihs , Ali Farhadi , Roozbeh Mottaghi

Intrinsically motivated goal exploration processes enable agents to autonomously sample goals to explore efficiently complex environments with high-dimensional continuous actions. They have been applied successfully to real world robots to…

Machine Learning · Computer Science 2018-11-06 Adrien Laversanne-Finot , Alexandre Péré , Pierre-Yves Oudeyer

Self-supervised goal proposal and reaching is a key component for exploration and efficient policy learning algorithms. Such a self-supervised approach without access to any oracle goal sampling distribution requires deep exploration and…

Robotics · Computer Science 2021-04-28 Homanga Bharadhwaj , Animesh Garg , Florian Shkurti

Solving tasks with sparse rewards is one of the most important challenges in reinforcement learning. In the single-agent setting, this challenge is addressed by introducing intrinsic rewards that motivate agents to explore unseen regions of…

Machine Learning · Computer Science 2021-05-25 Shariq Iqbal , Fei Sha

Planning for ad hoc teamwork is challenging because it involves agents collaborating without any prior coordination or communication. The focus is on principled methods for a single agent to cooperate with others. This motivates…

Multiagent Systems · Computer Science 2014-09-02 Muthukumaran Chandrasekaran , Prashant Doshi , Yifeng Zeng , Yingke Chen

Autonomous navigation requires planning to reach a goal safely and efficiently in complex and potentially dynamic environments. Graph search-based algorithms are widely adopted due to their generality and theoretical guarantees when…

Robotics · Computer Science 2026-04-21 Hanyang Hu , Cameron Siu , Mo Chen

Various hypotheses exist about the paths used for communication between the nodes of complex networks. Most studies simply suppose that communication goes via shortest paths, while others have more explicit assumptions about how routing…

We propose a novel Reinforcement Learning model for discrete environments, which is inherently interpretable and supports the discovery of deep subgoal hierarchies. In the model, an agent learns information about environment in the form of…

Artificial Intelligence · Computer Science 2022-02-16 Alexander Demin , Denis Ponomaryov

We propose a hierarchical reinforcement learning (HRL) framework for efficient Navigation Among Movable Obstacles (NAMO) using a mobile manipulator. Our approach combines interaction-based obstacle property estimation with structured…

Robotics · Computer Science 2025-06-19 Taegeun Yang , Jiwoo Hwang , Jeil Jeong , Minsung Yoon , Sung-Eui Yoon

Hierarchical reinforcement learning (HRL) addresses complex long-horizon tasks by skillfully decomposing them into subgoals. Therefore, the effectiveness of HRL is greatly influenced by subgoal reachability. Typical HRL methods only…

Machine Learning · Computer Science 2024-06-27 Yu Luo , Fuchun Sun , Tianying Ji , Xianyuan Zhan

Generating competitive strategies and performing continuous motion planning simultaneously in an adversarial setting is a challenging problem. In addition, understanding the intent of other agents is crucial to deploying autonomous systems…

Robotics · Computer Science 2025-06-17 Hongrui Zheng , Zhijun Zhuang , Stephanie Wu , Shuo Yang , Rahul Mangharam

We give lower bounds for various natural node- and edge-based local strategies for exploring a graph. We consider this problem both in the setting of an arbitrary graph as well as the abstraction of a geometric exploration of a space by a…

Computational Geometry · Computer Science 2016-03-21 Aditya Kumar Akash , Sandor P. Fekete , Seoung Kyou Lee , Alejandro Lopez-Ortiz , Daniela Maftuleac , James McLurkin

A significant element of human cooperative intelligence lies in our ability to identify opportunities for fruitful collaboration; and conversely to recognise when the task at hand is better pursued alone. Research on flexible cooperation in…

Multiagent Systems · Computer Science 2026-03-10 Max Taylor-Davies , Neil Bramley , Christopher G. Lucas

Walking in a Virtual Environment is a bounded task. It is challenging for a subject to navigate a large virtual environment designed in a limited physical space. External hardware support may be required to achieve such an act in a concise…

Human-Computer Interaction · Computer Science 2021-05-25 Raghav Mittal , Sai Anirudh Karre , Y. Raghu Reddy

Autonomous exploration is a complex task where the robot moves through an unknown environment with the goal of mapping it. The desired output of such a process is a sequence of paths that efficiently and safely minimise the uncertainty of…

Robotics · Computer Science 2018-05-04 Gilad Francis , Lionel Ott , Fabio Ramos

This paper introduces a real-time algorithm for navigating complex unknown environments cluttered with movable obstacles. Our algorithm achieves fast, adaptable routing by actively attempting to manipulate obstacles during path planning and…

Robotics · Computer Science 2024-04-12 Botao He , Guofei Chen , Wenshan Wang , Ji Zhang , Cornelia Fermuller , Yiannis Aloimonos