English
Related papers

Related papers: HEADER: Hierarchical Robot Exploration via Attenti…

200 papers

Recent researches show that machine learning has the potential to learn better heuristics than the one designed by human for solving combinatorial optimization problems. The deep neural network is used to characterize the input instance for…

Machine Learning · Computer Science 2020-02-11 Bo Peng , Jiahai Wang , Zizhen Zhang

Tracking moving objects is a critical skill for many everyday tasks, such as crossing a busy street, driving a car or catching a ball. Attention is a key cognitive function that supports object tracking; however, our understanding of the…

This paper introduces a novel method of adding intrinsic bonuses to task-oriented reward function in order to efficiently facilitate reinforcement learning search. While various bonuses have been designed to date, they are analogous to the…

Machine Learning · Computer Science 2023-07-04 Taisuke Kobayashi

This paper addresses the problem of learning abstractions that boost robot planning performance while providing strong guarantees of reliability. Although state-of-the-art hierarchical robot planning algorithms allow robots to efficiently…

Robotics · Computer Science 2022-04-26 Naman Shah , Siddharth Srivastava

Embedding visual representations within original hierarchical tables can mitigate additional cognitive load stemming from the division of users' attention. The created hierarchical table visualizations can help users understand and explore…

Human-Computer Interaction · Computer Science 2024-05-28 Guozheng Li , Peng He , Xinyu Wang , Runfei Li , Chi Harold Liu , Chuangxin Ou , Dong He , Guoren Wang

Hierarchical reinforcement learning (HRL) has the potential to solve complex long horizon tasks using temporal abstraction and increased exploration. However, hierarchical agents are difficult to train due to inherent non-stationarity. We…

Machine Learning · Computer Science 2025-02-11 Utsav Singh , Vinay P. Namboodiri

Attention is fundamental to cognition, yet it remains a challenge to understand attention in tasks approaching real-world complexity. Here, we approached this problem by modeling gaze patterns of monkeys playing Pac-Man. We first show a…

Neurons and Cognition · Quantitative Biology 2025-08-12 Zhongqiao Lin , Yunwei Li , Tianming Yang

This paper presents a system for autonomous semantic exploration and dense semantic target mapping of a complex unknown environment using a ground robot equipped with a LiDAR-panoramic camera suite. Existing approaches often struggle to…

Reinforcement learning is a machine learning approach based on behavioral psychology. It is focused on learning agents that can acquire knowledge and learn to carry out new tasks by interacting with the environment. However, a problem…

Artificial Intelligence · Computer Science 2022-12-15 Hugo Muñoz , Ernesto Portugal , Angel Ayala , Bruno Fernandes , Francisco Cruz

LiDAR relocalization has attracted increasing attention as it can deliver accurate 6-DoF pose estimation in complex 3D environments. Recent learning-based regression methods offer efficient solutions by directly predicting global poses…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jianshi Wu , Minghang Zhu , Dunqiang Liu , Wen Li , Sheng Ao , Siqi Shen , Chenglu Wen , Cheng Wang

Hierarchical Reinforcement Learning (HRL) exploits temporally extended actions, or options, to make decisions from a higher-dimensional perspective to alleviate the sparse reward problem, one of the most challenging problems in…

Machine Learning · Computer Science 2019-05-15 Libo Xing

Efficiently tackling multiple tasks within complex environment, such as those found in robot manipulation, remains an ongoing challenge in robotics and an opportunity for data-driven solutions, such as reinforcement learning (RL).…

Robotics · Computer Science 2024-04-03 Carlos Plou , Ana C. Murillo , Ruben Martinez-Cantin

We address the problem of efficient 3-D exploration in indoor environments for micro aerial vehicles with limited sensing capabilities and payload/power constraints. We develop an indoor exploration framework that uses learning to predict…

Robotics · Computer Science 2023-08-15 Yuezhan Tao , Yuwei Wu , Beiming Li , Fernando Cladera , Alex Zhou , Dinesh Thakur , Vijay Kumar

Training robots directly from human videos is an emerging area in robotics and computer vision. While there has been notable progress with two-fingered grippers, learning autonomous tasks for multi-fingered robot hands in this way remains…

Robotics · Computer Science 2024-10-31 Irmak Guzey , Yinlong Dai , Georgy Savva , Raunaq Bhirangi , Lerrel Pinto

Intrinsically motivated goal exploration algorithms enable machines to discover repertoires of policies that produce a diversity of effects in complex environments. These exploration algorithms have been shown to allow real world robots to…

Machine Learning · Computer Science 2018-10-11 Alexandre Péré , Sébastien Forestier , Olivier Sigaud , Pierre-Yves Oudeyer

Real-world robotic tasks require complex reward functions. When we define the problem the robot needs to solve, we pretend that a designer specifies this complex reward exactly, and it is set in stone from then on. In practice, however,…

Robotics · Computer Science 2021-11-19 Jerry Zhi-Yang He , Anca D. Dragan

Despite groundbreaking progress in reinforcement learning for robotics, gameplay, and other complex domains, major challenges remain in applying reinforcement learning to the evolving, open-world problems often found in critical application…

Self-supervised goal proposal and reaching is a key component for exploration and efficient policy learning algorithms. Such a self-supervised approach without access to any oracle goal sampling distribution requires deep exploration and…

Robotics · Computer Science 2021-04-28 Homanga Bharadhwaj , Animesh Garg , Florian Shkurti

Reinforcement learning is concerned with identifying reward-maximizing behaviour policies in environments that are initially unknown. State-of-the-art reinforcement learning approaches, such as deep Q-networks, are model-free and learn to…

Artificial Intelligence · Computer Science 2017-08-18 Felix Leibfried , Nate Kushman , Katja Hofmann

The design of reward functions in reinforcement learning is a human skill that comes with experience. Unfortunately, there is not any methodology in the literature that could guide a human to design the reward function or to allow a human…

Artificial Intelligence · Computer Science 2019-01-07 Nicholas R. Clayton , Hussein Abbass