English
Related papers

Related papers: Explore-Bench: Data Sets, Metrics and Evaluations …

200 papers

Sufficient exploration is paramount for the success of a reinforcement learning agent. Yet, exploration is rarely assessed in an algorithm-independent way. We compare the behavior of three data-based, offline exploration metrics described…

Machine Learning · Computer Science 2020-10-30 Jakob J. Hollenstein , Sayantan Auddy , Matteo Saveriano , Erwan Renaudo , Justus Piater

Multi-robot autonomous exploration in an unknown environment is an important application in robotics.Traditional exploration methods only use information around frontier points or viewpoints, ignoring spatial information of unknown areas.…

Robotics · Computer Science 2025-03-18 Di Meng , Tianhao Zhao , Chaoyu Xue , Jun Wu , Qiuguo Zhu

Reinforcement Learning (RL) has emerged as a powerful paradigm in Artificial Intelligence (AI), enabling agents to learn optimal behaviors through interactions with their environments. Drawing from the foundations of trial and error, RL…

Artificial Intelligence · Computer Science 2025-02-04 Majid Ghasemi , Amir Hossein Moosavi , Dariush Ebrahimi

Customized hardware accelerators have been developed to provide improved performance and efficiency for DNN inference and training. However, the existing hardware accelerators may not always be suitable for handling various DNN models as…

Hardware Architecture · Computer Science 2021-04-07 Xiaofan Zhang , Hanchen Ye , Deming Chen

A properly calibrated rule-based autoscaler can beat every one of six mainstream deep reinforcement learning (DRL) algorithms on cost across every workload we test - so when, if ever, does DRL actually help? We study this in RLScale-Bench,…

Machine Learning · Computer Science 2026-05-27 Guilin Zhang , Chuanyi Sun , Kai Zhao , Shahryar Sarkani , John Fossaceca

Deep reinforcement learning (DRL) has delivered strong results in domains such as Atari and Go, but it still suffers from high sample cost and weak transfer beyond the training setting. A common response is to reuse information from…

Machine Learning · Computer Science 2026-05-05 Ujjwal Patil , Javad Ghofrani

This paper presents a Pre-Training Deep Reinforcement Learning(DRL) for avoidance navigation without map for mobile robots which map raw sensor data to control variable and navigate in an unknown environment. The efficient offline training…

Robotics · Computer Science 2023-08-04 Yang Wenkai Ji Ruihang Zhang Yuxiang Lei Hao , Zhao Zijie

Deep reinforcement learning (DRL) has shown success in diverse domains such as robotics, computer games, and recommendation systems. However, like any other software system, DRL-based software systems are susceptible to faults that pose…

Software Engineering · Computer Science 2024-10-08 Rached Bouchoucha , Ahmed Haj Yahmed , Darshan Patil , Janarthanan Rajendran , Amin Nikanjam , Sarath Chandar , Foutse Khomh

Deep reinforcement learning (DRL) is a promising way to achieve human-like autonomous driving. However, the low sample efficiency and difficulty of designing reward functions for DRL would hinder its applications in practice. In light of…

Robotics · Computer Science 2021-10-29 Zhiyu Huang , Jingda Wu , Chen Lv

Automating AI research holds immense potential for accelerating scientific progress, yet current AI agents struggle with the complexities of rigorous, end-to-end experimentation. We introduce EXP-Bench, a novel benchmark designed to…

This study presents a benchmark for evaluating action-constrained reinforcement learning (RL) algorithms. In action-constrained RL, each action taken by the learning system must comply with certain constraints. These constraints are crucial…

Machine Learning · Computer Science 2023-06-30 Kazumi Kasaura , Shuwa Miura , Tadashi Kozuno , Ryo Yonetani , Kenta Hoshino , Yohei Hosoe

Planetary rover exploration is attracting renewed interest with several upcoming space missions to the Moon and Mars. However, a substantial amount of data from prior missions remain underutilized for path planning and autonomous navigation…

Robotics · Computer Science 2025-12-29 Marvin Chancán , Avijit Banerjee , George Nikolakopoulos

Metric ground navigation addresses the problem of autonomously moving a robot from one point to another in an obstacle-occupied planar environment in a collision-free manner. It is one of the most fundamental capabilities of intelligent…

Robotics · Computer Science 2020-11-04 Daniel Perille , Abigail Truong , Xuesu Xiao , Peter Stone

The offline reinforcement learning (RL) setting (also known as full batch RL), where a policy is learned from a static dataset, is compelling as progress enables RL methods to take advantage of large, previously-collected datasets, much…

Machine Learning · Computer Science 2021-02-09 Justin Fu , Aviral Kumar , Ofir Nachum , George Tucker , Sergey Levine

We consider the problem of time-limited robotic exploration in previously unseen environments where exploration is limited by a predefined amount of time. We propose a novel exploration approach using learning-augmented model-based…

Robotics · Computer Science 2023-08-10 Yimeng Li , Arnab Debnath , Gregory Stein , Jana Kosecka

Academic research in the field of autonomous vehicles has reached high popularity in recent years related to several topics as sensor technologies, V2X communications, safety, security, decision making, control, and even legal and…

Machine Learning · Computer Science 2020-01-31 Szilárd Aradi

DBSCAN is widely used in many scientific and engineering fields because of its simplicity and practicality. However, due to its high sensitivity parameters, the accuracy of the clustering result depends heavily on practical experience. In…

Machine Learning · Computer Science 2022-08-10 Ruitong Zhang , Hao Peng , Yingtong Dou , Jia Wu , Qingyun Sun , Jingyi Zhang , Philip S. Yu

Safe autonomous exploration of unknown environments is an essential skill for mobile robots to effectively and adaptively perform environmental mapping for diverse critical tasks. Due to its simplicity, most existing exploration methods…

Robotics · Computer Science 2025-03-13 Aykut İşleyen , René van de Molengraft , Ömür Arslan

Recently deep reinforcement learning (DRL) has achieved outstanding success on solving many difficult and large-scale RL problems. However the high sample cost required for effective learning often makes DRL unaffordable in resource-limited…

Machine Learning · Computer Science 2018-09-06 Gang Chen , Yiming Peng , Mengjie Zhang

Exploration is essential for reinforcement learning (RL). To face the challenges of exploration, we consider a reward-free RL framework that completely separates exploration from exploitation and brings new challenges for exploration…

Machine Learning · Computer Science 2020-12-11 Chuheng Zhang , Yuanying Cai , Longbo Huang , Jian Li