中文
相关论文

相关论文: Near-Optimal Algorithms for Autonomous Exploration…

200 篇论文

This paper addresses the problem of optimal control of robotic sensing systems aimed at autonomous information gathering in scenarios such as environmental monitoring, search and rescue, and surveillance and reconnaissance. The information…

系统与控制 · 计算机科学 2016-01-28 Mikko Lauri , Nikolay Atanasov , George J. Pappas , Risto Ritala

Autonomous exploration has many important applications. However, classic information gain-based or frontier-based exploration only relies on the robot current state to determine the immediate exploration goal, which lacks the capability of…

机器人学 · 计算机科学 2023-05-26 Yafei Hu , Junyi Geng , Chen Wang , John Keller , Sebastian Scherer

In this paper, we consider a class of continuous-time, continuous-space stochastic optimal control problems. Building upon recent advances in Markov chain approximation methods and sampling-based algorithms for deterministic path planning,…

机器人学 · 计算机科学 2012-02-27 Vu Anh Huynh , Sertac Karaman , Emilio Frazzoli

In order to compute near-optimal policies with policy-gradient algorithms, it is common in practice to include intrinsic exploration terms in the learning objective. Although the effectiveness of these terms is usually justified by an…

机器学习 · 计算机科学 2025-08-21 Adrien Bolland , Gaspard Lambrechts , Damien Ernst

Single Source Shortest Paths ($\textrm{SSSP}$) is among the most well-studied problems in computer science. In the incremental (resp. decremental) setting, the goal is to maintain distances from a fixed source in a graph undergoing edge…

数据结构与算法 · 计算机科学 2024-07-16 Barna Saha , Virginia Vassilevska Williams , Yinzhan Xu , Christopher Ye

Many policy search algorithms have been proposed for robot learning and proved to be practical in real robot applications. However, there are still hyperparameters in the algorithms, such as the exploration rate, which requires manual…

机器人学 · 计算机科学 2018-08-13 Shidi Li , Chee-Meng Chew , Velusamy Subramaniam

Exploration in reinforcement learning (RL) remains an open challenge. RL algorithms rely on observing rewards to train the agent, and if informative rewards are sparse the agent learns slowly or may not learn at all. To improve exploration…

机器学习 · 计算机科学 2024-11-12 Simone Parisi , Alireza Kazemipour , Michael Bowling

Autonomous exploration in mobile robotics often involves a trade-off between two objectives: maximizing environmental coverage and minimizing the total path length. In the widely used information gain paradigm, exploration is guided by the…

机器人学 · 计算机科学 2025-04-22 Ludvig Ericson , José Pedro , Patric Jensfelt

Balancing exploration and conservatism in the constrained setting is an important problem if we are to use reinforcement learning for meaningful tasks in the real world. In this paper, we propose a principled algorithm for safe exploration…

人工智能 · 计算机科学 2023-04-24 Alexander W. Goodall , Francesco Belardinelli

We study the combinatorial pure exploration problem Best-Set in stochastic multi-armed bandits. In a Best-Set instance, we are given $n$ arms with unknown reward distributions, as well as a family $\mathcal{F}$ of feasible subsets over the…

机器学习 · 计算机科学 2017-06-06 Lijie Chen , Anupam Gupta , Jian Li , Mingda Qiao , Ruosong Wang

Within the framework of probably approximately correct Markov decision processes (PAC-MDP), much theoretical work has focused on methods to attain near optimality after a relatively long period of learning and exploration. However,…

人工智能 · 计算机科学 2016-04-06 Kenji Kawaguchi

We propose a novel reformulation of the stochastic optimal control problem as an approximate inference problem, demonstrating, that such a interpretation leads to new practical methods for the original problem. In particular we characterise…

机器学习 · 计算机科学 2010-09-22 Konrad Rawlik , Marc Toussaint , Sethu Vijayakumar

We address the problem of minimal actuator placement in linear systems so that the volume of the set of states reachable with one unit or less of input energy is lower bounded by a desired value. First, following the recent work of…

最优化与控制 · 数学 2016-12-30 V. Tzoumas , M. A. Rahimian , G. J. Pappas , A. Jadbabaie

A natural optimization model that formulates many online resource allocation and revenue management problems is the online linear program (LP) in which the constraint matrix is revealed column by column along with the corresponding…

数据结构与算法 · 计算机科学 2014-04-10 Shipra Agrawal , Zizhuo Wang , Yinyu Ye

We consider the bi-criteria shortest-path problem where we want to compute shortest paths on a graph that simultaneously balance two cost functions. While this problem has numerous applications, there is usually no path minimizing both cost…

数据结构与算法 · 计算机科学 2021-03-08 Oren Salzman

This work studies object goal navigation task, which involves navigating to the closest object related to the given semantic category in unseen environments. Recent works have shown significant achievements both in the end-to-end…

人工智能 · 计算机科学 2021-09-21 Aleksey Staroverov , Aleksandr I. Panov

To achieve sample efficiency in reinforcement learning (RL), it necessitates efficiently exploring the underlying environment. Under the offline setting, addressing the exploration challenge lies in collecting an offline dataset with…

机器学习 · 计算机科学 2022-02-15 Shuang Qiu , Jieping Ye , Zhaoran Wang , Zhuoran Yang

In the contextual linear bandit setting, algorithms built on the optimism principle fail to exploit the structure of the problem and have been shown to be asymptotically suboptimal. In this paper, we follow recent approaches of deriving…

机器学习 · 计算机科学 2020-11-23 Andrea Tirinzoni , Matteo Pirotta , Marcello Restelli , Alessandro Lazaric

Autonomous exploration of cluttered environments requires efficient exploration strategies that guarantee safety against potential collisions with unknown random obstacles. This paper presents a novel approach combining a graph neural…

机器人学 · 计算机科学 2025-04-23 Gabriele Calzolari , Vidya Sumathy , Christoforos Kanellakis , George Nikolakopoulos

Autonomous exploration using unmanned aerial vehicles (UAVs) is essential for various tasks such as building inspections, rescue operations, deliveries, and warehousing. However, there are two main limitations to previous approaches: they…