English
Related papers

Related papers: Learning to Gather Information via Imitation

200 papers

We present a method for autonomous exploration of large-scale unknown environments under mission time constraints. We start by proposing the Frontloaded Information Gain Orienteering Problem (FIG-OP) -- a generalization of the traditional…

Reinforcement learning allows solving complex tasks, however, the learning tends to be task-specific and the sample efficiency remains a challenge. We present Plan2Explore, a self-supervised reinforcement learning agent that tackles both…

Machine Learning · Computer Science 2020-07-02 Ramanan Sekar , Oleh Rybkin , Kostas Daniilidis , Pieter Abbeel , Danijar Hafner , Deepak Pathak

Robotic motion planning problems are typically solved by constructing a search tree of valid maneuvers from a start to a goal configuration. Limited onboard computation and real-time planning constraints impose a limit on how large this…

Robotics · Computer Science 2017-07-12 Mohak Bhardwaj , Sanjiban Choudhury , Sebastian Scherer

This paper addresses the problem of active information gathering for multi-robot systems. Specifically, we consider scenarios where robots are tasked with reducing uncertainty of dynamical hidden states evolving in complex environments. The…

Robotics · Computer Science 2021-07-26 Mariliza Tzes , Yiannis Kantaros , George J. Pappas

Intrinsically motivated goal exploration algorithms enable machines to discover repertoires of policies that produce a diversity of effects in complex environments. These exploration algorithms have been shown to allow real world robots to…

Machine Learning · Computer Science 2018-10-11 Alexandre Péré , Sébastien Forestier , Olivier Sigaud , Pierre-Yves Oudeyer

This article introduces an imitation learning method for learning maximum entropy policies that comply with constraints demonstrated by expert trajectories executing a task. The formulation of the method takes advantage of results…

Machine Learning · Computer Science 2025-07-10 George Papadopoulos , George A. Vouros

Imitation learning for acquiring generalizable policies often requires a large volume of demonstration data, making the process significantly costly. One promising strategy to address this challenge is to leverage the cognitive and…

Robotics · Computer Science 2025-06-09 Yutaro Ishida , Takamitsu Matsubara , Takayuki Kanai , Kazuhiro Shintani , Hiroshi Bito

We consider a robotic vehicle tasked with gathering information by visiting a set of spatially-distributed data sources, the locations of which are not known a priori, but are discovered on the fly. We assume a first-order robot dynamics…

Robotics · Computer Science 2017-04-10 Fangchang Ma , Sertac Karaman

Communication bandwidth is an important consideration in multi-robot exploration, where information exchange among robots is critical. While existing methods typically aim to reduce communication throughput, they either require significant…

Robotics · Computer Science 2024-07-30 Yixiao Ma , Jingsong Liang , Yuhong Cao , Derek Ming Siang Tan , Guillaume Sartoretti

Search missions require motion planning and navigation methods for information gathering that continuously replan based on new observations of the robot's surroundings. Current methods for information gathering, such as Monte Carlo Tree…

As Computer Vision moves from a passive analysis of pixels to active analysis of semantics, the breadth of information algorithms need to reason over has expanded significantly. One of the key challenges in this vein is the ability to…

Machine Learning · Computer Science 2020-03-31 Ehsan Abbasnejad , Iman Abbasnejad , Qi Wu , Javen Shi , Anton van den Hengel

Active learning agents typically employ a query selection algorithm which solely considers the agent's learning objectives. However, this may be insufficient in more realistic human domains. This work uses imitation learning to enable an…

Machine Learning · Computer Science 2019-07-02 Kalesha Bullard , Yannick Schroecker , Sonia Chernova

Imitation from observation is the framework of learning tasks by observing demonstrated state-only trajectories. Recently, adversarial approaches have achieved significant performance improvements over other methods for imitating complex…

Machine Learning · Computer Science 2019-06-19 Faraz Torabi , Sean Geiger , Garrett Warnell , Peter Stone

Model-based controllers on real robots require accurate knowledge of the system dynamics to perform optimally. For complex dynamics, first-principles modeling is not sufficiently precise, and data-driven approaches can be leveraged to learn…

Robotics · Computer Science 2021-05-17 Weixuan Zhang , Marco Tognon , Lionel Ott , Roland Siegwart , Juan Nieto

We consider online learning problems under a partial observability model capturing situations where the information conveyed to the learner is between full information and bandit feedback. In the simplest variant, we assume that in addition…

Machine Learning · Computer Science 2026-04-28 Tomas Kocak , Gergely Neu , Michal Valko , Remi Munos

In this paper, we propose to combine imitation and reinforcement learning via the idea of reward shaping using an oracle. We study the effectiveness of the near-optimal cost-to-go oracle on the planning horizon and demonstrate that the…

Machine Learning · Computer Science 2018-05-30 Wen Sun , J. Andrew Bagnell , Byron Boots

A practical approach to robot reinforcement learning is to first collect a large batch of real or simulated robot interaction data, using some data collection policy, and then learn from this data to perform various tasks, using offline…

Robotics · Computer Science 2021-06-02 Shadi Endrawis , Gal Leibovich , Guy Jacob , Gal Novik , Aviv Tamar

In this paper, we propose a novel architecture and a self-supervised policy gradient algorithm, which employs unsupervised auxiliary tasks to enable a mobile robot to learn how to navigate to a given goal. The dependency on the global…

Robotics · Computer Science 2018-03-07 Arbaaz Khan , Vijay Kumar , Alejandro Ribeiro

We present a novel approach to efficiently learn a simultaneous translation model with coupled programmer-interpreter policies. First, wepresent an algorithmic oracle to produce oracle READ/WRITE actions for training bilingual…

Computation and Language · Computer Science 2021-01-26 Philip Arthur , Trevor Cohn , Gholamreza Haffari

Autonomous exploration in mobile robotics often involves a trade-off between two objectives: maximizing environmental coverage and minimizing the total path length. In the widely used information gain paradigm, exploration is guided by the…

Robotics · Computer Science 2025-04-22 Ludvig Ericson , José Pedro , Patric Jensfelt