English
Related papers

Related papers: Learning What Matters: Adaptive Information-Theore…

200 papers

The growing demand for oriented object detection (OOD) across various domains has driven significant research in this area. However, the high cost of dataset annotation remains a major concern. Current mainstream OOD algorithms can be…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Mingxin Liu , Peiyuan Zhang , Yuan Liu , Wei Zhang , Yue Zhou , Ning Liao , Ziyang Gong , Junwei Luo , Zhirui Wang , Yi Yu , Xue Yang

Learning complex robot behaviors through interaction requires structured exploration. Planning should target interactions with the potential to optimize long-term performance, while only reducing uncertainty where conducive to this…

Machine Learning · Computer Science 2021-12-14 Tim Seyde , Wilko Schwarting , Sertac Karaman , Daniela Rus

Intrinsically motivated goal exploration algorithms enable machines to discover repertoires of policies that produce a diversity of effects in complex environments. These exploration algorithms have been shown to allow real world robots to…

Machine Learning · Computer Science 2018-10-11 Alexandre Péré , Sébastien Forestier , Olivier Sigaud , Pierre-Yves Oudeyer

Exploration in an unknown environment is the core functionality for mobile robots. Learning-based exploration methods, including convolutional neural networks, provide excellent strategies without human-designed logic for the feature…

Robotics · Computer Science 2016-10-10 Lei Tai , Ming Liu

In this paper, we propose a unified information theoretic framework for learning-motivated methods aimed at odometry estimation, a crucial component of many robotics and vision tasks such as navigation and virtual reality where relative…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Sen Zhang , Jing Zhang , Dacheng Tao

Generalizing deep reinforcement learning agents to unseen environments remains a significant challenge. One promising solution is Unsupervised Environment Design (UED), a co-evolutionary framework in which a teacher adaptively generates…

Machine Learning · Computer Science 2026-03-17 Geonwoo Cho , Jaegyun Im , Jihwan Lee , Hojun Yi , Sejin Kim , Sundong Kim

This study addresses the challenge of fleet design optimization in the context of heterogeneous multi-robot fleets, aiming to obtain feasible designs that balance performance and costs. In the domain of autonomous multi-robot exploration,…

We consider the utilization of a computational model to guide the optimal acquisition of experimental data to inform the stochastic description of model input parameters. Our formulation is based on the recently developed consistent…

Computation · Statistics 2021-05-04 Scott N. Walsh , Tim M. Wildey , John D. Jakeman

In this work, we propose an information-directed objective for infinite-horizon reinforcement learning (RL), called the occupancy information ratio (OIR), inspired by the information ratio objectives used in previous information-directed…

Machine Learning · Computer Science 2023-12-29 Wesley A. Suttle , Alec Koppel , Ji Liu

Learning from imperfect data becomes an issue in many industrial applications after the research community has made profound progress in supervised learning from perfectly annotated datasets. The purpose of the Learning from Imperfect Data…

Advancing Machine Learning (ML)-based perception models for autonomous systems necessitates addressing weak spots within the models, particularly in challenging Operational Design Domains (ODDs). These are environmental operating conditions…

Machine Learning · Computer Science 2024-09-02 Ahmed Hammam , Bharathwaj Krishnaswami Sreedhar , Nura Kawa , Tim Patzelt , Oliver De Candido

Volumetric objectives for exploration and perception tasks seek to capture a sense of value (or reward) for hypothetical observations at one or more camera views for robots operating in unknown environments. For example, a volumetric…

Robotics · Computer Science 2021-03-29 Micah Corah , Nathan Michael

Bayesian optimal experimental design (BOED) is a methodology to identify experiments that are expected to yield informative data. Recent work in cognitive science considered BOED for computational models of human behavior with tractable and…

Machine Learning · Computer Science 2021-11-01 Simon Valentin , Steven Kleinegesse , Neil R. Bramley , Michael U. Gutmann , Christopher G. Lucas

The goal of meta-reinforcement learning (meta-RL) is to build agents that can quickly learn new tasks by leveraging prior experience on related tasks. Learning a new task often requires both exploring to gather task-relevant information and…

Machine Learning · Computer Science 2021-11-15 Evan Zheran Liu , Aditi Raghunathan , Percy Liang , Chelsea Finn

Adaptive random search approaches have been shown to be effective for global optimization problems, where under certain conditions, the expected performance time increases only linearly with dimension. However, previous analyses assume that…

Optimization and Control · Mathematics 2022-03-22 David D. Linz , Zelda B. Zabinsky

Using mathematical models to assist in the interpretation of experiments is becoming increasingly important in research across applied mathematics, and in particular in biology and ecology. In this context, accurate parameter estimation is…

Statistics Theory · Mathematics 2025-04-29 Jie Qi , Ruth E. Baker

Representation learning is a powerful tool that enables learning over large multitudes of agents or domains by enforcing that all agents operate on a shared set of learned features. However, many robotics or controls applications that would…

Machine Learning · Computer Science 2024-07-30 Bruce D. Lee , Leonardo F. Toso , Thomas T. Zhang , James Anderson , Nikolai Matni

Sequential Bayesian optimal experimental design (SBOED) for PDE-governed inverse problems is computationally challenging, especially for infinite-dimensional random field parameters. High-fidelity approaches require repeated forward and…

Optimization and Control · Mathematics 2026-01-12 Kaichen Shen , Peng Chen

We consider online learning problems under a partial observability model capturing situations where the information conveyed to the learner is between full information and bandit feedback. In the simplest variant, we assume that in addition…

Machine Learning · Computer Science 2026-04-28 Tomas Kocak , Gergely Neu , Michal Valko , Remi Munos

Optimal experimental design (OED) concerns itself with identifying ideal methods of data collection, e.g.~via sensor placement. The \emph{greedy algorithm}, that is, placing one sensor at a time, in an iteratively optimal manner, stands as…

Optimization and Control · Mathematics 2025-10-15 Christian Aarset