English
Related papers

Related papers: Planning to Be Surprised: Optimal Bayesian Explora…

200 papers

Many potential applications of reinforcement learning (RL) are stymied by the large numbers of samples required to learn an effective policy. This is especially true when applying RL to real-world control tasks, e.g. in the sciences or…

Machine Learning · Computer Science 2022-10-11 Viraj Mehta , Ian Char , Joseph Abbate , Rory Conlin , Mark D. Boyer , Stefano Ermon , Jeff Schneider , Willie Neiswanger

The problem of optimizing unknown costly-to-evaluate functions has been studied for a long time in the context of Bayesian Optimization. Algorithms in this field aim to find the optimizer of the function by asking only a few function…

Machine Learning · Computer Science 2013-07-17 Ali Jalali , Javad Azimi , Xiaoli Fern , Ruofei Zhang

Artificial life aims to understand the fundamental principles of biological life by creating computational models that exhibit life-like properties. Although artificial life systems show promise for simulating biological evolution,…

Neural and Evolutionary Computing · Computer Science 2025-06-04 Niko Lorantos , Lee Spector

Excellent computer simulations are done for a purpose. The most valid purposes are to explore uncharted territory, to resolve a well-posed scientific or technical question, or to make a design choice. Stand-alone modeling can serve the…

Numerical Analysis · Mathematics 2025-10-20 Leo P. Kadanoff

Trained human pilots or operators still stand out through their efficient, robust, and versatile skills in guidance tasks such as driving agile vehicles in spatial environments or performing complex surgeries. This research studies how…

Robotics · Computer Science 2017-10-24 Abhishek Verma , Bérénice Mettler

As robots operate in increasingly complex and dynamic environments, fast motion re-planning has become a widely explored area of research. In a real-world deployment, we often lack the ability to fully observe the environment at all times,…

Robotics · Computer Science 2022-02-08 Mark Nicholas Finean , Wolfgang Merkt , Ioannis Havoutis

Active search is a learning paradigm for actively identifying as many members of a given class as possible. A critical target scenario is high-throughput screening for scientific discovery, such as drug or materials discovery. In this…

Machine Learning · Computer Science 2018-11-27 Shali Jiang , Gustavo Malkomes , Benjamin Moseley , Roman Garnett

Research in developmental psychology consistently shows that children explore the world thoroughly and efficiently and that this exploration allows them to learn. In turn, this early learning supports more robust generalization and…

Artificial Intelligence · Computer Science 2020-07-02 Eliza Kosoy , Jasmine Collins , David M. Chan , Sandy Huang , Deepak Pathak , Pulkit Agrawal , John Canny , Alison Gopnik , Jessica B. Hamrick

Adaptive exploration methods propose ways to learn complex policies via alternating between exploration and exploitation. An important question for such methods is to determine the appropriate moment to switch between exploration and…

Artificial Intelligence · Computer Science 2026-02-11 Leonidas Bakopoulos , Georgios Chalkiadakis

Identifying optimal strategies for efficient spatial exploration is crucial, both for animals seeking food and for robotic search processes, where maximizing the covered area is a fundamental requirement. Here, we propose position resetting…

Soft Condensed Matter · Physics 2025-10-02 Kristian Stølevik Olsen , Hartmut Löwen , Lorenzo Caprini

Building autonomous -- i.e., choosing goals based on one's needs -- and adaptive -- i.e., surviving in ever-changing environments -- agents has been a holy grail of artificial intelligence (AI). A living organism is a prime example of such…

Artificial Intelligence · Computer Science 2025-03-18 Sungwoo Lee , Younghyun Oh , Hyunhoe An , Hyebhin Yoon , Karl J. Friston , Seok Jun Hong , Choong-Wan Woo

This paper addresses the problem of planning a safe (i.e., collision-free) trajectory from an initial state to a goal region when the obstacle space is a-priori unknown and is incrementally revealed online, e.g., through line-of-sight…

Robotics · Computer Science 2018-04-17 Lucas Janson , Tommy Hu , Marco Pavone

As AI models grow in power and generality, understanding how agents learn and make decisions in complex environments is critical to promoting ethical behavior. This study introduces the Odyssey, a lightweight, adaptive text based adventure…

Artificial Intelligence · Computer Science 2025-07-16 Dylan Waldner , Risto Miikkulainen

Autonomous exploration is a complex task where the robot moves through an unknown environment with the goal of mapping it. The desired output of such a process is a sequence of paths that efficiently and safely minimise the uncertainty of…

Robotics · Computer Science 2018-05-04 Gilad Francis , Lionel Ott , Fabio Ramos

We consider an active visual exploration scenario, where an agent must intelligently select its camera motions to efficiently reconstruct the full environment from only a limited set of narrow field-of-view glimpses. While the agent has…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Santhosh K. Ramakrishnan , Kristen Grauman

Reinforcement learning systems are often concerned with balancing exploration of untested actions against exploitation of actions that are known to be good. The benefit of exploration can be estimated using the classical notion of Value of…

Artificial Intelligence · Computer Science 2013-01-30 Richard Dearden , Nir Friedman , David Andre

In order to enable Micro-Aerial Vehicles (MAVs) to assist in complex, unknown, unstructured environments, they must be able to navigate with guaranteed safety, even when faced with a cluttered environment they have no prior knowledge of.…

Robotics · Computer Science 2018-03-13 Helen Oleynikova , Zachary Taylor , Roland Siegwart , Juan Nieto

How should we gather information to make effective decisions? We address Bayesian active learning and experimental design problems, where we sequentially select tests to reduce uncertainty about a set of hypotheses. Instead of minimizing…

Machine Learning · Computer Science 2014-02-25 Shervin Javdani , Yuxin Chen , Amin Karbasi , Andreas Krause , J. Andrew Bagnell , Siddhartha Srinivasa

In this extended abstract we discuss the opportunities and challenges of studying intrinsically-motivated agents for exploration in textual environments. We argue that there is important synergy between text environments and autonomous…

Artificial Intelligence · Computer Science 2022-07-12 Laetitia Teodorescu , Eric Yuan , Marc-Alexandre Côté , Pierre-Yves Oudeyer

The use of mobile robots is being popular over the world mainly for autonomous explorations in hazardous/ toxic or unknown environments. This exploration will be more effective and efficient if the explorations in unknown environment can be…

Robotics · Computer Science 2011-10-11 Dip Narayan Ray , Somajyoti Majumder , Sumit Mukhopadhyay