English
Related papers

Related papers: Learning in embodied action-perception loops throu…

200 papers

Sequential experimental design to discover interventions that achieve a desired outcome is a key problem in various domains including science, engineering and public policy. When the space of possible interventions is large, making an…

Machine Learning · Computer Science 2023-08-17 Jiaqi Zhang , Louis Cammarata , Chandler Squires , Themistoklis P. Sapsis , Caroline Uhler

Exploration is essential for reinforcement learning (RL). To face the challenges of exploration, we consider a reward-free RL framework that completely separates exploration from exploitation and brings new challenges for exploration…

Machine Learning · Computer Science 2020-12-11 Chuheng Zhang , Yuanying Cai , Longbo Huang , Jian Li

Information maximization has been investigated as a possible mechanism of learning governing the self-organization that occurs within the neural systems of animals. Within the general context of models of neural systems bidirectionally…

Disordered Systems and Neural Networks · Physics 2015-11-18 Takashi Hayakawa , Toshio Aoyagi

Despite recent progress in reinforcement learning (RL), RL algorithms for exploration still remain an active area of research. Existing methods often focus on state-based metrics, which do not consider the underlying causal structures of…

Models of economic decision makers often include idealized assumptions, such as rationality, perfect foresight, and access to all relevant pieces of information. These assumptions often assure the models' internal validity, but, at the same…

General Economics · Economics 2021-07-09 Patrick Reinwald , Stephan Leitner , Friederike Wall

The Integrated Information Theory provides a quantitative approach to consciousness and can be applied to neural networks. An embodied agent controlled by such a network influences and is being influenced by its environment. This involves,…

Neurons and Cognition · Quantitative Biology 2021-11-30 Carlotta Langer , Nihat Ay

The aim of this paper is to study the reward based policy exploration problem in a supervised learning approach and enable robots to form complex movement trajectories in challenging reward settings and search spaces. For this, the…

Robotics · Computer Science 2020-11-10 M. Tuluhan Akbulut , Utku Bozdogan , Ahmet Tekden , Emre Ugur

The foraging behavior of animals is a paradigm of target search in nature. Understanding which foraging strategies are optimal and how animals learn them are central challenges in modeling animal foraging. While the question of optimality…

Statistical Mechanics · Physics 2024-04-15 Gorka Muñoz-Gil , Andrea López-Incera , Lukas J. Fiderer , Hans J. Briegel

Exploration is a prerequisite for learning useful behaviors in sparse-reward, long-horizon tasks, particularly within 3D environments. Curiosity-driven reinforcement learning addresses this via intrinsic rewards derived from the mismatch…

Machine Learning · Computer Science 2026-05-22 Lily Goli , Justin Kerr , Daniele Reda , Alec Jacobson , Andrea Tagliasacchi , Angjoo Kanazawa

What are the functions of curiosity? What are the mechanisms of curiosity-driven learning? We approach these questions about the living using concepts and tools from machine learning and developmental robotics. We argue that…

Artificial Intelligence · Computer Science 2018-06-19 Pierre-Yves Oudeyer

This paper investigates the task-driven exploration of unknown environments with mobile sensors communicating compressed measurements. The sensors explore the area and transmit their compressed data to another robot, assisting it to reach…

Robotics · Computer Science 2025-08-19 Evangelos Psomiadis , Dipankar Maity , Panagiotis Tsiotras

The central tenet of reinforcement learning (RL) is that agents seek to maximize the sum of cumulative rewards. In contrast, active inference, an emerging framework within cognitive and computational neuroscience, proposes that agents act…

Machine Learning · Computer Science 2020-03-02 Alexander Tschantz , Beren Millidge , Anil K. Seth , Christopher L. Buckley

Drawing inspiration from animal navigation strategies, we introduce a novel computational model for navigation and mapping, rooted in biologically inspired principles. Animals exhibit remarkable navigation abilities by efficiently using…

Artificial Intelligence · Computer Science 2025-01-07 Daria de Tinguy , Tim Verbelen , Bart Dhoedt

Exploration is essential in reinforcement learning, particularly in environments where external rewards are sparse. Here we focus on exploration with intrinsic rewards, where the agent transiently augments the external rewards with…

Machine Learning · Computer Science 2024-01-26 Changmin Yu , Neil Burgess , Maneesh Sahani , Samuel J. Gershman

Standard computer vision systems assume access to intelligently captured inputs (e.g., photos from a human photographer), yet autonomously capturing good observations is a major challenge in itself. We address the problem of learning to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-28 Santhosh K. Ramakrishnan , Dinesh Jayaraman , Kristen Grauman

The last few years have witnessed substantial progress in the field of embodied AI where artificial agents, mirroring biological counterparts, are now able to learn from interaction to accomplish complex tasks. Despite this success,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Sarah Pratt , Luca Weihs , Ali Farhadi

When an individual's behavior has rational characteristics, this may lead to irrational collective actions for the group. A wide range of organisms from animals to humans often evolve the social attribute of cooperation to meet this…

Multiagent Systems · Computer Science 2021-11-18 Zhenbo Cheng , Xingguang Liu , Leilei Zhang , Hangcheng Meng , Qin Li , Xiao Gang

Positive affect has been linked to increased interest, curiosity and satisfaction in human learning. In reinforcement learning, extrinsic rewards are often sparse and difficult to define, intrinsically motivated learning can help address…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Dean Zadok , Daniel McDuff , Ashish Kapoor

An embodied task such as embodied question answering (EmbodiedQA), requires an agent to explore the environment and collect clues to answer a given question that related with specific objects in the scene. The solution of such task usually…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Yang Wu , Shirui Feng , Guanbin Li , Liang Lin

We study lifelong visual perception in an embodied setup, where we develop new models and compare various agents that navigate in buildings and occasionally request annotations which, in turn, are used to refine their visual perception…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 David Nilsson , Aleksis Pirinen , Erik Gärtner , Cristian Sminchisescu