English
Related papers

Related papers: Emergence of Implicit World Models from Mortal Age…

200 papers

We consider the setting of an agent with a fixed body interacting with an unknown and uncertain external world. We show that models trained to predict proprioceptive information about the agent's body come to represent objects in the…

Efficient exploration is an unsolved problem in Reinforcement Learning which is usually addressed by reactively rewarding the agent for fortuitously encountering novel situations. This paper introduces an efficient active exploration…

Machine Learning · Computer Science 2019-06-17 Pranav Shyam , Wojciech Jaśkowski , Faustino Gomez

In the face of difficult exploration problems in reinforcement learning, we study whether giving an agent an object-centric mapping (describing a set of items and their attributes) allow for more efficient learning. We found this problem is…

Machine Learning · Computer Science 2025-04-15 Anthony GX-Chen , Kenneth Marino , Rob Fergus

Emergence and emergent behaviors are often defined as cases where changes in local interactions between agents at a lower level effectively changes what occurs in the higher level of the system (i.e., the whole swarm) and its properties.…

Robotics · Computer Science 2024-04-01 Ricardo Vega , Connor Mattson , Daniel S. Brown , Cameron Nowzari

The rapid progress in embodied artificial intelligence has highlighted the necessity for more advanced and integrated models that can perceive, interpret, and predict environmental dynamics. In this context, World Models (WMs) have been…

Artificial Life provides the opportunity to study the emergence and evolution of simple ecosystems in real time. We give an overview of the advantages and limitations of such an approach, as well as its relation to individual-based modeling…

Biological Physics · Physics 2007-05-23 C. Adami

Interactions with articulated objects are a challenging but important task for mobile robots. To tackle this challenge, we propose a novel closed-loop control pipeline, which integrates manipulation priors from affordance estimation with…

Robotics · Computer Science 2023-02-07 Giulio Schiavi , Paula Wulkop , Giuseppe Rizzi , Lionel Ott , Roland Siegwart , Jen Jen Chung

Robotic manipulation stands as a largely unsolved problem despite significant advances in robotics and machine learning in recent years. One of the key challenges in manipulation is the exploration of the dynamics of the environment when…

Robotics · Computer Science 2022-10-25 Tim Schneider , Boris Belousov , Georgia Chalvatzaki , Diego Romeres , Devesh K. Jha , Jan Peters

World models have emerged as a unifying paradigm for learning latent dynamics, simulating counterfactual futures, and supporting planning under uncertainty. In this paper, we argue that computational epidemiology is a natural and…

Machine Learning · Computer Science 2026-04-14 Zeeshan Memon , Yiqi Su , Christo Kurisummoottil Thomas , Walid Saad , Liang Zhao , Naren Ramakrishnan

In reinforcement learning (RL), agents often operate in partially observed and uncertain environments. Model-based RL suggests that this is best achieved by learning and exploiting a probabilistic model of the world. 'Active inference' is…

Machine Learning · Computer Science 2019-11-26 Alexander Tschantz , Manuel Baltieri , Anil. K. Seth , Christopher L. Buckley

Humans perceive and interact with hundreds of objects every day. In doing so, they need to employ mental models of these objects and often exploit symmetries in the object's shape and appearance in order to learn generalizable and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Stefano Ferraro , Toon Van de Maele , Tim Verbelen , Bart Dhoedt

Adaptive behavior is mainly the result of adaptive brains. We go a step beyond and claim that the brain does not only adapt to its surrounding reality but rather, it builds itself up to constructs its own reality. That is, rather than just…

Neural and Evolutionary Computing · Computer Science 2016-08-09 Fernando Corbacho

The enactive approach to cognition is typically proposed as a viable alternative to traditional cognitive science. Enactive cognition displaces the explanatory focus from the internal representations of the agent to the direct sensorimotor…

Machine Learning · Computer Science 2018-10-11 Rafik Hadfi

Recent advances in theoretical biology suggest that basal cognition and sentient behaviour are emergent properties of in vitro cell cultures and neuronal networks, respectively. Such neuronal networks spontaneously learn structured…

This paper studies the action dynamics of network coordination games with bounded-rational agents. I apply the experience-weighted attraction (EWA) model to the analysis as the EWA model has several free parameters that can capture…

General Economics · Economics 2023-10-31 Fulin Guo

In this work we present an empirical study where we demonstrate the possibility of developing an artificial agent that is capable to autonomously explore an experimental scenario. During the exploration, the agent is able to discover and…

Artificial Intelligence · Computer Science 2022-06-07 Gabriele Sartor , Davide Zollo , Marta Cialdea Mayer , Angelo Oddi , Riccardo Rasconi , Vieri Giuliano Santucci

Continual learning refers to the ability of a biological or artificial system to seamlessly learn from continuous streams of information while preventing catastrophic forgetting, i.e., a condition in which new incoming information strongly…

Machine Learning · Computer Science 2019-07-04 German I. Parisi , Christopher Kanan

The premise of the Multi-disciplinary Conference on Reinforcement Learning and Decision Making is that multiple disciplines share an interest in goal-directed decision making over time. The idea of this paper is to sharpen and deepen this…

Artificial Intelligence · Computer Science 2022-06-07 Richard S. Sutton

We analyze the dynamics of agent--based models (ABMs) from a Markovian perspective and derive explicit statements about the possibility of linking a microscopic agent model to the dynamical processes of macroscopic observables that are…

Adaptation and Self-Organizing Systems · Physics 2012-07-11 Sven Banisch , Ricardo Lima , Tanya Araújo

In this exploratory paper we introduce the problem of cognitive agents that learn how to modify their environment according to local sensing to reach a global goal. We concentrate on discrete dynamics (cellular automata) on a…

Cellular Automata and Lattice Gases · Physics 2026-04-14 Franco Bagnoli , Bassem Sellami , Amira Mouakher , Samira El Yacoubi