English
Related papers

Related papers: General Agents Contain World Models, even under Pa…

200 papers

In this article, we work towards the goal of developing agents that can learn to act in complex worlds. We develop a probabilistic, relational planning rule representation that compactly models noisy, nondeterministic action effects, and…

Machine Learning · Computer Science 2011-10-12 L. P. Kaelbling , H. M. Pasula , L. S. Zettlemoyer

The recent framework of performative prediction is aimed at capturing settings where predictions influence the target/outcome they want to predict. In this paper, we introduce a natural multi-agent version of this framework, where multiple…

Machine Learning · Computer Science 2022-01-26 Georgios Piliouras , Fang-Yi Yu

In explainable artificial intelligence, there is increasing interest in understanding the behaviour of autonomous agents to build trust and validate performance. Modern agent architectures, such as those trained by deep reinforcement…

Artificial Intelligence · Computer Science 2020-09-22 Tom Bewley , Jonathan Lawry

We show that the way in which the Shannon entropy of sequences produced by an information source converges to the source's entropy rate can be used to monitor how an intelligent agent builds and effectively uses a predictive model of its…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 James P. Crutchfield , David P. Feldman

There has been considerable work on reasoning about the strategic ability of agents under imperfect information. However, existing logics such as Probabilistic Strategy Logic are unable to express properties relating to information…

Artificial Intelligence · Computer Science 2025-01-07 Chunyan Mu , Nima Motamed , Natasha Alechina , Brian Logan

Robotic manipulation stands as a largely unsolved problem despite significant advances in robotics and machine learning in the last decades. One of the central challenges of manipulation is partial observability, as the agent usually does…

Robotics · Computer Science 2022-06-22 Tim Schneider , Boris Belousov , Hany Abdulsamad , Jan Peters

Understanding realistic complex systems requires confronting significant conceptual, theoretical and experimental limitations rooted in the persistence of views that originated in the mechanics of simple moving bodies. We define the…

Physics and Society · Physics 2024-03-06 Santiago Núñez-Corrales , Eric Jakobsson

World models learn behaviors in a latent imagination space to enhance the sample-efficiency of deep reinforcement learning (RL) algorithms. While learning world models for high-dimensional observations (e.g., pixel inputs) has become…

Machine Learning · Computer Science 2022-03-01 Axel Brunnbauer , Luigi Berducci , Andreas Brandstätter , Mathias Lechner , Ramin Hasani , Daniela Rus , Radu Grosu

Many applications of imitation learning require the agent to generate the full distribution of behaviour observed in the training data. For example, to evaluate the safety of autonomous vehicles in simulation, accurate and diverse behaviour…

Deep reinforcement learning has proven to be a great success in allowing agents to learn complex tasks. However, its application to actual robots can be prohibitively expensive. Furthermore, the unpredictability of human behavior in…

Robotics · Computer Science 2019-08-16 Mohammad Thabet , Massimiliano Patacchiola , Angelo Cangelosi

We argue that intelligence, construed as the disposition to perform tasks successfully, is a property of systems composed of agents and their contexts. This is the thesis of extended intelligence. We argue that the performance of an agent…

Artificial Intelligence · Computer Science 2022-09-16 David L Barack , Andrew Jaegle

Correlations and other collective phenomena in a schematic model of heterogeneous binary agents (individual spin-glass samples) are considered on the complete graph and also on 2d and 3d regular lattices. The system's stochastic dynamics is…

Disordered Systems and Neural Networks · Physics 2014-02-25 Imre Kondor , István Csabai , Gábor Papp , Enys Mones , Gábor Czimbalmos , Máté Csaba Sándor

Planning agents are ill-equipped to act in novel situations in which their domain model no longer accurately represents the world. We introduce an approach for such agents operating in open worlds that detects the presence of novelties and…

Artificial Intelligence · Computer Science 2023-03-28 Wiktor Piotrowski , Roni Stern , Yoni Sher , Jacob Le , Matthew Klenk , Johan deKleer , Shiwali Mohan

One of the main research areas in Artificial Intelligence is the coding of agents (programs) which are able to learn by themselves in any situation. This means that agents must be useful for purposes other than those they were created for,…

Artificial Intelligence · Computer Science 2011-02-04 Javier Insa-Cabrera , Jose Hernandez-Orallo

Model-based approaches bear great promise for decision making of agents interacting with the physical world. In the context of spatial environments, different types of problems such as localisation, mapping, navigation or autonomous…

Machine Learning · Statistics 2019-06-21 Atanas Mirchev , Baris Kayalibay , Maximilian Soelch , Patrick van der Smagt , Justin Bayer

In cooperative multiagent planning, it can often be beneficial for an agent to make commitments about aspects of its behavior to others, allowing them in turn to plan their own behaviors without taking the agent's detailed behavior into…

Artificial Intelligence · Computer Science 2017-03-16 Qi Zhang , Satinder Singh , Edmund Durfee

We discuss the possibility of world models and active exploration as emergent properties of open-ended behavior optimization in autonomous agents. In discussing the source of the open-endedness of living things, we start from the…

Neural and Evolutionary Computing · Computer Science 2024-11-20 Kazuya Horibe , Naoto Yoshida

The aim of my Ph.D. thesis concerns Reasoning in Highly Reactive Environments. As reasoning in highly reactive environments, we identify the setting in which a knowledge-based agent, with given goals, is deployed in an environment subject…

Artificial Intelligence · Computer Science 2019-09-19 Francesco Pacenza

Multi-agent systems are prevalent in a wide range of domains including power systems, vehicular networks, and robotics. Two important problems to solve in these types of systems are how the intentions of non-coordinating agents can be…

Multiagent Systems · Computer Science 2025-09-30 Benjamin Alcorn , Eman Hammad

Possibility theory is proposed as an uncertainty representation framework for distributed learning in multi-agent systems and robot swarms. In particular, we investigate its application to the best-of-n problem where the aim is for a…

Multiagent Systems · Computer Science 2020-01-22 Jonathan Lawry , Michael Crosscombe , David Harvey