English
Related papers

Related papers: General Agents Contain World Models, even under Pa…

200 papers

Biological agents have adopted the principle of attention to limit the rate of incoming information from the environment. One question that arises is if an artificial agent has access to only a limited view of its surroundings, how can it…

Artificial Intelligence · Computer Science 2021-03-12 Himanshu Sahni , Charles Isbell

Stochastic models in which agents interact with their neighborhood according to a network topology are a powerful modeling framework to study the emergence of complex dynamic patterns in real-world systems. Stochastic simulations are often…

Social and Information Networks · Computer Science 2021-01-27 Gerrit Großmann , Luca Bortolussi , Verena Wolf

Collective intelligence is a fundamental trait shared by several species of living organisms. It has allowed them to thrive in the diverse environmental conditions that exist on our planet. From simple organisations in an ant colony to…

Machine Learning · Computer Science 2022-02-22 Anuj Mahajan , Mikayel Samvelyan , Tarun Gupta , Benjamin Ellis , Mingfei Sun , Tim Rocktäschel , Shimon Whiteson

How can agents learn internal models that veridically represent interactions with the real world is a largely open question. As machine learning is moving towards representations containing not just observational but also interventional…

Machine Learning · Computer Science 2024-07-03 Hamza Keurti , Hsiao-Ru Pan , Michel Besserve , Benjamin F. Grewe , Bernhard Schölkopf

The next generation of autonomous agents must not only learn efficiently but also act reliably and adapt their behavior in open worlds. Standard approaches typically assume fixed tasks and environments with little or no novelty, which…

Machine Learning · Computer Science 2026-03-02 Florent Delgrange

Ensuring artificial intelligence behaves in such a way that is aligned with human values is commonly referred to as the alignment challenge. Prior work has shown that rational agents, behaving in such a way that maximizes a utility…

Artificial Intelligence · Computer Science 2024-02-16 Paulo Garcia

World modelling, i.e. building a representation of the rules that govern the world so as to predict its evolution, is an essential ability for any agent interacting with the physical world. Despite their impressive performance, many…

Machine Learning · Computer Science 2025-05-06 Francesco Petri , Luigi Asprino , Aldo Gangemi

Most of the grand challenges of humanity today involve complex agent-based systems, such as epidemiology, economics or ecology. However, remains as a pending task the challenge of identifying the general principles underlying their…

General Finance · Quantitative Finance 2020-10-19 Martin Jaraiz

A sequential decision-making agent balances between exploring to gain new knowledge about an environment and exploiting current knowledge to maximize immediate reward. For environments studied in the traditional literature, optimal…

Machine Learning · Computer Science 2024-07-23 Dilip Arumugam , Wanqiao Xu , Benjamin Van Roy

The last few years have witnessed substantial progress in the field of embodied AI where artificial agents, mirroring biological counterparts, are now able to learn from interaction to accomplish complex tasks. Despite this success,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Sarah Pratt , Luca Weihs , Ali Farhadi

The question of what global information must distributed rational agents a-priori know about the network in order for equilibrium to be possible is researched here. Until now, distributed algorithms with rational agents have assumed that…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-10 Yehuda Afek , Shaked Rafaeli , Moshe Sulamy

The ability to learn a model is essential for the success of autonomous agents. Unfortunately, learning a model is difficult in partially observable environments, where latent environmental factors influence what the agent observes. In the…

Robotics · Computer Science 2016-08-03 Nikolas J. Hemion

Cognitive scientists believe adaptable intelligent agents like humans perform reasoning through learned causal mental simulations of agents and environments. The problem of learning such simulations is called predictive world modeling.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Robin Karlsson , Alexander Carballo , Keisuke Fujii , Kento Ohtani , Kazuya Takeda

Stochastic models share many characteristics with generic parametric models. In some ways they can be regarded as a special case. But for stochastic models there is a notion of weak distribution or generalised random variable, and the same…

Numerical Analysis · Mathematics 2018-09-05 Hermann G. Matthies

Starting from the Minority Game and building more and more sophisticated models of adaptive agents, we show that minority mechanisms underly any model where agents learn collectively a resource level that can be either obvious and constant…

Statistical Mechanics · Physics 2009-11-10 Damien Challet

Adapting a Reinforcement Learning (RL) agent to an unseen environment is a difficult task due to typical over-fitting on the training environment. RL agents are often capable of solving environments very close to the trained environment,…

Artificial Intelligence · Computer Science 2022-07-04 Olivier Moulin , Vincent Francois-Lavet , Paul Elbers , Mark Hoogendoorn

We present a first approximation of agent behaviour in a generalized model in contract theory. This model relaxes some of the the assumptions of one of the classical models allowing to include a broader range of agents. We introduce the…

Optimization and Control · Mathematics 2011-07-15 Francisco Gutiérrez , Camilo Argoty , Stefany Moreno

Training intelligent agents that can drive autonomously in various urban and highway scenarios has been a hot topic in the robotics society within the last decades. However, the diversity of driving environments in terms of road topology…

Robotics · Computer Science 2022-04-06 Behrad Toghi , Rodolfo Valiente , Ramtin Pedarsani , Yaser P. Fallah

Representations are internal models of the environment that can provide guidance to a behaving agent, even in the absence of sensory information. It is not clear how representations are developed and whether or not they are necessary or…

Neurons and Cognition · Quantitative Biology 2013-08-07 Lars Marstaller , Arend Hintze , Christoph Adami

Explaining the behavior of a black box machine learning model at the instance level is useful for building trust. However, it is also important to understand how the model behaves globally. Such an understanding provides insight into both…

Artificial Intelligence · Computer Science 2018-06-18 Nikaash Puri , Piyush Gupta , Pratiksha Agarwal , Sukriti Verma , Balaji Krishnamurthy