English
Related papers

Related papers: Active Inference as a Model of Agency

200 papers

This paper argues that model-free reinforcement learning (RL) agents, while lacking explicit planning mechanisms, exhibit behaviours that can be analogised to System 1 ("thinking fast") processes in human cognition. Unlike model-based RL…

Artificial Intelligence · Computer Science 2025-01-31 Hal Ashton , Matija Franklin

Autonomous agents (robots) face tremendous challenges while interacting with heterogeneous human agents in close proximity. One of these challenges is that the autonomous agent does not have an accurate model tailored to the specific human…

Robotics · Computer Science 2023-04-25 Shuangge Wang , Yiwei Lyu , John M. Dolan

It is well known that reinforcement learning can be cast as inference in an appropriate probabilistic model. However, this commonly involves introducing a distribution over agent trajectories with probabilities proportional to exponentiated…

Artificial Intelligence · Computer Science 2021-10-07 David Tolpin , Tomer Dobkin

The ability of modeling the other agents, such as understanding their intentions and skills, is essential to an agent's interactions with other agents. Conventional agent modeling relies on passive observation from demonstrations. In this…

Artificial Intelligence · Computer Science 2018-10-02 Tianmin Shu , Caiming Xiong , Ying Nian Wu , Song-Chun Zhu

Active systems across scales, ranging from molecular machines to human crowds, are usually modeled as assemblies of self-propelled particles driven by internally generated forces. However, these models often assume memoryless dynamics and…

Statistical Mechanics · Physics 2025-12-10 Marc Besse , Raphaël Voituriez

Evidence-based decision-making entails collecting (costly) observations about an underlying phenomenon of interest, and subsequently committing to an (informed) decision on the basis of accumulated evidence. In this setting, active sensing…

Machine Learning · Statistics 2020-06-26 Daniel Jarrett , Mihaela van der Schaar

We focus on how individual behavior that complies with social norms interferes with performance-based incentive mechanisms in organizations with multiple distributed decision-making agents. We model social norms to emerge from interactions…

General Economics · Economics 2021-02-25 Ravshanbek Khodzhimatov , Stephan Leitner , Friederike Wall

A default assumption in the design of reinforcement-learning algorithms is that a decision-making agent always explores to learn optimal behavior. In sufficiently complex environments that approach the vastness and scale of the real world,…

Machine Learning · Computer Science 2024-07-23 Dilip Arumugam , Saurabh Kumar , Ramki Gummadi , Benjamin Van Roy

Tax evasion, usually the largest component of an informal economy, is a persistent challenge over history with significant socio-economic implications. Many socio-economic studies investigate its dynamics, including influencing factors, the…

Information Retrieval · Computer Science 2025-09-03 Teddy Lazebnik , Labib Shami

Advanced reasoning models with agentic capabilities (AI agents) are deployed to interact with humans and to solve sequential decision-making problems under (approximate) utility functions and internal models. When such problems have…

Artificial Intelligence · Computer Science 2025-09-25 Daniel Jarne Ornia , Nicholas Bishop , Joel Dyer , Wei-Chen Lee , Ani Calinescu , Doyne Farmer , Michael Wooldridge

Modeling the complex interactions of systems of particles or agents is a fundamental scientific and mathematical problem that is studied in diverse fields, ranging from physics and biology, to economics and machine learning. In this work,…

Machine Learning · Statistics 2020-10-09 Jason Miller , Sui Tang , Ming Zhong , Mauro Maggioni

Developing autonomous agents that quickly explore an environment and adapt their behavior online is a canonical challenge in robotics and machine learning. While humans are able to achieve such fast online exploration and adaptation, often…

Machine Learning · Computer Science 2025-07-15 Andrew Wagenmaker , Zhiyuan Zhou , Sergey Levine

Capturing and simulating intelligent adaptive behaviours within spatially explicit individual-based models remains an ongoing challenge for researchers. While an ever-increasing abundance of real-world behavioural data are collected, few…

Multiagent Systems · Computer Science 2022-01-05 Sedar Olmez , Dan Birks , Alison Heppenstall

Social dilemmas are situations where groups of individuals can benefit from mutual cooperation but conflicting interests impede them from doing so. This type of situations resembles many of humanity's most critical challenges, and…

Machine Learning · Computer Science 2023-05-22 Manuel Rios , Nicanor Quijano , Luis Felipe Giraldo

A formal but intuitive framework is introduced to bridge the gap between data obtained from empirical studies and that generated by agent-based models. This is based on three key tenets. Firstly, a simulation can be given multiple formal…

Multiagent Systems · Computer Science 2013-02-21 Chih-Chun Chen

Continual learning is often motivated by the idea, known as the big world hypothesis, that "the world is bigger" than the agent. Recent problem formulations capture this idea by explicitly constraining an agent relative to the environment.…

Artificial Intelligence · Computer Science 2025-12-30 Alex Lewandowski , Adtiya A. Ramesh , Edan Meyer , Dale Schuurmans , Marlos C. Machado

Training a model-free reinforcement learning agent requires allowing the agent to sufficiently explore the environment to search for an optimal policy. In safety-constrained environments, utilizing unsupervised exploration or a non-optimal…

Artificial Intelligence · Computer Science 2024-08-05 Erfan Entezami , Mahsa Sahebdel , Dhawal Gupta

Agent-based modeling is a powerful simulation technique to understand the collective behavior and microscopic interaction in complex financial systems. Recently, the concept for determining the key parameters of the agent-based models from…

Statistical Finance · Quantitative Finance 2017-03-21 T. T. Chen , B. Zheng , Y. Li , X. F. Jiang

Collective motion is ubiquitous in nature; groups of animals, such as fish, birds, and ungulates appear to move as a whole, exhibiting a rich behavioral repertoire that ranges from directed movement to milling to disordered swarming.…

Adaptation and Self-Organizing Systems · Physics 2024-05-15 Conor Heins , Beren Millidge , Lancelot da Costa , Richard Mann , Karl Friston , Iain Couzin

Model-based Reinforcement Learning approaches have the promise of being sample efficient. Much of the progress in learning dynamics models in RL has been made by learning models via supervised learning. But traditional model-based…

Machine Learning · Computer Science 2019-06-12 Shagun Sodhani , Anirudh Goyal , Tristan Deleu , Yoshua Bengio , Sergey Levine , Jian Tang