English
Related papers

Related papers: Active Inference through Incentive Design in Marko…

200 papers

In this paper we introduce a general estimation methodology for learning a model of human perception and control in a sensorimotor control task based upon a finite set of demonstrations. The model's structure consists of i the agent's…

Machine Learning · Computer Science 2025-05-02 Ran Wei , Anthony D. McDonald , Alfredo Garcia , Gustav Markkula , Johan Engstrom , Matthew O'Kelly

Efficient exploration remains a challenging problem in reinforcement learning, especially for those tasks where rewards from environments are sparse. A commonly used approach for exploring such environments is to introduce some "intrinsic"…

Machine Learning · Computer Science 2020-07-16 Neale Ratzlaff , Qinxun Bai , Li Fuxin , Wei Xu

We develop an active inference route-planning method for the autonomous control of intelligent agents. The aim is to reconnoiter a geographical area to maintain a common operational picture. To achieve this, we construct an evidence map…

Artificial Intelligence · Computer Science 2025-10-21 Johan Schubert , Farzad Kamrani , Tove Gustavi

Evidence-based decision-making entails collecting (costly) observations about an underlying phenomenon of interest, and subsequently committing to an (informed) decision on the basis of accumulated evidence. In this setting, active sensing…

Machine Learning · Statistics 2020-06-26 Daniel Jarrett , Mihaela van der Schaar

Imitation is widely observed in populations of decision-making agents. Using our recent convergence results for asynchronous imitation dynamics on networks, we consider how such networks can be efficiently driven to a desired equilibrium…

Computer Science and Game Theory · Computer Science 2017-04-17 James Riehl , Pouria Ramazi , Ming Cao

We investigate the application of active inference in developing energy-efficient control agents for manufacturing systems. Active inference, rooted in neuroscience, provides a unified probabilistic framework integrating perception,…

Machine Learning · Computer Science 2025-05-28 Yavar Taheri Yeganeh , Mohsen Jafari , Andrea Matta

In this work, we investigate a steering problem in a mediator-augmented two-player normal-form game, where the mediator aims to guide players toward a specific action profile through information and incentive design. We first characterize…

Computer Science and Game Theory · Computer Science 2025-09-01 Asrin Efe Yorulmaz , Raj Kiriti Velicheti , Melih Bastopcu , Tamer Başar

Strategic classification studies the problem where self-interested individuals or agents manipulate their response to obtain favorable decision outcomes made by classifiers, typically turning to dishonest actions when they are less costly…

Machine Learning · Computer Science 2026-05-07 Ziyuan Huang , Lina Alkarmi , Mingyan Liu

We pose an active perception problem where an autonomous agent actively interacts with a second agent with potentially adversarial behaviors. Given the uncertainty in the intent of the other agent, the objective is to collect further…

Artificial Intelligence · Computer Science 2019-09-20 Macheng Shen , Jonathan P How

This technical note considers the sampling of outcomes that provide the greatest amount of information about the structure of underlying world models. This generalisation furnishes a principled approach to structure learning under a…

Neurons and Cognition · Quantitative Biology 2025-12-25 Karl Friston , Lancelot Da Costa , Alexander Tschantz , Conor Heins , Christopher Buckley , Tim Verbelen , Thomas Parr

Although research has produced promising results demonstrating the utility of active inference (AIF) in Markov decision processes (MDPs), there is relatively less work that builds AIF models in the context of environments and problems that…

Robotics · Computer Science 2024-09-24 Viet Dung Nguyen , Zhizhuo Yang , Christopher L. Buckley , Alexander Ororbia

In many scenarios, a principal dynamically interacts with an agent and offers a sequence of incentives to align the agent's behavior with a desired objective. This paper focuses on the problem of synthesizing an incentive sequence that,…

Optimization and Control · Mathematics 2020-07-20 Yagiz Savas , Vijay Gupta , Ufuk Topcu

Complex behaviors are often driven by an internal model, which integrates sensory information over time and facilitates long-term planning. Inferring an agent's internal model is a crucial ingredient in social interactions (theory of mind),…

Machine Learning · Computer Science 2019-06-13 Zhengwei Wu , Paul Schrater , Xaq Pitkow

This paper studies the synthesis of a joint control and active perception policy for a stochastic system modeled as a partially observable Markov decision process (POMDP), subject to temporal logic specifications. The POMDP actions…

Systems and Control · Electrical Eng. & Systems 2025-04-21 Chongyang Shi , Michael R. Dorothy , Jie Fu

As electrical generation becomes more distributed and volatile, and loads become more uncertain, controllability of distributed energy resources (DERs), regardless of their ownership status, will be necessary for grid reliability. Grid…

Systems and Control · Electrical Eng. & Systems 2024-10-22 Adam Lechowicz , Joshua Comden , Andrey Bernstein

Active inference is an ambitious theory that treats perception, inference and action selection of autonomous agents under the heading of a single principle. It suggests biologically plausible explanations for many cognitive phenomena,…

Artificial Intelligence · Computer Science 2018-06-22 Martin Biehl , Christian Guckelsberger , Christoph Salge , Simón C. Smith , Daniel Polani

Designing incentives for an adapting population is a ubiquitous problem in a wide array of economic applications and beyond. In this work, we study how to design additional rewards to steer multi-agent systems towards desired policies…

Machine Learning · Computer Science 2025-02-11 Jiawei Huang , Vinzenz Thoma , Zebang Shen , Heinrich H. Nax , Niao He

Reward design is a critical part of the application of reinforcement learning, the performance of which strongly depends on how well the reward signal frames the goal of the designer and how well the signal assesses progress in reaching…

Machine Learning · Computer Science 2022-08-01 Yixiang Wang , Yujing Hu , Feng Wu , Yingfeng Chen

In this work, we study the problem of actively classifying the attributes of dynamical systems characterized as a finite set of Markov decision process (MDP) models. We are interested in finding strategies that actively interact with the…

Systems and Control · Electrical Eng. & Systems 2023-01-06 Bo Wu , Niklas Lauffer , Mohamadreza Ahmadi , Suda Bharadwaj , Zhe Xu , Ufuk Topcu

This work considers a novel information design problem and studies how the craft of payoff-relevant environmental signals solely can influence the behaviors of intelligent agents. The agents' strategic interactions are captured by an…

Multiagent Systems · Computer Science 2021-02-16 Tao Zhang , Quanyan Zhu