English
Related papers

Related papers: Curiosity is Knowledge: Self-Consistent Learning a…

200 papers

Efficient exploration is a long-standing problem in sensorimotor learning. Major advances have been demonstrated in noise-free, non-stochastic domains such as video games and simulation. However, most of these formulations either get stuck…

Machine Learning · Computer Science 2019-06-11 Deepak Pathak , Dhiraj Gandhi , Abhinav Gupta

The central tenet of reinforcement learning (RL) is that agents seek to maximize the sum of cumulative rewards. In contrast, active inference, an emerging framework within cognitive and computational neuroscience, proposes that agents act…

Machine Learning · Computer Science 2020-03-02 Alexander Tschantz , Beren Millidge , Anil K. Seth , Christopher L. Buckley

Is there a canonical way to think of agency beyond reward maximisation? In this paper, we show that any type of behaviour complying with physically sound assumptions about how macroscopic biological agents interact with the world…

Artificial Intelligence · Computer Science 2024-01-24 Lancelot Da Costa , Samuel Tenka , Dominic Zhao , Noor Sajid

Active inference is a unifying theory for perception and action resting upon the idea that the brain maintains an internal model of the world by minimizing free energy. From a behavioral perspective, active inference agents can be seen as…

Machine Learning · Computer Science 2024-01-17 Pietro Mazzaglia , Tim Verbelen , Bart Dhoedt

Obtaining labels can be costly and time-consuming. Active learning allows a learning algorithm to intelligently query samples to be labeled for efficient learning. Fisher information ratio (FIR) has been used as an objective for selecting…

Machine Learning · Statistics 2016-10-18 Jamshid Sourati , Murat Akcakaya , Todd K. Leen , Deniz Erdogmus , Jennifer G. Dy

We study the problem of guaranteeing low regret in repeated games against an opponent with unknown membership in one of several classes. We add the constraint that our algorithm is non-exploitable, in that the opponent lacks an incentive to…

Computer Science and Game Theory · Computer Science 2022-07-05 Anthony DiGiovanni , Ambuj Tewari

Although there are many approaches to implement intrinsically motivated artificial agents, the combined usage of multiple intrinsic drives remains still a relatively unexplored research area. Specifically, we hypothesize that a mechanism…

Artificial Intelligence · Computer Science 2018-06-19 Ildefons Magrans de Abril , Ryota Kanai

Background: Exploration of the physical environment is an indispensable precursor to information acquisition and knowledge consolidation for living organisms. Yet, current artificial intelligence models lack these autonomy capabilities…

Artificial Intelligence · Computer Science 2025-09-10 Gustavo Assunção , Miguel Castelo-Branco , Paulo Menezes

What are the functions of curiosity? What are the mechanisms of curiosity-driven learning? We approach these questions about the living using concepts and tools from machine learning and developmental robotics. We argue that…

Artificial Intelligence · Computer Science 2018-06-19 Pierre-Yves Oudeyer

Autonomous agents powered by LLMs and Retrieval-Augmented Generation (RAG) are proficient consumers of digital content but remain unidirectional, a limitation we term epistemic asymmetry. This isolation leads to redundant reasoning and…

Artificial Intelligence · Computer Science 2025-12-25 Zan-Kai Chong , Hiroyuki Ohsaki , Bryan Ng

High-level theories rooted in the Bayesian Brain Hypothesis often frame cognitive effort as the cost of resolving the conflict between habits and optimal policies. In parallel, evidence accumulator models (EAMs) provide a mechanistic…

Neurons and Cognition · Quantitative Biology 2025-09-15 Alvaro Garrido Perez , Viktor Lemoine , Amrapali Pednekar , Yara Khaluf , Pieter Simoens

Deploying deep neural networks on resource-constrained devices faces two critical challenges: maintaining accuracy under aggressive quantization while ensuring predictable inference latency. We present a curiosity-driven quantized…

The design of recommendations strategies in the adaptive learning system focuses on utilizing currently available information to provide individual-specific learning instructions for learners. As a critical motivate for human behaviors,…

Computers and Society · Computer Science 2019-10-29 Ruijian Han , Kani Chen , Chunxi Tan

Active inference is a first principle account of how autonomous agents operate in dynamic, non-stationary environments. This problem is also considered in reinforcement learning (RL), but limited work exists on comparing the two approaches…

Artificial Intelligence · Computer Science 2021-02-15 Noor Sajid , Philip J. Ball , Thomas Parr , Karl J. Friston

Adaptive decision-making in biological and artificial intelligence requires balancing the exploitation of known outcomes with the exploration of uncertain alternatives. Although prior work suggests that uncertainty generally promotes…

Artificial Intelligence · Computer Science 2026-05-20 Payam Piray

This chapter examines the relationship between curiosity and metacognition as critical drivers of autonomous and self-regulated learning. We synthesize recent research to propose a unified framework integrating behavioral, computational,…

Computers and Society · Computer Science 2026-04-29 Chloé Desvaux , Rania Abdelghani , Pierre-Yves Oudeyer , Hélène Sauzéon

In the last decade, the free energy principle (FEP) and active inference (AIF) have achieved many successes connecting conceptual models of learning and cognition to mathematical models of perception and action. This effort is driven by a…

Artificial Intelligence · Computer Science 2024-11-25 Joséphine Pazem , Marius Krumm , Alexander Q. Vining , Lukas J. Fiderer , Hans J. Briegel

Estimating the Conditional Average Treatment Effect (CATE) is often constrained by the high cost of obtaining outcome measurements, making active learning essential. However, conventional active learning strategies suffer from a fundamental…

Machine Learning · Statistics 2025-09-29 Erdun Gao , Jake Fawkes , Dino Sejdinovic

Curiosity is a vital metacognitive skill in educational contexts. Yet, little is known about how social factors influence curiosity in group work. We argue that curiosity is evoked not only through individual, but also interpersonal…

Human-Computer Interaction · Computer Science 2017-10-24 Tanmay Sinha , Zhen Bai , Justine Cassell

A default assumption in the design of reinforcement-learning algorithms is that a decision-making agent always explores to learn optimal behavior. In sufficiently complex environments that approach the vastness and scale of the real world,…

Machine Learning · Computer Science 2024-07-23 Dilip Arumugam , Saurabh Kumar , Ramki Gummadi , Benjamin Van Roy