English
Related papers

Related papers: Active Inference with a Self-Prior in the Mirror-M…

200 papers

Consider a prosthetic arm, learning to adapt to its user's control signals. We propose Interaction-Grounded Learning for this novel setting, in which a learner's goal is to interact with the environment with no grounding or explicit reward…

Machine Learning · Computer Science 2021-07-15 Tengyang Xie , John Langford , Paul Mineiro , Ida Momennejad

Exploration is a fundamental aspect of reinforcement learning (RL), and its effectiveness is a deciding factor in the performance of RL algorithms, especially when facing sparse extrinsic rewards. Recent studies have shown the effectiveness…

Machine Learning · Computer Science 2023-05-19 Shanchuan Wan , Yujin Tang , Yingtao Tian , Tomoyuki Kaneko

Inspired by infant development, we propose a Reinforcement Learning (RL) framework for autonomous self-exploration in a robotic agent, Baby Sophia, using the BabyBench simulation environment. The agent learns self-touch and hand regard…

Active systems across scales, ranging from molecular machines to human crowds, are usually modeled as assemblies of self-propelled particles driven by internally generated forces. However, these models often assume memoryless dynamics and…

Statistical Mechanics · Physics 2025-12-10 Marc Besse , Raphaël Voituriez

This paper presents a model of consciousness that follows directly from the free-energy principle (FEP). We first rehearse the classical and quantum formulations of the FEP. In particular, we consider the inner screen hypothesis that…

Neurons and Cognition · Quantitative Biology 2024-01-03 Maxwell J. D. Ramstead , Mahault Albarracin , Alex Kiefer , Brennan Klein , Chris Fields , Karl Friston , Adam Safron

The central tenet of reinforcement learning (RL) is that agents seek to maximize the sum of cumulative rewards. In contrast, active inference, an emerging framework within cognitive and computational neuroscience, proposes that agents act…

Machine Learning · Computer Science 2020-03-02 Alexander Tschantz , Beren Millidge , Anil K. Seth , Christopher L. Buckley

We present a method for active inference with partial observations in stochastic systems through incentive design, also known as the leader-follower game. Consider a leader agent who aims to infer a follower agent's type given a finite set…

Systems and Control · Electrical Eng. & Systems 2025-02-12 Xinyi Wei , Chongyang Shi , Shuo Han , Ahmed H. Hemida , Charles A. Kamhoua , Jie Fu

Humans perceive and interact with hundreds of objects every day. In doing so, they need to employ mental models of these objects and often exploit symmetries in the object's shape and appearance in order to learn generalizable and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Stefano Ferraro , Toon Van de Maele , Tim Verbelen , Bart Dhoedt

This paper proposes a minimalist three-layer model for artificial consciousness, focusing on the emergence of self-awareness. The model comprises a Cognitive Integration Layer, a Pattern Prediction Layer, and an Instinctive Response Layer,…

Neurons and Cognition · Quantitative Biology 2025-02-12 Kurando Iida

Large-scale black-box models have become ubiquitous across numerous applications. Understanding the influence of individual training data sources on predictions made by these models is crucial for improving their trustworthiness. Current…

Machine Learning · Computer Science 2024-06-21 Myeongseob Ko , Feiyang Kang , Weiyan Shi , Ming Jin , Zhou Yu , Ruoxi Jia

In this thesis we address two related aspects of visual object recognition: the use of motion information, and the use of internal supervision, to help unsupervised learning. These two aspects are inter-related in the current study, since…

Computer Vision and Pattern Recognition · Computer Science 2018-12-14 Daniel Harari

Current technologies have enabled us to track and quantify our physical state and behavior. Self-tracking aims to achieve increased awareness to decrease undesired behaviors and lead to a healthier lifestyle. However, inappropriately…

Human-Computer Interaction · Computer Science 2019-03-21 Monica Perusquía-Hernández , David Antonio Gómez Jáuregui , Marisabel Cuberos-Balda , Diego Paez-Granados

Reward-free data is abundant and contains rich prior knowledge of human behaviors, but it is not well exploited by offline reinforcement learning (RL) algorithms. In this paper, we propose UBER, an unsupervised approach to extract useful…

Machine Learning · Computer Science 2023-10-31 Hao Hu , Yiqin Yang , Jianing Ye , Ziqing Mai , Chongjie Zhang

Active perception approaches select future viewpoints by using some estimate of the information gain. An inaccurate estimate can be detrimental in critical situations, e.g., locating a person in distress. However the true information gained…

Robotics · Computer Science 2026-04-17 Siming He , Yuezhan Tao , Igor Spasojevic , Vijay Kumar , Pratik Chaudhari

This paper presents a self-supervised method for visual detection of the active speaker in a multi-person spoken interaction scenario. Active speaker detection is a fundamental prerequisite for any artificial cognitive system attempting to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Kalin Stefanov , Jonas Beskow , Giampiero Salvi

On social media, several individuals experiencing suicidal ideation (SI) do not disclose their distress explicitly. Instead, signs may surface indirectly through everyday posts or peer interactions. Detecting such implicit signals early is…

Social and Information Networks · Computer Science 2026-02-24 Soorya Ram Shimgekar , Ruining Zhao , Agam Goyal , Violeta J. Rodriguez , Paul A. Bloom , Navin Kumar , Hari Sundaram , Koustuv Saha

Extensive experiments in Human Movement Science suggest that solo motions are characterized by unique features that define the individuality or motor signature of people. While interacting with others, humans tend to spontaneously…

Neurons and Cognition · Quantitative Biology 2016-11-18 Chao Zhai , Michael Z. Q. Chen , Francesco Alderisio , Alexei Yu. Uteshev , Mario di Bernardo

Building upon prior framework of computational Lacanian psychoanalysis with the theory of active inference, this paper aims to further explore the concept of self-identification and its potential applications. Beginning with two classic…

Neurons and Cognition · Quantitative Biology 2024-03-13 Lingyu Li , Chunbo Li

Learning to infer labels in an open world, i.e., in an environment where the target "labels" are unknown, is an important characteristic for achieving autonomy. Foundation models pre-trained on enormous amounts of data have shown remarkable…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Sanjoy Kundu , Shubham Trehan , Sathyanarayanan N. Aakur

Humans excel in grasping objects through diverse and robust policies, many of which are so probabilistically rare that exploration-based learning methods hardly observe and learn. Inspired by the human learning process, we propose a method…

Robotics · Computer Science 2023-04-06 Chao Zhao , Chunli Jiang , Junhao Cai , Hongyu Yu , Michael Yu Wang , Qifeng Chen