English
Related papers

Related papers: Attention or memory? Neurointerpretable agents in …

200 papers

In this work, we consider the problem of computing optimal actions for Reinforcement Learning (RL) agents in a co-operative setting, where the objective is to optimize a common goal. However, in many real-life applications, in addition to…

Artificial Intelligence · Computer Science 2021-01-08 P. Parnika , Raghuram Bharadwaj Diddigi , Sai Koti Reddy Danda , Shalabh Bhatnagar

Bottom-Up (BU) saliency models do not perform well in complex interactive environments where humans are actively engaged in tasks (e.g., sandwich making and playing the video games). In this paper, we leverage Reinforcement Learning (RL) to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Sajad Mousavi , Michael Schukat , Enda Howley , Ali Borji , Nasser Mozayani

The central tenet of reinforcement learning (RL) is that agents seek to maximize the sum of cumulative rewards. In contrast, active inference, an emerging framework within cognitive and computational neuroscience, proposes that agents act…

Machine Learning · Computer Science 2020-03-02 Alexander Tschantz , Beren Millidge , Anil K. Seth , Christopher L. Buckley

While the Self-Attention mechanism in the Transformer model has proven to be effective in many domains, we observe that it is less effective in more diverse settings (e.g. multimodality) due to the varying granularity of each token and the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Wayner Barrios , SouYoung Jin

Replay is a powerful strategy to promote learning in artificial intelligence and the brain. However, the conditions to generate it and its functional advantages have not been fully recognized. In this study, we develop a modular…

Systems and Control · Electrical Eng. & Systems 2024-10-08 Jiyi Wang , Likai Tang , Huimiao Chen , Marcelo G Mattar , Sen Song

Recent progress in NLP witnessed the development of large-scale pre-trained language models (GPT, BERT, XLNet, etc.) based on Transformer (Vaswani et al. 2017), and in a range of end tasks, such models have achieved state-of-the-art…

Computation and Language · Computer Science 2019-11-12 Pengxiang Cheng , Katrin Erk

Self-trained autonomous agents developed using machine learning are showing great promise in a variety of control settings, perhaps most remarkably in applications involving autonomous vehicles. The main challenge associated with…

Machine Learning · Computer Science 2022-11-11 Patrik Hammersborg , Inga Strümke

The brain's attention system is a complex and adaptive network of brain regions that enables individuals to interact effectively with their surroundings and perform complex tasks. This system involves the coordination of various brain…

Human-Computer Interaction · Computer Science 2024-05-03 Shiva Ghasemi , Majid Behravan , Sunday Uber , Denis Gracanin

Human visual system can selectively attend to parts of a scene for quick perception, a biological mechanism known as Human attention. Inspired by this, recent deep learning models encode attention mechanisms to focus on the most…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Qiuxia Lai , Salman Khan , Yongwei Nie , Jianbing Shen , Hanqiu Sun , Ling Shao

This paper investigates whether learning contingency-awareness and controllable aspects of an environment can lead to better exploration in reinforcement learning. To investigate this question, we consider an instantiation of this…

Machine Learning · Computer Science 2019-03-05 Jongwook Choi , Yijie Guo , Marcin Moczulski , Junhyuk Oh , Neal Wu , Mohammad Norouzi , Honglak Lee

Autonomous artificial agents must be able to learn behaviors in complex environments without humans to design tasks and rewards. Designing these functions for each environment is not feasible, thus, motivating the development of intrinsic…

Machine Learning · Computer Science 2025-02-20 Alana Santana , Paula P. Costa , Esther L. Colombini

Text-based reinforcement learning involves an agent interacting with a fictional environment using observed text and admissible actions in natural language to complete a task. Previous works have shown that agents can succeed in text-based…

Computation and Language · Computer Science 2024-04-17 Mauricio Gruppi , Soham Dan , Keerthiram Murugesan , Subhajit Chaudhury

Deep reinforcement learning (DRL) has shown incredible performance in learning various tasks to the human level. However, unlike human perception, current DRL models connect the entire low-level sensory input to the state-action values…

Machine Learning · Computer Science 2017-12-14 Jinyoung Choi , Beom-Jin Lee , Byoung-Tak Zhang

Object-based attention is a key component of the visual system, relevant for perception, learning, and memory. Neurons tuned to features of attended objects tend to be more active than those associated with non-attended objects. There is a…

Neurons and Cognition · Quantitative Biology 2021-06-09 Jordan Lei , Ari S. Benjamin , Konrad P. Kording

Speech Emotion Recognition (SER) plays a key role in advancing human-computer interaction. Attention mechanisms have become the dominant approach for modeling emotional speech due to their ability to capture long-range dependencies and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-17 Marc Casals-Salvador , Federico Costa , Rodolfo Zevallos , Javier Hernando

Effective decision-making in the real world depends on memory that is both stable and adaptive: environments change over time, and agents must retain relevant information over long horizons while also updating or overwriting outdated…

Machine Learning · Computer Science 2026-01-22 Oleg Shchendrigin , Egor Cherepanov , Alexey K. Kovalev , Aleksandr I. Panov

Pervasive and ubiquitous computing facilitates immediate access to information in the sense of always-on. Information such as news, messages, or reminders can significantly enhance our daily routines but are rendered useless or disturbing…

Human-Computer Interaction · Computer Science 2022-12-20 Christoph Anderson , Judith Simone Heinisch , Shohreh Deldari , Flora D. Salim , Sandra Ohly , Klaus David , Veljko Pejovic

Recent work in computational psycholinguistics has revealed intriguing parallels between attention mechanisms and human memory retrieval, focusing primarily on vanilla Transformers that operate on token-level representations. However,…

Computation and Language · Computer Science 2025-08-20 Ryo Yoshida , Shinnosuke Isono , Kohei Kajikawa , Taiga Someya , Yushi Sugimoto , Yohei Oseki

Sequential modelling with self-attention has achieved cutting edge performances in natural language processing. With advantages in model flexibility, computation complexity and interpretability, self-attention is gradually becoming a key…

Machine Learning · Computer Science 2019-12-02 Da Xu , Chuanwei Ruan , Sushant Kumar , Evren Korpeoglu , Kannan Achan

Attributional inference, the ability to predict latent intentions behind observed actions, is a critical yet underexplored capability for large language models (LLMs) operating in multi-agent environments. Traditional natural language…

Computation and Language · Computer Science 2026-01-14 Xin Quan , Jiafeng Xiong , Marco Valentino , André Freitas