English
Related papers

Related papers: A Framework for Inference Inspired by Human Memory…

200 papers

There has been much progress in data-driven artificial intelligence technology for medical image analysis in the last decades. However, it still remains challenging due to its distinctive complexity of acquiring and annotating image data,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Chao Gou , Tianyu Shen , Wenbo Zheng , Huadan Xue , Hui Yu , Qiang Ji , Zhengyu Jin , Fei-Yue Wang

This article provides an analytical framework for how to simulate human-like thought processes within a computer. It describes how attention and memory should be structured, updated, and utilized to search for associative additions to the…

Neurons and Cognition · Quantitative Biology 2024-11-15 Jared Edward Reser

Large language model (LLM) agents are constrained by limited context windows, necessitating external memory systems for long-term information understanding. Current memory-augmented agents typically depend on pre-defined instructions and…

Computation and Language · Computer Science 2025-10-01 Yu Wang , Ryuichi Takanobu , Zhiqi Liang , Yuzhen Mao , Yuanzhe Hu , Julian McAuley , Xiaojian Wu

Memory, a fundamental component of human cognition, exhibits adaptive yet fallible characteristics as illustrated by Schacter's memory "sins".These cognitive phenomena have been studied extensively in psychology and neuroscience, but the…

Neurons and Cognition · Quantitative Biology 2025-10-23 Zhaoyang Cao , Lael Schooler , Reza Zafarani

Language is crucial for human intelligence, but what exactly is its role? We take language to be a part of a system for understanding and communicating about situations. The human ability to understand and communicate about situations…

Computation and Language · Computer Science 2020-07-07 James L. McClelland , Felix Hill , Maja Rudolph , Jason Baldridge , Hinrich Schütze

The widespread use of deep neural networks has achieved substantial success in many tasks. However, there still exists a huge gap between the operating mechanism of deep learning models and human-understandable decision making, so that…

Artificial Intelligence · Computer Science 2021-03-08 Xiaowei Zhou , Jie Yin , Ivor Tsang , Chen Wang

Large language models (LLMs) power many interactive systems such as chatbots, customer-service agents, and personal assistants. In knowledge-intensive scenarios requiring user-specific personalization, conventional retrieval-augmented…

Artificial Intelligence · Computer Science 2026-01-13 Hailong Li , Feifei Li , Wenhui Que , Xingyu Fan

Artificial intelligence has advanced significantly through deep learning, reinforcement learning, and large language and vision models. However, these systems often remain task specific, struggle to adapt to changing conditions, and cannot…

Neurons and Cognition · Quantitative Biology 2025-10-17 Noorbakhsh Amiri Golilarz , Hassan S. Al Khatib , Shahram Rahimi

Variational inference (VI) has become the method of choice for fitting many modern probabilistic models. However, practitioners are faced with a fragmented literature that offers a bewildering array of algorithmic options. First, the…

Machine Learning · Statistics 2018-11-29 Thang D. Bui , Cuong V. Nguyen , Siddharth Swaroop , Richard E. Turner

Knowledge Tracing (KT) models students' evolving knowledge states to predict future performance, serving as a foundation for personalized education. While traditional deep learning models achieve high accuracy, they often lack…

Computation and Language · Computer Science 2026-03-25 Runze Li , Kedi Chen , Guwei Feng , Mo Yu , Jun Wang , Wei Zhang

Bridging continuous perceptual signals and discrete symbolic reasoning is a fundamental challenge in AI systems that must operate under uncertainty. We present a neuro-symbolic framework that explicitly models and propagates uncertainty…

Artificial Intelligence · Computer Science 2025-11-19 Jiahao Wu , Shengwen Yu

In modern human-robot collaboration (HRC) applications, multiple perception modules jointly extract visual, auditory, and contextual cues to achieve comprehensive scene understanding, enabling the robot to provide appropriate assistance to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Dingcheng Huang , Xiaotong Zhang , Kamal Youcef-Toumi

Neural reasoners such as Tiny Recursive Models (TRMs) solve complex problems by combining neural backbones with specialized inference schemes. Such inference schemes have been a central component of stochastic reasoning systems, where…

Machine Learning · Computer Science 2026-03-06 Mieszko Komisarczyk , Saurabh Mathur , Maurice Kraus , Sriraam Natarajan , Kristian Kersting

To produce accurate predictions, language models (LMs) must balance between generalization and memorization. Yet, little is known about the mechanism by which transformer LMs employ their memorization capacity. When does a model decide to…

Computation and Language · Computer Science 2023-02-14 Adi Haviv , Ido Cohen , Jacob Gidron , Roei Schuster , Yoav Goldberg , Mor Geva

Recurrent Neural Networks (RNNs) have achieved remarkable performance on a range of tasks. A key step to further empowering RNN-based approaches is improving their explainability and interpretability. In this work we present MEME: a model…

Machine Learning · Computer Science 2021-04-15 Dmitry Kazhdan , Botty Dimanov , Mateja Jamnik , Pietro Liò

Real-time human-artificial intelligence (AI) collaboration is crucial yet challenging, especially when AI agents must adapt to diverse and unseen human behaviors in dynamic scenarios. Existing large language model (LLM) agents often fail to…

Machine Learning · Computer Science 2025-07-21 Xiyun Li , Yining Ding , Yuhua Jiang , Yunlong Zhao , Runpeng Xie , Shuang Xu , Yuanhua Ni , Yiqin Yang , Bo Xu

Large language models (LLMs) have emerged as effective action policies for sequential decision-making (SDM) tasks due to their extensive prior knowledge. However, this broad yet general knowledge is often insufficient for specific…

Machine Learning · Computer Science 2025-10-01 Xue Yan , Zijing Ou , Mengyue Yang , Yan Song , Haifeng Zhang , Yingzhen Li , Jun Wang

Transformer-based models have achieved state-of-the-art results in many natural language processing tasks. The self-attention architecture allows transformer to combine information from all elements of a sequence into context-aware…

Computation and Language · Computer Science 2021-02-17 Mikhail S. Burtsev , Yuri Kuratov , Anton Peganov , Grigory V. Sapunov

Large language models (LLMs) excel on a variety of reasoning benchmarks, but previous studies suggest they sometimes struggle to generalize to unseen questions, potentially due to over-reliance on memorized training examples. However, the…

Computation and Language · Computer Science 2025-04-01 Yihuai Hong , Dian Zhou , Meng Cao , Lei Yu , Zhijing Jin

Reconstructing past events requires reasoning across long time horizons. To figure out what happened, we need to use our prior knowledge about the world and human behavior and draw inferences from various sources of evidence including…