English
Related papers

Related papers: Human-inspired Episodic Memory for Infinite Contex…

200 papers

Memory-augmented Large Language Models (LLMs) have demonstrated remarkable performance in long-term human-machine interactions, which basically relies on iterative recalling and reasoning of history to generate high-quality responses.…

Computation and Language · Computer Science 2023-11-16 Lei Liu , Xiaoyan Yang , Yue Shen , Binbin Hu , Zhiqiang Zhang , Jinjie Gu , Guannan Zhang

Event relations are crucial for narrative understanding and reasoning. Governed by nuanced logic, event relation extraction (ERE) is a challenging task that demands thorough semantic understanding and rigorous logical reasoning. In this…

Artificial Intelligence · Computer Science 2024-08-12 Meiqi Chen , Yubo Ma , Kaitao Song , Yixin Cao , Yan Zhang , Dongsheng Li

In-context learning (ICL) is critical for large language models (LLMs), but its effectiveness is constrained by finite context windows, particularly in ultra-long contexts. To overcome this, we introduce InfiniteICL, a framework that…

Computation and Language · Computer Science 2025-04-04 Bowen Cao , Deng Cai , Wai Lam

Event log analysis is an important task that security professionals undertake. Event logs record key information on activities that occur on computing devices, and due to the substantial number of events generated, they consume a large…

Artificial Intelligence · Computer Science 2025-02-04 Siraaj Akhtar , Saad Khan , Simon Parkinson

Large Language Model (LLM)-based Vision-Language Models (VLMs) have substantially extended the boundaries of visual understanding capabilities. However, their high computational demands hinder deployment on resource-constrained edge…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Haotong Qin , Cheng Hu , Michele Magno

Intelligent systems must maintain and manipulate task-relevant information online to adapt to dynamic environments and changing goals. This capacity, known as working memory, is fundamental to human reasoning and intelligence. Despite…

Machine Learning · Computer Science 2026-04-14 Hua-Dong Xiong , Li Ji-An , Jiaqi Huang , Robert C. Wilson , Kwonjoon Lee , Xue-Xin Wei

Large Language Models (LLMs) face fundamental limitations in context management despite recent advances extending context windows to millions of tokens. We propose Cognitive Workspace, a novel paradigm that transcends traditional…

Artificial Intelligence · Computer Science 2025-08-20 Tao An

Existing memory systems enable Large Language Models (LLMs) to support long-horizon human-LLM interactions by persisting historical interactions beyond limited context windows. However, while recent approaches have succeeded in constructing…

Computation and Language · Computer Science 2026-04-21 Haidong Xin , Xinze Li , Zhenghao Liu , Yukun Yan , Shuo Wang , Cheng Yang , Yu Gu , Ge Yu , Maosong Sun

Analogical reasoning -- the capacity to identify and map structural relationships between different domains -- is fundamental to human cognition and learning. Recent studies have shown that large language models (LLMs) can sometimes match…

Computation and Language · Computer Science 2025-11-21 Sam Musker , Alex Duchnowski , Raphaël Millière , Ellie Pavlick

Existing large language models (LLMs) can only afford fix-sized inputs due to the input length limit, preventing them from utilizing rich long-context information from past inputs. To address this, we propose a framework, Language Models…

Computation and Language · Computer Science 2023-06-13 Weizhi Wang , Li Dong , Hao Cheng , Xiaodong Liu , Xifeng Yan , Jianfeng Gao , Furu Wei

Large Language Models (LLMs) are increasingly deployed as long-term interactive agents, yet their limited context windows make it difficult to sustain coherent behavior over extended interactions. Existing memory systems often store…

Artificial Intelligence · Computer Science 2026-01-12 Chuanrui Hu , Xingze Gao , Zuyi Zhou , Dannong Xu , Yi Bai , Xintong Li , Hui Zhang , Tong Li , Chong Zhang , Lidong Bing , Yafeng Deng

Large Language Models (LLMs) have demonstrated proficiency in a wide array of natural language processing tasks. However, its effectiveness over discourse-level event relation extraction (ERE) tasks remains unexplored. In this paper, we…

Computation and Language · Computer Science 2025-02-25 Kangda Wei , Aayush Gautam , Ruihong Huang

Memory is critical for dialogue agents to maintain coherence and enable continuous adaptation in long-term interactions. While existing memory mechanisms offer basic storage and retrieval capabilities, they are hindered by two primary…

Computation and Language · Computer Science 2026-01-14 Huhai Zou , Tianhao Sun , Chuanjiang He , Yu Tian , Zhenyang Li , Li Jin , Nayu Liu , Jiang Zhong , Kaiwen Wei

While Large Language Models (LLMs) demonstrate strong performance across domains, their long-context capabilities are limited by transient neural activations causing information decay and unstructured feed-forward network (FFN) weights…

Neurons and Cognition · Quantitative Biology 2026-04-13 Kangcong Li , Peng Ye , Chongjun Tu , Lin Zhang , Chunfeng Song , Jiamin Wu , Tao Yang , Qihao Zheng , Tao Chen

Event reasoning is a fundamental ability that underlies many applications. It requires event schema knowledge to perform global reasoning and needs to deal with the diversity of the inter-event relations and the reasoning paradigms. How…

Computation and Language · Computer Science 2024-08-05 Zhengwei Tao , Zhi Jin , Yifan Zhang , Xiancai Chen , Haiyan Zhao , Jia Li , Bing Liang , Chongyang Tao , Qun Liu , Kam-Fai Wong

Large language models (LLMs) have transformed AI research thanks to their powerful internal capabilities and knowledge. However, existing LLMs still fail to effectively incorporate the massive external knowledge when interacting with the…

Computation and Language · Computer Science 2026-04-15 Tao Feng , Pengrui Han , Guanyu Lin , Ge Liu , Jiaxuan You

Large language models (LLMs) and multimodal LLMs are changing event extraction (EE): prompting and generation can often produce structured outputs in zero shot or few shot settings. Yet LLM based pipelines face deployment gaps, including…

Computation and Language · Computer Science 2025-12-23 Bobo Li , Xudong Han , Jiang Liu , Yuzhe Ding , Liqiang Jing , Zhaoqi Zhang , Jinheng Li , Xinya Du , Fei Li , Meishan Zhang , Min Zhang , Aixin Sun , Philip S. Yu , Hao Fei

Large Language Models (LLMs) excel at extracting common patterns from large-scale corpora, yet they struggle with rare, low-resource, or previously unseen scenarios-such as niche hardware deployment issues or irregular IoT device…

Computation and Language · Computer Science 2025-12-23 Hong Su

In order for large language models to achieve true conversational continuity and benefit from experiential learning, they need memory. While research has focused on the development of complex memory systems, it remains unclear which types…

Computation and Language · Computer Science 2025-12-09 Alessandra Terranova , Björn Ross , Alexandra Birch

Reasoning about real-life events is a unifying challenge in AI and NLP that has profound utility in a variety of domains, while fallacy in high-stake applications could be catastrophic. Able to work with diverse text in these domains, large…

Computation and Language · Computer Science 2024-08-30 Li Zhang