English
Related papers

Related papers: Beyond Fact Retrieval: Episodic Memory for RAG wit…

200 papers

Large language models (LLMs) exhibit remarkable capabilities in question answering and reasoning thanks to their extensive parametric memory. However, their knowledge is inherently limited by the scope of their pre-training data, while…

Computation and Language · Computer Science 2025-06-10 Atahan Özer , Çağatay Yıldız

Large Language Models (LLMs) have made significant progress in dialogue, yet redundant memory contexts severely limit their effectiveness in long-term dialogue agents. External memory systems have been proposed to improve memory…

Information Retrieval · Computer Science 2026-05-28 Tan Wang , Yunwei Dong

Recent studies increasingly explore Large Language Models (LLMs) as a new paradigm for recommendation systems due to their scalability and world knowledge. However, existing work has three key limitations: (1) most efforts focus on…

Large Language Models (LLMs) have demonstrated strong capabilities across diverse NLP applications, such as translation, text generation, and question answering. Nevertheless, they remain limited in complex settings that demand deep…

Computation and Language · Computer Science 2026-05-18 Xin Zhang , Yang Cao , Baoxing Wu , Kai Song , Siying Li

Large language model (LLM) agents often struggle in long-context interactions. As the agent accumulates more interaction history, context management approaches such as sliding window and prompt compression may omit earlier structured…

Computation and Language · Computer Science 2026-04-28 Yating Wu , Yuhao Zhang , Sayan Ghosh , Sourya Basu , Anoop Deoras , Jun Huan , Gaurav Gupta

Automatic Speech Recognition (ASR) systems, such as Whisper, achieve high transcription accuracy but struggle with named entities and numerical data, especially when proper formatting is required. These issues increase word error rate (WER)…

Computation and Language · Computer Science 2025-07-01 Duygu Altinok

Large Language Models (LLMs) often struggle with producing factually consistent answers due to limitations in their parametric memory. Retrieval-Augmented Generation (RAG) paradigms mitigate this issue by incorporating external knowledge at…

Computation and Language · Computer Science 2026-05-05 Shanglin Wu , Lihui Liu , Jinho D. Choi , Kai Shu

Generative Large Language Models (LLMs) are a promising approach to structuring knowledge contained within the corpora of research literature produced by large-scale and long-running scientific collaborations. Within experimental particle…

High Energy Physics - Experiment · Physics 2025-09-09 James McGreivy , Blaise Delaney , Anja Beck , Mike Williams

Large Language Models (LLMs) demonstrate impressive capabilities but lack robust temporal intelligence, struggling to integrate reasoning about the past with predictions and plausible generations of the future. Meanwhile, existing methods…

Computation and Language · Computer Science 2025-06-04 Zijia Liu , Peixuan Han , Haofei Yu , Haoru Li , Jiaxuan You

Memory retention challenges in deep neural architectures have ongoing limitations in the ability to process and recall extended contextual information. Token dependencies degrade as sequence length increases, leading to a decline in…

Computation and Language · Computer Science 2025-03-26 Frederick Dillon , Gregor Halvorsen , Simon Tattershall , Magnus Rowntree , Gareth Vanderpool

Large Language Models (LLMs) have achieved remarkable success across various domains. However, they still face significant challenges, including high computational costs for training and limitations in solving complex reasoning problems.…

Machine Learning · Computer Science 2025-05-20 Hang Gao , Chenhao Zhang , Tie Wang , Junsuo Zhao , Fengge Wu , Changwen Zheng , Huaping Liu

Recent advances in Large Language Models (LLMs) have significantly improved complex reasoning capabilities. Retrieval-Augmented Generation (RAG) has further extended these capabilities by grounding generation in dynamically retrieved…

Computation and Language · Computer Science 2026-02-23 Jash Rajesh Parekh , Pengcheng Jiang , Jiawei Han

Large language models (LLMs) often suffer from hallucination, generating factually incorrect statements when handling questions beyond their knowledge and perception. Retrieval-augmented generation (RAG) addresses this by retrieving…

Computation and Language · Computer Science 2025-11-18 Shengyuan Chen , Chuang Zhou , Zheng Yuan , Qinggang Zhang , Zeyang Cui , Hao Chen , Yilin Xiao , Jiannong Cao , Xiao Huang

Text embedding and generative tasks are usually trained separately based on large language models (LLMs) nowadays. This causes a large amount of training cost and deployment effort. Context compression is also a challenging and pressing…

Computation and Language · Computer Science 2026-05-13 Zhongtao Miao , Qiyu Wu , Yoshimasa Tsuruoka

Clinical decision-making agents can benefit from reusing prior decision experience. However, many memory-augmented methods store experiences as independent records without explicit relational structure, which may introduce noisy retrieval,…

Artificial Intelligence · Computer Science 2026-03-24 Xiao Han , Yuzheng Fan , Sendong Zhao , Haochun Wang , Bing Qin

Longitudinal health agents must reason across multi-source trajectories that combine continuous device streams, sparse clinical exams, and episodic life events - yet evaluating them is hard: real-world data cannot be released at scale, and…

Artificial Intelligence · Computer Science 2026-04-06 Chao Li , Cailiang Liu , Ang Gao , Kexin Deng , Shu Zhang , Langping Xu , Xiaotong Shi , Xionghao Ding , Jian Pei , Xun Jiang

The ability to form, retrieve, and reason about memories in response to stimuli serves as the cornerstone for general intelligence - shaping entities capable of learning, adaptation, and intuitive insight. Large Language Models (LLMs) have…

Computation and Language · Computer Science 2024-09-25 Brendan Hogan Rappazzo , Yingheng Wang , Aaron Ferber , Carla Gomes

Memory is identified as a crucial human faculty that allows for the retention of visual and linguistic information within the hippocampus and neurons in the brain, which can subsequently be retrieved to address real-world challenges that…

Computation and Language · Computer Science 2023-08-29 Akide Liu

Large Language Models (LLMs) have shown immense potential in Knowledge Graph Completion (KGC), yet bridging the modality gap between continuous graph embeddings and discrete LLM tokens remains a critical challenge. While recent…

Artificial Intelligence · Computer Science 2026-04-24 Qizhuo Xie , Yunhui Liu , Yu Xing , Qianzi Hou , Xudong Jin , Tao Zheng , Tieke He

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation. However, they often struggle with complex reasoning tasks and are prone to hallucination. Recent research has shown…

Computation and Language · Computer Science 2024-12-17 Xue Wu , Kostas Tsioutsiouliklis