English
Related papers

Related papers: ENGRAM: Effective, Lightweight Memory Orchestratio…

200 papers

Personalized large language models (LLMs) rely on memory retrieval to incorporate user-specific histories, preferences, and contexts. Existing approaches either overload the LLM by feeding all the user's past memory into the prompt, which…

Information Retrieval · Computer Science 2026-03-11 Yingyi Zhang , Junyi Li , Wenlin Zhang , Penyue Jia , Xianneng Li , Yichao Wang , Derong Xu , Yi Wen , Huifeng Guo , Yong Liu , Xiangyu Zhao

Large Language Models (LLMs) deliver strong performance but incur high inference cost in real-world services, especially under workloads with repeated or near-duplicate queries across users and sessions. In this work, we propose MemBoost, a…

Computation and Language · Computer Science 2026-03-30 Joris Köster , Zixuan Liu , Siavash Khajavi , Zizhan Zheng

Emerging intelligent service scenarios in 6G communication impose stringent requirements for low latency, high reliability, and privacy preservation. Generative large language models (LLMs) are gradually becoming key enablers for the…

Networking and Internet Architecture · Computer Science 2025-05-21 Pengyan Zhu , Tingting Yang

Modeling the relationship between natural speech and a recorded electroencephalogram (EEG) helps us understand how the brain processes speech and has various applications in neuroscience and brain-computer interfaces. In this context, so…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-26 Mohammad Jalilpour Monesi , Bernd Accou , Jair Montoya-Martinez , Tom Francart , Hugo Van Hamme

To enable reliable long-term interaction, LLM agents require a memory system that can faithfully store, efficiently retrieve, and deeply reason over accumulated dialogue history. Most existing methods adopt an extracted fact based paradigm:…

Computation and Language · Computer Science 2026-05-20 Jingwei Sun , Jianing Zhu , Jiangchao Yao , Tongliang Liu , Bo Han

Large Language Models face significant challenges in maintaining coherent interactions over extended dialogues due to their limited contextual memory. This limitation often leads to fragmented exchanges and reduced relevance in responses,…

Machine Learning · Computer Science 2025-06-24 Haseeb Ullah Khan Shinwari , Muhammad Usama

Large Language Models (LLMs) exhibit remarkable capabilities but suffer from apparent precision loss, reframed here as information spreading. This reframing shifts the problem from computational precision to an information-theoretic…

Machine Learning · Computer Science 2025-07-02 Christopher James Augeri

Large language models (LLMs) have shown remarkable capabilities, but still struggle with processing extensive contexts, limiting their ability to maintain coherence and accuracy over long sequences. In contrast, the human brain excels at…

This research investigates the application of Large Language Models (LLMs) to augment conversational agents in process mining, aiming to tackle its inherent complexity and diverse skill requirements. While LLM advancements present novel…

Artificial Intelligence · Computer Science 2023-07-20 Urszula Jessen , Michal Sroka , Dirk Fahland

Built upon the existing analysis of retrieval heads in large language models, we propose an alternative reranking framework that trains models to estimate passage-query relevance using the attention scores of selected heads. This approach…

Computation and Language · Computer Science 2026-03-11 Yuqing Li , Jiangnan Li , Mo Yu , Guoxuan Ding , Zheng Lin , Weiping Wang , Jie Zhou

Large language models (LLMs) are largely static and often redo reasoning or repeat mistakes. Prior experience reuse typically relies on external retrieval, which is similarity-based, can introduce noise, and adds latency. We introduce SEAM…

Machine Learning · Computer Science 2026-04-28 Xuancheng Li , Haitao Li , Yujia Zhou , Yiqun Liu , Qingyao Ai

In today's assistant landscape, personalisation enhances interactions, fosters long-term relationships, and deepens engagement. However, many systems struggle with retaining user preferences, leading to repetitive user requests and…

Artificial Intelligence · Computer Science 2025-01-17 Johannes Kirmayr , Lukas Stappen , Phillip Schneider , Florian Matthes , Elisabeth André

Large Language Models (LLMs) are increasingly integrating memory functionalities to provide personalized and context-aware interactions. However, user understanding, practices and expectations regarding these memory systems are not yet well…

Human-Computer Interaction · Computer Science 2025-08-12 Shuning Zhang , Rongjun Ma , Ying Ma , Shixuan Li , Yiqun Xu , Xin Yi , Hewu Li

People have to remember an ever-expanding volume of information. Wearables that use information capture and retrieval for memory augmentation can help but can be disruptive and cumbersome in real-world tasks, such as in social settings. To…

Human-Computer Interaction · Computer Science 2024-03-05 Wazeer Zulfikar , Samantha Chan , Pattie Maes

Large Language Models (LLMs) lack persistent memory for long-term personalized conversations. Existing graph-based memory systems suffer from information dilution, absent provenance tracking, and uniform retrieval that ignores query…

Computation and Language · Computer Science 2026-05-05 Hung Pham Van , Nguyen Manh Hieu , Khang Pham Tran Tuan , Nam Le Hai , Linh Ngo Van , Nguyen Thi Ngoc Diep , Trung Le

Large language models (LLMs) have made significant progress in Emotional Intelligence (EI) and long-context modeling. However, existing benchmarks often overlook the fact that emotional information processing unfolds as a continuous…

Computation and Language · Computer Science 2026-01-13 Weichu Liu , Jing Xiong , Yuxuan Hu , Zixuan Li , Minghuan Tan , Ningning Mao , Hui Shen , Wendong Xu , Chaofan Tao , Min Yang , Chengming Li , Lingpeng Kong , Ngai Wong

Memory embeddings are crucial for memory-augmented systems, such as OpenClaw, but their evaluation is underexplored in current text embedding benchmarks, which narrowly focus on traditional passage retrieval and fail to assess models'…

Computation and Language · Computer Science 2026-05-08 Xinping Zhao , Xinshuo Hu , Jiaxin Xu , Danyu Tang , Xin Zhang , Mengjia Zhou , Yan Zhong , Yao Zhou , Zifei Shan , Meishan Zhang , Baotian Hu , Min Zhang

Large Language Models (LLMs) have become an essential infrastructure for Artificial General Intelligence (AGI), yet their lack of well-defined memory management systems hinders the development of long-context reasoning, continual…

Large Language Models (LLMs) have advanced rapidly but face significant memory demands. While quantization has shown promise for LLMs, current methods typically require lengthy training to alleviate the performance degradation from…

Artificial Intelligence · Computer Science 2024-05-31 Ke Yi , Yuhui Xu , Heng Chang , Chen Tang , Yuan Meng , Tong Zhang , Jia Li

Existing memory-augmented LLM agents often treat memory as a static repository with pre-defined representations and fixed retrieval pipelines, which is brittle in dynamic agentic environments where feedback, task variation, and…