English
Related papers

Related papers: Memento: Personalized RAG-Style Long-Retention Dat…

200 papers

Conversational recommender systems (CRSs) aim to capture user preferences and provide personalized recommendations through multi-round natural language dialogues. However, most existing CRS models mainly focus on dialogue comprehension and…

Information Retrieval · Computer Science 2024-07-09 Yunjia Xi , Weiwen Liu , Jianghao Lin , Bo Chen , Ruiming Tang , Weinan Zhang , Yong Yu

Nowadays, Large Language Models (LLMs) have been trained using extended context lengths to foster more creative applications. However, long context training poses great challenges considering the constraint of GPU memory. It not only leads…

Machine Learning · Computer Science 2025-01-16 Pinxue Zhao , Hailin Zhang , Fangcheng Fu , Xiaonan Nie , Qibin Liu , Fang Yang , Yuanbo Peng , Dian Jiao , Shuaipeng Li , Jinbao Xue , Yangyu Tao , Bin Cui

Memory, additional information beyond the training of large language models (LLMs), is crucial to various real-world applications, such as personal assistant. The two mainstream solutions to incorporate memory into the generation process…

Computation and Language · Computer Science 2025-03-21 Jiale Wei , Shuchi Wu , Ruochen Liu , Xiang Ying , Jingbo Shang , Fangbo Tao

Transformers have a quadratic scaling of computational complexity with input size, which limits the input context window size of large language models (LLMs) in both training and inference. Meanwhile, retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2024-10-18 Yimin Tang , Yurong Xu , Ning Yan , Masood Mortazavi

To enable embodied agents to operate effectively over extended timeframes, it is crucial to develop models that form and access memories to stay contextualized in their environment. In the current paradigm of training transformer-based…

Artificial Intelligence · Computer Science 2025-12-01 Gunshi Gupta , Karmesh Yadav , Zsolt Kira , Yarin Gal , Rahaf Aljundi

We introduce Memento, a conversational AR assistant that permanently captures and memorizes user's verbal queries alongside their spatiotemporal and activity contexts. By storing these "memories," Memento discovers connections between…

Human-Computer Interaction · Computer Science 2026-05-08 Yoonsang Kim , Yalong Yang , Arie E. Kaufman

While Retrieval-Augmented Generation (RAG) has exhibited promise in utilizing external knowledge, its generation process heavily depends on the quality and accuracy of the retrieved context. Large language models (LLMs) struggle to evaluate…

Computation and Language · Computer Science 2025-10-13 Shi-Qi Yan , Quan Liu , Zhen-Hua Ling

Large language models (LLMs) achieve strong performance across a wide range of tasks, but remain frozen after pretraining until subsequent updates. Many real-world applications require timely, domain-specific information, motivating the…

Range filters are probabilistic data structures that answer approximate range emptiness queries. They aid in avoiding processing empty range queries and have use cases in many application domains such as key-value stores and social web…

Data Structures and Algorithms · Computer Science 2024-10-29 Navid Eslami , Niv Dayan

Enterprise deployments of large-language model (LLM) demand continuously changing document collections with sub-second latency and predictable GPU cost requirements that classical Retrieval-Augmented Generation (RAG) pipelines only…

Information Retrieval · Computer Science 2025-06-30 Abu Hanif Muhammad Syarubany , Chang Dong Yoo

Effective long-term memory management is crucial for language models handling extended contexts. We introduce the Enhanced Ranked Memory Augmented Retrieval (ERMAR) framework, which dynamically ranks memory entries based on relevance.…

Information Retrieval · Computer Science 2026-05-19 Ghadir Alselwi , Hao Xue , Shoaib Jameel , Basem Suleiman , Flora D. Salim , Imran Razzak

Generative recommendation (GenRec) models typically model user behavior via full attention, but scaling to lifelong sequences is hindered by prohibitive computational costs and noise accumulation from stochastic interactions. To address…

Information Retrieval · Computer Science 2026-02-16 Yixiao Chen , Yuan Wang , Yue Liu , Qiyao Wang , Ke Cheng , Xin Xu , Juntong Yan , Shuojin Yang , Menghao Guo , Jun Zhang , Huan Yu , Jie Jiang

Large Language Model (LLM) agents require persistent memory to maintain personalization, factual continuity, and long-horizon reasoning, yet standard context-window and retrieval-augmented generation (RAG) pipelines degrade over…

Artificial Intelligence · Computer Science 2026-04-07 Shu Wang , Edwin Yu , Oscar Love , Tom Zhang , Tom Wong , Steve Scargall , Charles Fan

Personal and private Web archives are proliferating due to the increase in the tools to create them and the realization that Internet Archive and other public Web archives are unable to capture personalized (e.g., Facebook) and private…

Digital Libraries · Computer Science 2018-06-05 Mat Kelly , Michael L. Nelson , Michele C. Weigle

Users often omit essential details in their requests to LLM-based agents, resulting in under-specified inputs for tool use. This poses a fundamental challenge for tool-augmented agents, as API execution typically requires complete…

Computation and Language · Computer Science 2026-04-21 Yejin Yoon , Minseo Kim , Taeuk Kim

The scaling law, which indicates that model performance improves with increasing dataset and model capacity, has fueled a growing trend in expanding recommendation models in both industry and academia. However, the advent of large-scale…

Information Retrieval · Computer Science 2026-01-30 Qihang Yu , Kairui Fu , Zhaocheng Du , Yuxuan Si , Kaiyuan Li , Weihao Zhao , Zhicheng Zhang , Jieming Zhu , Quanyu Dai , Zhenhua Dong , Shengyu Zhang , Kun Kuang , Fei Wu

LLM-powered embodied agents have shown success on conventional object-rearrangement tasks, but providing personalized assistance that leverages user-specific knowledge from past interactions presents new challenges. We investigate these…

Computation and Language · Computer Science 2026-02-16 Taeyoon Kwon , Dongwook Choi , Hyojun Kim , Sunghwan Kim , Seungjun Moon , Beong-woo Kwak , Kuan-Hao Huang , Jinyoung Yeo

Large Language Models (LLMs) have recently been widely adopted in conversational agents. However, the increasingly long interactions between users and agents accumulate extensive dialogue records, making it difficult for LLMs with limited…

Computation and Language · Computer Science 2025-09-30 Derong Xu , Yi Wen , Pengyue Jia , Yingyi Zhang , wenlin zhang , Yichao Wang , Huifeng Guo , Ruiming Tang , Xiangyu Zhao , Enhong Chen , Tong Xu

The rapid evolution of e-commerce has exposed the limitations of traditional product retrieval systems in managing complex, multi-turn user interactions. Recent advances in multimodal generative retrieval -- particularly those leveraging…

Increasing concerns with privacy have stimulated interests in Session-based Recommendation (SR) using no personal data other than what is observed in the current browser session. Existing methods are evaluated in static settings which…

Machine Learning · Computer Science 2020-05-05 Fei Mi , Boi Faltings