English
Related papers

Related papers: RGMem: Renormalization Group-inspired Memory Evolu…

200 papers

Predicting human daily behavior is challenging due to the complexity of routine patterns and short-term fluctuations. While data-driven models have improved behavior prediction by leveraging empirical data from various platforms and…

Machine Learning · Computer Science 2025-05-26 Haoxin Li , Jingtao Ding , Jiahui Gong , Yong Li

Large language model (LLM) agents are constrained by limited context windows, necessitating external memory systems for long-term information understanding. Current memory-augmented agents typically depend on pre-defined instructions and…

Computation and Language · Computer Science 2025-10-01 Yu Wang , Ryuichi Takanobu , Zhiqi Liang , Yuzhen Mao , Yuanzhe Hu , Julian McAuley , Xiaojian Wu

In this study, we explore the application of Large Language Models (LLMs) for generating synthetic users and simulating user conversations with a task-oriented dialogue system and present detailed results and their analysis. We propose a…

Computation and Language · Computer Science 2025-02-19 Adnan Ahmad , Stefan Hillmann , Sebastian Möller

Memory is a central capability for LLM agents operating across long-horizon tasks. Existing memory benchmarks predominantly evaluate retention of personalized information in multi-turn chat scenarios, overlooking the dynamic memory…

Computation and Language · Computer Science 2026-05-21 Wujiang Xu , Yu Wang , Kai Mei , Kaiqu Liang , Zhenting Wang , Mingyu Jin , Han Zhang , Shi-Xiong Zhang , Wenyue Hua , Sambit Sahu , Dimitris N. Metaxas

The Transformer architecture has become the de facto standard for Large Language Models (LLMs), demonstrating remarkable capabilities in language understanding and generation. However, its application in conversational AI is fundamentally…

Computation and Language · Computer Science 2025-10-07 Adam Filipek

Collaborative dialogue offers rich insights into students' learning and critical thinking, which is essential for personalizing pedagogical agent interactions in STEM+C settings. While large language models (LLMs) facilitate dynamic…

Large Language Models (LLMs) excel at generating coherent text within a single prompt but fall short in sustaining relevance, personalization, and continuity across extended interactions. Human communication, however, relies on multiple…

Computation and Language · Computer Science 2025-12-05 Stefano Zeppieri

Long-term memory is a critical challenge for Large Language Model agents, as fixed context windows cannot preserve coherence across extended interactions. Existing memory systems represent conversation history as unstructured embedding…

Computation and Language · Computer Science 2026-04-21 Jinchang Zhu , Jindong Li , Cheng Zhang , Jiahong Liu , Menglin Yang

Longitudinal Dialogues (LD) are the most challenging type of conversation for human-machine dialogue systems. LDs include the recollections of events, personal thoughts, and emotions specific to each individual in a sparse sequence of…

Computation and Language · Computer Science 2023-11-01 Seyed Mahed Mousavi , Simone Caldarella , Giuseppe Riccardi

Conversational search utilizes muli-turn natural language contexts to retrieve relevant passages. Existing conversational dense retrieval models mostly view a conversation as a fixed sequence of questions and responses, overlooking the…

Computation and Language · Computer Science 2024-06-05 Haonan Chen , Zhicheng Dou , Kelong Mao , Jiongnan Liu , Ziliang Zhao

Personalized retrieval-augmented generation (RAG) aims to produce user-tailored responses by incorporating retrieved user profiles alongside the input query. Existing methods primarily focus on improving retrieval and rely on large language…

Information Retrieval · Computer Science 2025-08-12 Kepu Zhang , Teng Shi , Weijie Yu , Jun Xu

Recent advancements in Large Language Models (LLMs) have significantly enhanced their ability to process long contexts, yet a notable gap remains in generating long, aligned outputs. This limitation stems from a training gap where…

Computation and Language · Computer Science 2024-11-01 Shanghaoran Quan , Tianyi Tang , Bowen Yu , An Yang , Dayiheng Liu , Bofei Gao , Jianhong Tu , Yichang Zhang , Jingren Zhou , Junyang Lin

Effective long-term memory in conversational AI requires synthesizing information across multiple sessions. However, current systems place excessive reasoning burden on response generation, making performance significantly dependent on…

Computation and Language · Computer Science 2025-09-16 Sangyeop Kim , Yohan Lee , Sanghwa Kim , Hyunjong Kim , Sungzoon Cho

Large Language Model (LLM) agents have shown stunning results in complex tasks, yet they often operate in isolation, failing to learn from past experiences. Existing memory-based methods primarily store raw trajectories, which are often…

Large Language Models (LLMs) based agents have demonstrated remarkable potential in autonomous task-solving across complex, open-ended environments. A promising approach for improving the reasoning capabilities of LLM agents is to better…

Computation and Language · Computer Science 2025-11-12 Siyu Xia , Zekun Xu , Jiajun Chai , Wentian Fan , Yan Song , Xiaohan Wang , Guojun Yin , Wei Lin , Haifeng Zhang , Jun Wang

Self-reflection enables language agents to iteratively refine solutions, yet often produces repetitive outputs that limit reasoning performance. Recent studies have attempted to address this limitation through various approaches, among…

Machine Learning · Computer Science 2026-03-02 Tianjun Yao , Yongqiang Chen , Yujia Zheng , Pan Li , Zhiqiang Shen , Kun Zhang

Large Language Model (LLM) agents exhibit remarkable conversational and reasoning capabilities but remain constrained by limited context windows and the lack of persistent memory. Recent efforts address these limitations via external memory…

Information Retrieval · Computer Science 2026-01-07 Zhengjun Huang , Zhoujin Tian , Qintian Guo , Fangyuan Zhang , Yingli Zhou , Di Jiang , Zeying Xie , Xiaofang Zhou

Large Language Models (LLMs) struggle with generating reliable outputs due to outdated knowledge and hallucinations. Retrieval-Augmented Generation (RAG) models address this by enhancing LLMs with external knowledge, but often fail to…

Information Retrieval · Computer Science 2026-01-16 Saber Zerhoudi , Michael Granitzer

Large language model (LLM) agents are increasingly deployed in long running workflows, where they must preserve user and task state across many turns. Many existing agent memory systems behave like external databases with ad hoc read/write…

Artificial Intelligence · Computer Science 2026-03-18 Pearl Mody , Mihir Panchal , Rishit Kar , Kiran Bhowmick , Ruhina Karani

Large language models (LLMs) have advanced the field of artificial intelligence (AI) and are a powerful enabler for interactive systems. However, they still face challenges in long-term interactions that require adaptation towards the user…

Artificial Intelligence · Computer Science 2025-05-20 Rebecca Westhäußer , Frederik Berenz , Wolfgang Minker , Sebastian Zepf