English
Related papers

Related papers: Hierarchical Long-Term Semantic Memory for LinkedI…

200 papers

Large language models (LLMs) excel in many natural language processing (NLP) tasks. However, since LLMs can only incorporate new knowledge through training or supervised fine-tuning processes, they are unsuitable for applications that…

Databases · Computer Science 2024-07-23 Zongyue Qin , Chen Luo , Zhengyang Wang , Haoming Jiang , Yizhou Sun

Large language model (LLM) agents have recently demonstrated strong capabilities in interactive decision-making, yet they remain fundamentally limited in long-horizon tasks that require structured planning and reliable execution. Existing…

Artificial Intelligence · Computer Science 2026-05-06 Hongbo Jin , Rongpeng Zhu , Jiayu Ding , Guibo Luo , Ge Li

Large language models face challenges in long-context question answering, where key evidence of a query may be dispersed across millions of tokens. Existing works equip large language models with a memory buffer that is dynamically updated…

Computation and Language · Computer Science 2026-03-03 Yaorui Shi , Yuxin Chen , Siyuan Wang , Sihang Li , Hengxing Cai , Qi Gu , Xiang Wang , An Zhang

Long-term conversational agents require effective memory management to handle dialogue histories that exceed the context window of large language models (LLMs). Existing methods based on fact extraction or summarization reduce redundancy…

Computation and Language · Computer Science 2025-09-26 Yaxiong Wu , Yongyue Zhang , Sheng Liang , Yong Liu

Interactive recommender systems can dynamically adapt to user feedback, but often suffer from content homogeneity and filter bubble effects due to overfitting short-term user preferences. While recent efforts aim to improve content…

Information Retrieval · Computer Science 2026-05-12 Chongjun Xia , Yanchun Peng , Xianzhi Wang

Large language model (LLM) agents require long-term memory to leverage information from past interactions. However, existing memory systems often face a fidelity--efficiency trade-off: raw dialogue histories are expensive, while flat facts…

Computation and Language · Computer Science 2026-05-26 Wentao Qiu , Haotian Hu , Fanyi Wang , Jinwei Kong , Yu Zhang

As deep neural networks continue to revolutionize various application domains, there is increasing interest in making these powerful models more understandable and interpretable, and narrowing down the causes of good and bad predictions. We…

Machine Learning · Statistics 2016-11-21 Viktoriya Krakovna , Finale Doshi-Velez

Large Language Model (LLM) agents exhibit remarkable conversational and reasoning capabilities but remain constrained by limited context windows and the lack of persistent memory. Recent efforts address these limitations via external memory…

Information Retrieval · Computer Science 2026-01-07 Zhengjun Huang , Zhoujin Tian , Qintian Guo , Fangyuan Zhang , Yingli Zhou , Di Jiang , Zeying Xie , Xiaofang Zhou

We present NeuSymMS, an adaptive memory system that enables large language model (LLM) agents to learn, remember, and reason about users across sessions via a hybrid neuro-symbolic architecture. NeuSymMS couples neural fact extraction from…

Artificial Intelligence · Computer Science 2026-05-22 Mujahid Sultan , Sri Thuraisamy , Daya Rajaratnam

Personalizing language models by effectively incorporating user interaction history remains a central challenge in the development of adaptive AI systems. While large language models (LLMs), combined with Retrieval-Augmented Generation…

Computation and Language · Computer Science 2026-04-14 Mikhail Menschikov , Dmitry Evseev , Victoria Dochkina , Ruslan Kostoev , Ilia Perepechkin , Petr Anokhin , Nikita Semenov , Evgeny Burnaev

Large language models (LLMs) power many interactive systems such as chatbots, customer-service agents, and personal assistants. In knowledge-intensive scenarios requiring user-specific personalization, conventional retrieval-augmented…

Artificial Intelligence · Computer Science 2026-01-13 Hailong Li , Feifei Li , Wenhui Que , Xingyu Fan

Recent advanced LLM-powered agent systems have exhibited their remarkable capabilities in tackling complex, long-horizon tasks. Nevertheless, they still suffer from inherent limitations in resource efficiency, context management, and…

Training Long-Context Large Language Models (LLMs) is challenging, as hybrid training with long-context and short-context data often leads to workload imbalances. Existing works mainly use data packing to alleviate this issue, but fail to…

Machine Learning · Computer Science 2025-10-14 Yongqiang Yao , Jingru Tan , Kaihuan Liang , Feizhao Zhang , Jiahao Hu , Shuo Wu , Yazhe Niu , Ruihao Gong , Dahua Lin , Ningyi Xu

Large language models (LLMs) and LLM-based agents are increasingly deployed as assistants in planning and decision making, yet most existing systems are implicitly optimized for a single-principal interaction paradigm, in which the model is…

Computation and Language · Computer Science 2026-04-29 Shu Yang , Shenzhe Zhu , Hao Zhu , José Ramón Enríquez , Di Wang , Alex Pentland , Michiel A. Bakker , Jiaxin Pei

With the rise of large language models (LLMs), recent works have leveraged LLMs to improve the performance of click-through rate (CTR) prediction. However, we argue that a critical obstacle remains in deploying LLMs for practical use: the…

Information Retrieval · Computer Science 2024-03-29 Binzong Geng , Zhaoxin Huan , Xiaolu Zhang , Yong He , Liang Zhang , Fajie Yuan , Jun Zhou , Linjian Mo

Large language models (LLMs) face persistent challenges when handling long-context tasks, most notably the lost in the middle issue, where information located in the middle of a long input tends to be underutilized. Some existing methods…

Artificial Intelligence · Computer Science 2025-10-22 Song Yu , Xiaofei Xu , Ke Deng , Li Li , Lin Tian

Long-term memory plays a critical role in personal interaction, considering long-term memory can better leverage world knowledge, historical information, and preferences in dialogues. Our research introduces PerLTQA, an innovative QA…

Computation and Language · Computer Science 2024-02-27 Yiming Du , Hongru Wang , Zhengyi Zhao , Bin Liang , Baojun Wang , Wanjun Zhong , Zezhong Wang , Kam-Fai Wong

Large language models (LLMs) have shown great progress in responding to user questions, allowing for a multitude of diverse applications. Yet, the quality of LLM outputs heavily depends on the prompt design, where a good prompt might enable…

Computation and Language · Computer Science 2025-04-16 Yuchi Liu , Jaskirat Singh , Gaowen Liu , Ali Payani , Liang Zheng

Large Language Models (LLMs) exhibit remarkable capabilities but suffer from apparent precision loss, reframed here as information spreading. This reframing shifts the problem from computational precision to an information-theoretic…

Machine Learning · Computer Science 2025-07-02 Christopher James Augeri

In recent years, robots and autonomous systems have become increasingly integral to our daily lives, offering solutions to complex problems across various domains. Their application in search and rescue (SAR) operations, however, presents…

Robotics · Computer Science 2024-09-23 Dimitrios Panagopoulos , Adolfo Perrusquia , Weisi Guo