English
Related papers

Related papers: RecallM: An Adaptable Memory Mechanism with Tempor…

200 papers

Large Language Model (LLM) agents use memory to learn from past interactions, enabling autonomous planning and decision-making in complex environments. However, this reliance on memory introduces a critical security risk: an adversary can…

Cryptography and Security · Computer Science 2025-10-06 Qianshan Wei , Tengchao Yang , Yaochen Wang , Xinfeng Li , Lijun Li , Zhenfei Yin , Yi Zhan , Thorsten Holz , Zhiqiang Lin , XiaoFeng Wang

Large Language Models (LLMs) deliver strong performance but incur high inference cost in real-world services, especially under workloads with repeated or near-duplicate queries across users and sessions. In this work, we propose MemBoost, a…

Computation and Language · Computer Science 2026-03-30 Joris Köster , Zixuan Liu , Siavash Khajavi , Zizhan Zheng

Personalizing language models by effectively incorporating user interaction history remains a central challenge in the development of adaptive AI systems. While large language models (LLMs), combined with Retrieval-Augmented Generation…

Computation and Language · Computer Science 2026-04-14 Mikhail Menschikov , Dmitry Evseev , Victoria Dochkina , Ruslan Kostoev , Ilia Perepechkin , Petr Anokhin , Nikita Semenov , Evgeny Burnaev

Large Language Models (LLMs) are highly proficient in language-based tasks. Their language capabilities have positioned them at the forefront of the future AGI (Artificial General Intelligence) race. However, on closer inspection, Valmeekam…

Computation and Language · Computer Science 2025-03-17 Dibyanayan Bandyopadhyay , Soham Bhattacharjee , Asif Ekbal

Recent advances in video large language models have demonstrated strong capabilities in understanding short clips. However, scaling them to hours- or days-long videos remains highly challenging due to limited context capacity and the loss…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Woongyeong Yeo , Kangsan Kim , Jaehong Yoon , Sung Ju Hwang

Modern software systems are subjected to various types of uncertainties arising from context, environment, etc. To this end, self-adaptation techniques have been sought out as potential solutions. Although recent advances in self-adaptation…

Software Engineering · Computer Science 2024-04-16 Raghav Donakanti , Prakhar Jain , Shubham Kulkarni , Karthik Vaidhyanathan

To improve the reasoning capabilities of large language models, test-time compute is typically scaled by generating intermediate tokens before the final answer. However, this couples reasoning to autoregressive generation and thereby…

Computation and Language · Computer Science 2026-05-29 Lukas Aichberger , Sepp Hochreiter

Although long-term memory systems have made substantial progress in recent years, they still exhibit clear limitations in adaptability, scalability, and self-evolution under continuous interaction settings. Inspired by cognitive theories,…

Artificial Intelligence · Computer Science 2026-01-13 Ningning Zhang , Xingxing Yang , Zhizhong Tan , Weiping Deng , Wenyong Wang

Language has long been conceived as an essential tool for human reasoning. The breakthrough of Large Language Models (LLMs) has sparked significant research interest in leveraging these models to tackle complex reasoning tasks. Researchers…

Large Language Models (LLMs) have demonstrated remarkable capabilities in leveraging extensive external knowledge to enhance responses in multi-turn and agentic applications, such as retrieval-augmented generation (RAG). However, processing…

Computation and Language · Computer Science 2025-10-14 Xiaoqiang Lin , Aritra Ghosh , Bryan Kian Hsiang Low , Anshumali Shrivastava , Vijai Mohan

Retrieval-Augmented Language Modeling (RALM) by integrating large language models (LLM) with relevant documents from an external corpus is a proven method for enabling the LLM to generate information beyond the scope of its pre-training…

Computation and Language · Computer Science 2025-06-16 Runheng Liu , Xingchen Xiao , Heyan Huang , Zewen Chi , Zhijing Wu

Traditional neural network models for intent inference rely heavily on observable states and struggle to generalize across diverse tasks and dynamic environments. Recent advances in Vision Language Models (VLMs) and Vision Language Action…

Artificial Intelligence · Computer Science 2026-04-14 Anshul Nayak , Shahil Shaik , Yue Wang

Large language models (LLMs) have emerged as a cornerstone in real-world applications with lengthy streaming inputs (e.g., LLM-driven agents). However, existing LLMs, pre-trained on sequences with a restricted maximum length, cannot process…

Computation and Language · Computer Science 2024-05-29 Chaojun Xiao , Pengle Zhang , Xu Han , Guangxuan Xiao , Yankai Lin , Zhengyan Zhang , Zhiyuan Liu , Maosong Sun

Transformer-based Large Language Models (LLMs) have been applied in diverse areas such as knowledge bases, human interfaces, and dynamic agents, and marking a stride towards achieving Artificial General Intelligence (AGI). However, current…

Computation and Language · Computer Science 2024-02-27 Yunpeng Huang , Jingwei Xu , Junyu Lai , Zixu Jiang , Taolue Chen , Zenan Li , Yuan Yao , Xiaoxing Ma , Lijuan Yang , Hao Chen , Shupeng Li , Penghao Zhao

Personalized and continuous interactions are critical for LLM-based conversational agents, yet finite context windows and static parametric memory hinder the modeling of long-term, cross-session user states. Existing approaches, including…

Artificial Intelligence · Computer Science 2026-02-03 Ao Tian , Yunfeng Lu , Xinxin Fan , Changhao Wang , Lanzhi Zhou , Yeyao Zhang , Yanfang Liu

Continual learning (CL) in large language models (LLMs) is an evolving domain that focuses on developing efficient and sustainable training strategies to adapt models to emerging knowledge and achieve robustness in dynamic environments. Our…

Computation and Language · Computer Science 2025-02-13 Çağatay Yıldız , Nishaanth Kanna Ravichandran , Nitin Sharma , Matthias Bethge , Beyza Ermis

Large language models (LLMs) have demonstrated impressive zero-shot abilities in solving a wide range of general-purpose tasks. However, it is empirically found that LLMs fall short in recognizing and utilizing temporal information,…

Information Retrieval · Computer Science 2024-05-07 Zhendong Chu , Zichao Wang , Ruiyi Zhang , Yangfeng Ji , Hongning Wang , Tong Sun

Inspired by the exceptional general intelligence of Large Language Models (LLMs), researchers have begun to explore their application in pioneering the next generation of recommender systems - systems that are conversational, explainable,…

Information Retrieval · Computer Science 2024-08-06 Wensheng Lu , Jianxun Lian , Wei Zhang , Guanghua Li , Mingyang Zhou , Hao Liao , Xing Xie

While Large Language Models (LLMs) have achieved remarkable success in various fields, the efficiency of training and inference remains a major challenge. To address this issue, we propose SUBLLM, short for Subsampling-Upsampling-Bypass…

Computation and Language · Computer Science 2024-08-26 Quandong Wang , Yuxuan Yuan , Xiaoyu Yang , Ruike Zhang , Kang Zhao , Wei Liu , Jian Luan , Daniel Povey , Bin Wang

Large language models (LLMs) possess strong semantic understanding, driving significant progress in data mining applications. This is further enhanced by large reasoning models (LRMs), which provide explicit multi-step reasoning traces. On…

Machine Learning · Computer Science 2026-04-07 Aobo Chen , Chenxu Zhao , Chenglin Miao , Mengdi Huai