English
Related papers

Related papers: Neural Paging: Learning Context Management Policie…

200 papers

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks but are constrained by their small context window sizes. Various efforts have been proposed to expand the context window to accommodate even up to…

Computation and Language · Computer Science 2024-04-09 Xuanfan Ni , Hengyi Cai , Xiaochi Wei , Shuaiqiang Wang , Dawei Yin , Piji Li

Large Language Model (LLM) agents are increasingly used in real-world products, where personalized and context-aware user interactions are essential. A central enabler of such capabilities is the agent's long-term semantic memory system,…

Information Retrieval · Computer Science 2026-05-27 Zhentao Xu , Shangjin Zhang , Emir Poyraz , Yvonne Li , Ye Jin , Xie Lu , Xiaoyang Gu , Karthik Ramgopal , Praveen Kumar Bodigutla , Xiaofeng Wang

The advancement of artificial intelligence toward agentic science is currently bottlenecked by the challenge of ultra-long-horizon autonomy, the ability to sustain strategic coherence and iterative correction over experimental cycles…

Artificial Intelligence · Computer Science 2026-03-26 Xinyu Zhu , Yuzhu Cai , Zexi Liu , Bingyang Zheng , Cheng Wang , Rui Ye , Yuzhi Zhang , Linfeng Zhang , Weinan E , Siheng Chen , Yanfeng Wang

Large Language Models (LLMs) are revolutionizing how users interact with information systems, yet their high inference cost poses serious scalability and sustainability challenges. Caching inference responses, allowing them to be retrieved…

Machine Learning · Computer Science 2026-02-16 Xutong Liu , Baran Atalar , Xiangxiang Dai , Jinhang Zuo , Siwei Wang , John C. S. Lui , Wei Chen , Carlee Joe-Wong

Large Language Model (LLM) web agents often struggle with long-horizon web navigation and web task completion in new websites, producing inefficient action sequences unless fine-tuned on environment-specific data. We show that…

While Large Language Models (LLM) enable non-experts to specify open-world multi-robot tasks, the generated plans often lack kinematic feasibility and are not efficient, especially in long-horizon scenarios. Formal methods like Linear…

Robotics · Computer Science 2026-02-11 Shuyuan Hu , Tao Lin , Kai Ye , Yang Yang , Tianwei Zhang

User simulators serve as the critical interactive environment for agent post-training, and an ideal user simulator generalizes across domains and proactively engages in negotiation by challenging or bargaining. However, current methods…

Computation and Language · Computer Science 2026-01-15 Feng Zhang , Shijia Li , Chunmao Zhang , Zhanyu Ma , Jun Xu , Jiuchong Gao , Jinghua Hao , Renqing He , Jingwen Xu , Han Liu

Large Language Models (LLMs) are constrained by their inability to process lengthy inputs, resulting in the loss of critical historical information. To address this limitation, in this paper, we propose the Self-Controlled Memory (SCM)…

Computation and Language · Computer Science 2025-03-19 Bing Wang , Xinnian Liang , Jian Yang , Hui Huang , Shuangzhi Wu , Peihao Wu , Lu Lu , Zejun Ma , Zhoujun Li

Large language models (LLMs) have achieved impressive linguistic capabilities. However, a key limitation persists in their lack of human-like memory faculties. LLMs exhibit constrained memory retention across sequential interactions,…

Computation and Language · Computer Science 2024-05-29 Jing Guo , Nan Li , Jianchuan Qi , Hang Yang , Ruiqiao Li , Yuzhen Feng , Si Zhang , Ming Xu

The limited context window of contemporary large language models (LLMs) remains a primary bottleneck for their broader application across diverse domains. Although continual pre-training on long-context data offers a straightforward…

Computation and Language · Computer Science 2026-04-10 Wei Han , Pan Zhou , Soujanya Poria , Shuicheng Yan

Large Reasoning Models (LRMs) represent a breakthrough in AI problem-solving capabilities, but their effectiveness in interactive environments can be limited. This paper introduces and analyzes overthinking in LRMs. A phenomenon where…

Long-term memory systems enable conversational agents based on large language models (LLMs) to retain, retrieve, and apply user-specific information across multi-session interactions. However, existing evaluations mainly assess…

Information Retrieval · Computer Science 2026-05-21 Zhen Tao , Jinxiang Zhao , Peng Liu , Dinghao Xi , Yanfang Chen , Wei Xu , Zhiyu Li

Computer agents powered by vision-language models (VLMs) have significantly advanced human-computer interaction, enabling users to perform complex tasks through natural language instructions. However, these agents are vulnerable to context…

Artificial Intelligence · Computer Science 2025-03-13 Pei Yang , Hai Ci , Mike Zheng Shou

Large language model agents heavily rely on external memory to support knowledge reuse and complex reasoning tasks. Yet most memory systems store experiences in a single global retrieval pool which can gradually dilute or corrupt stored…

Computation and Language · Computer Science 2026-04-21 Taeyun Roh , Wonjune Jang , Junha Jung , Jaewoo Kang

Large Language Models (LLMs) based agents have demonstrated remarkable potential in autonomous task-solving across complex, open-ended environments. A promising approach for improving the reasoning capabilities of LLM agents is to better…

Computation and Language · Computer Science 2025-11-12 Siyu Xia , Zekun Xu , Jiajun Chai , Wentian Fan , Yan Song , Xiaohan Wang , Guojun Yin , Wei Lin , Haifeng Zhang , Jun Wang

Large Language Models (LLMs) have emerged as a promising paradigm for next-generation recommender systems, offering strong semantic understanding and natural-language reasoning abilities. Despite recent progress, current LLM-based…

Information Retrieval · Computer Science 2026-05-11 Shijun Li , Wooseong Yang , Yu Wang , Tianxin Wei , Joydeep Ghosh

To tackle long-context reasoning tasks without the quadratic complexity of standard attention mechanisms, approaches based on agent memory have emerged, which typically maintain a dynamically updated memory when linearly processing document…

Computation and Language · Computer Science 2026-05-12 Baibei Ji , Xiaoyang Weng , Juntao Li , Zecheng Tang , Yihang Lou , Min Zhang

Recent investigations into effective context lengths of modern flagship large language models (LLMs) have revealed major limitations in effective question answering (QA) and reasoning over long and complex contexts for even the largest and…

Computation and Language · Computer Science 2025-10-28 Anwesan Pal , Karen Hovsepian , Tinghao Guo , Mengnan Zhao , Somendra Tripathi , Nikos Kanakaris , George Mihaila , Sumit Nigam

Large Language Models (LLMs) have garnered widespread attention due to their remarkable performance across various tasks. However, to mitigate the issue of hallucinations, LLMs often incorporate retrieval-augmented pipeline to provide them…

Computation and Language · Computer Science 2024-08-29 Haowen Hou , Fei Ma , Binwen Bai , Xinxin Zhu , Fei Yu

Mathematical problem solving is a fundamental benchmark for assessing the reasoning capabilities of artificial intelligence and a gateway to applications in education, science, and engineering where reliable symbolic reasoning is essential.…

Artificial Intelligence · Computer Science 2026-02-10 Aditya Basarkar , Benyamin Tabarsi , Tiffany Barnes , Dongkuan Xu