English
Related papers

Related papers: MemAgent: Reshaping Long-Context LLM with Multi-Co…

200 papers

Owing to recent advancements, Large Language Models (LLMs) can now be deployed as agents for increasingly complex decision-making applications in areas including robotics, gaming, and API integration. However, reflecting past experiences in…

Traditional enterprises face significant challenges in processing business documents, where tasks like extracting transport references from invoices remain largely manual despite their crucial role in logistics operations. While Large…

Computation and Language · Computer Science 2024-12-23 Jiale Liu , Yifan Zeng , Malte Højmark-Bertelsen , Marie Normann Gadeberg , Huazheng Wang , Qingyun Wu

Long-horizon agentic reasoning necessitates effectively compressing growing interaction histories into a limited context window. Most existing memory systems serialize history as text, where token-level cost is uniform and scales linearly…

Artificial Intelligence · Computer Science 2026-05-19 Yaorui Shi , Shugui Liu , Yu Yang , Wenyu Mao , Yuxin Chen , Qi GU , Hui Su , Xunliang Cai , Xiang Wang , An Zhang

Long-context modeling capabilities have garnered widespread attention, leading to the emergence of Large Language Models (LLMs) with ultra-context windows. Meanwhile, benchmarks for evaluating long-context LLMs are gradually catching up.…

Computation and Language · Computer Science 2024-10-04 Minzheng Wang , Longze Chen , Cheng Fu , Shengyi Liao , Xinghua Zhang , Bingli Wu , Haiyang Yu , Nan Xu , Lei Zhang , Run Luo , Yunshui Li , Min Yang , Fei Huang , Yongbin Li

Large language models (LLMs) face persistent challenges when handling long-context tasks, most notably the lost in the middle issue, where information located in the middle of a long input tends to be underutilized. Some existing methods…

Artificial Intelligence · Computer Science 2025-10-22 Song Yu , Xiaofei Xu , Ke Deng , Li Li , Lin Tian

Large language models (LLMs) based on Transformer have been widely applied in the filed of natural language processing (NLP), demonstrating strong performance, particularly in handling short text tasks. However, when it comes to long…

Computation and Language · Computer Science 2025-07-09 Yijun Liu , Jinzheng Yu , Yang Xu , Zhongyang Li , Qingfu Zhu

Large Language Models (LLMs) encounter challenges in efficiently processing long-text queries, as seen in applications like enterprise document analysis and financial report comprehension. While conventional solutions employ long-context…

Computation and Language · Computer Science 2025-03-06 Yulong Hui , Yihao Liu , Yao Lu , Huanchen Zhang

The field of artificial intelligence has witnessed significant advancements in natural language processing, largely attributed to the capabilities of Large Language Models (LLMs). These models form the backbone of Agents designed to address…

Computation and Language · Computer Science 2025-01-16 Jiaxin Guo , Yuanchang Luo , Daimeng Wei , Ling Zhang , Zongyao Li , Hengchao Shang , Zhiqiang Rao , Shaojun Li , Jinlong Yang , Zhanglin Wu , Hao Yang

Existing works on long-term open-domain dialogues focus on evaluating model responses within contexts spanning no more than five chat sessions. Despite advancements in long-context large language models (LLMs) and retrieval augmented…

Computation and Language · Computer Science 2024-02-28 Adyasha Maharana , Dong-Ho Lee , Sergey Tulyakov , Mohit Bansal , Francesco Barbieri , Yuwei Fang

Large language models (LLMs) have revolutionized text-based code automation, but their potential in graph-oriented engineering workflows remains under-explored. We introduce SimuAgent, an LLM-powered modeling and simulation agent tailored…

Artificial Intelligence · Computer Science 2026-01-09 Yanchang Liang , Xiaowei Zhao

Online video understanding requires models to perform continuous perception and long-range reasoning within potentially infinite visual streams. Its fundamental challenge lies in the conflict between the unbounded nature of streaming media…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Siwei Wen , Zhangcheng Wang , Xingjian Zhang , Lei Huang , Wenjun Wu

LLM-based multi-agent systems have demonstrated remarkable performance on complex tasks through collaborative reasoning. However, these systems tend to rapidly accumulate extremely long conversation histories during interaction. As…

Artificial Intelligence · Computer Science 2026-05-29 Hongxiang Zhang , Yuan Tian , Tianyi Zhang

Spreadsheets are ubiquitous across the World Wide Web, playing a critical role in enhancing work efficiency across various domains. Large language model (LLM) has been recently attempted for automatic spreadsheet manipulation but has not…

Artificial Intelligence · Computer Science 2025-03-04 Yibin Chen , Yifu Yuan , Zeyu Zhang , Yan Zheng , Jinyi Liu , Fei Ni , Jianye Hao , Hangyu Mao , Fuzheng Zhang

We introduce M3-Agent, a novel multimodal agent framework equipped with long-term memory. Like humans, M3-Agent can process real-time visual and auditory inputs to build and update episodic and semantic memories, gradually accumulating…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Lin Long , Yichen He , Wentao Ye , Yiyuan Pan , Yuan Lin , Hang Li , Junbo Zhao , Wei Li

Recent advances in multimodal LLMs and systems that use tools for long-video QA point to the promise of reasoning over hour-long episodes. However, many methods still compress content into lossy summaries or rely on limited toolsets,…

Artificial Intelligence · Computer Science 2025-12-24 Runtao Liu , Ziyi Liu , Jiaqi Tang , Yue Ma , Renjie Pi , Jipeng Zhang , Qifeng Chen

Long-context capabilities are essential for a wide range of applications, including document and video understanding, in-context learning, and inference-time scaling, all of which require models to process and reason over long sequences of…

Computation and Language · Computer Science 2025-04-09 Chejian Xu , Wei Ping , Peng Xu , Zihan Liu , Boxin Wang , Mohammad Shoeybi , Bo Li , Bryan Catanzaro

Recent works on context and memory benchmarking have primarily focused on conversational instances but the need for evaluating memory in dynamic enterprise environments is crucial for its effective application. We introduce MEMTRACK, a…

Artificial Intelligence · Computer Science 2025-10-03 Darshan Deshpande , Varun Gangal , Hersh Mehta , Anand Kannappan , Rebecca Qian , Peng Wang

This paper focuses on embodied task planning, where an agent acquires visual observations from the environment and executes atomic actions to accomplish a given task. Although recent Vision-Language Models (VLMs) have achieved impressive…

Robotics · Computer Science 2026-04-10 Peiran Xu , Jiaqi Zheng , Yadong Mu

Recent advances in Large Language Models (LLMs) have yielded impressive successes on many language tasks. However, efficient processing of long contexts using LLMs remains a significant challenge. We introduce \textbf{EpMAN} -- a method for…

Large language models (LLMs) are increasingly deployed as agents in dynamic, real-world environments, where success requires both reasoning and effective tool use. A central challenge for agentic tasks is the growing context length, as…

Artificial Intelligence · Computer Science 2025-10-20 Minki Kang , Wei-Ning Chen , Dongge Han , Huseyin A. Inan , Lukas Wutschitz , Yanzhi Chen , Robert Sim , Saravan Rajmohan