English
Related papers

Related papers: WhenLoss: Diagnosing Write and Retrieval Bottlenec…

200 papers

In long context scenarios, large language models (LLMs) face three main challenges: higher computational cost, performance reduction, and position bias. Research indicates that LLM performance hinges on the density and position of key…

Computation and Language · Computer Science 2024-08-13 Huiqiang Jiang , Qianhui Wu , Xufang Luo , Dongsheng Li , Chin-Yew Lin , Yuqing Yang , Lili Qiu

Across medical specialties, clinical practice is anchored in evidence-based guidelines that codify best studied diagnostic and treatment pathways. These pathways routinely fall short for the long tail of real-world care not covered by…

Large language model (LLM) agents increasingly rely on external memory systems to remain consistent across long-horizon interactions, but little empirical work has been done to understand the specific failure modes and design choices that…

Artificial Intelligence · Computer Science 2026-05-27 Ishir Garg , Neel Kolhe , Dawn Song , Xuandong Zhao

Large language models (LLMs) often fail to scale their performance on long-context tasks performance in line with the context lengths they support. This gap is commonly attributed to retrieval failures -- the models' inability to identify…

Computation and Language · Computer Science 2025-10-08 Yufeng Du , Minyang Tian , Srikanth Ronanki , Subendhu Rongali , Sravan Bodapati , Aram Galstyan , Azton Wells , Roy Schwartz , Eliu A Huerta , Hao Peng

Existing Multimodal Large Language Models (MLLMs) suffer from significant performance degradation on the long document understanding task as document length increases. This stems from two fundamental challenges: 1) a low Signal-to-Noise…

Artificial Intelligence · Computer Science 2026-05-12 Hao Yan , Yuliang Liu , Xingchen Liu , Yuyi Zhang , Minghui Liao , Jihao Wu , Wei Chen , Xiang Bai

Persistent conversational AI systems face a choice between passing full conversation histories to a long-context large language model (LLM) and maintaining a dedicated memory system that extracts and retrieves structured facts. We compare a…

Computation and Language · Computer Science 2026-03-06 Natchanon Pollertlam , Witchayut Kornsuwannawit

The evolution of Large Language Model (LLM) agents towards System~2 reasoning, characterized by deliberative, high-precision problem-solving, requires maintaining rigorous logical integrity over extended horizons. However, prevalent memory…

Artificial Intelligence · Computer Science 2026-05-15 Kaixiang Wang , Yidan Lin , Jiong Lou , Zhaojiacheng Zhou , Bunyod Suvonov , Jie Li

Million-level token inputs in long-context tasks pose significant computational and memory challenges for Large Language Models (LLMs). Recently, DeepSeek-OCR conducted research into the feasibility of Contexts Optical Compression and…

Computation and Language · Computer Science 2025-12-04 Fanfan Liu , Haibo Qiu

Continual instruction tuning(CIT) during the post-training phase is crucial for adapting multimodal large language models (MLLMs) to evolving real-world demands. However, the progress is hampered by the lack of benchmarks with rigorous,…

Computation and Language · Computer Science 2026-02-16 Haiyun Guo , Zhiyan Hou , Yandu Sun , Jinghan He , Yu Chen , Yuzhe Zhou , Yuheng Jia , Jinqiao Wang , Tat-Seng Chua

Long Context Understanding (LCU) is a critical area for exploration in current large language models (LLMs). However, due to the inherently lengthy nature of long-text data, existing LCU benchmarks for LLMs often result in prohibitively…

Computation and Language · Computer Science 2025-07-31 Zhongzhan Huang , Guoming Ling , Shanshan Zhong , Hefeng Wu , Liang Lin

Long-context modeling is one of the critical capabilities of language AI for digesting and reasoning over complex information pieces. In practice, long-context capabilities are typically built into a pre-trained language model~(LM) through…

Computation and Language · Computer Science 2024-10-15 Luyu Gao , Yunyi Zhang , Jamie Callan

Integrating large language models (LLMs) as priors in reinforcement learning (RL) offers significant advantages but comes with substantial computational costs. We present a principled cache-efficient framework for posterior sampling with…

Machine Learning · Computer Science 2025-09-30 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma

Motivation: Biomedical event detection is fundamental for information extraction in molecular biology and biomedical research. The detected events form the central basis for comprehensive biomedical knowledge fusion, facilitating the…

Computation and Language · Computer Science 2019-05-06 Shankai Yan , Ka-Chun Wong

As large language models increasingly gain popularity in real-world applications, processing extremely long contexts, often exceeding the model's pre-trained context limits, has emerged as a critical challenge. While existing approaches to…

Large Language Models (LLMs) encounter significant performance bottlenecks in long-sequence tasks due to the computational complexity and memory overhead inherent in the self-attention mechanism. To address these challenges, we introduce…

Artificial Intelligence · Computer Science 2026-02-17 Ziming Wang , Xiang Wang , Kailong Peng , Lang Qin , Juan Gabriel Kostelec , Christos Sourmpis , Axel Laborieux , Qinghai Guo

Prompt compression is often evaluated by input-token reduction, but its real deployment impact depends on how compression changes output length and total inference cost. We present a controlled replication and extension study of…

Computation and Language · Computer Science 2026-03-26 Warren Johnson

Coding agents accumulate extensive context during long-running tasks, yet fixed context windows force practitioners to choose between truncation and task failure. While numerous memory condensation strategies have been proposed, from simple…

Machine Learning · Computer Science 2026-05-20 Renuka Chintalapati , Sid Raskar , Anurag Acharya , Jared Willard , Patrick Emami , Sameera Horawalavithana

Large Language Models (LLMs) have become a mainstay for many everyday applications. However, as data evolve their knowledge quickly becomes outdated. Continual learning aims to update LLMs with new information without erasing previously…

Machine Learning · Computer Science 2026-01-05 Thomas Katraouras , Dimitrios Rafailidis

Handling long-context sequences efficiently remains a significant challenge in large language models (LLMs). Existing methods for token selection in sequence extrapolation either employ a permanent eviction strategy or select tokens by…

Computation and Language · Computer Science 2025-02-21 Haoyu Wang , Tong Teng , Tianyu Guo , An Xiao , Duyu Tang , Hanting Chen , Yunhe Wang

Large Language Models (LLMs) are increasingly expected to operate over long contexts, yet standard softmax attention incurs a KV cache that grows linearly with sequence length, quickly becoming the bottleneck for long context inference. A…

Computation and Language · Computer Science 2026-05-26 Xintong Yang , Hao Gu , Binxing Xu , Lujun Li , Bei Liu , Jiacheng Liu , Qiyuan Zhu , Sirui Han , Yike Guo