English
Related papers

Related papers: Where Does Long-Context Supervision Actually Go? E…

200 papers

Large language models (LLMs) are known for their exceptional performance in natural language processing, making them highly effective in many human life-related or even job-related tasks. The attention mechanism in the Transformer…

Computation and Language · Computer Science 2023-04-27 Shuai Li , Zhao Song , Yu Xia , Tong Yu , Tianyi Zhou

We study reinforcement learning (RL) fine-tuning of large language model (LLM) agents for long-horizon multi-turn tool use, where context length quickly becomes a fundamental bottleneck. Existing RL pipelines can suffer from degraded…

Computation and Language · Computer Science 2025-10-09 Miao Lu , Weiwei Sun , Weihua Du , Zhan Ling , Xuesong Yao , Kang Liu , Jiecao Chen

Self-attention and position embedding are two key modules in transformer-based Large Language Models (LLMs). However, the potential relationship between them is far from well studied, especially for long context window extending. In fact,…

Machine Learning · Computer Science 2024-02-29 Shiyi Zhu , Jing Ye , Wei Jiang , Siqiao Xue , Qi Zhang , Yifan Wu , Jianguo Li

Long-context modeling is becoming a core capability of modern large vision-language models (LVLMs), enabling sustained context management across long-document understanding, video analysis, and multi-turn tool use in agentic workflows. Yet…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Zhaowei Wang , Lishu Luo , Haodong Duan , Weiwei Liu , Sijin Wu , Ji Luo , Shen Yan , Shuai Peng , Sihang Yuan , Chaoyi Huang , Yi Lin , Yangqiu Song

Large language models (LLMs) with extended context windows have made significant strides yet remain a challenge due to the scarcity of long documents. Existing methods tend to synthesize long-context data but lack a clear mechanism to…

Computation and Language · Computer Science 2025-05-27 Chaochen Gao , Xing Wu , Zijia Lin , Debing Zhang , Songlin Hu

As Large Language Models (LLMs) continue to evolve, more are being designed to handle long-context inputs. Despite this advancement, most of them still face challenges in accurately handling long-context tasks, often showing the "lost in…

Computation and Language · Computer Science 2024-12-13 Yijiong Yu , Yongfeng Huang , Zhixiao Qi , Zhe Zhou

As model context lengths continue to increase, the number of demonstrations that can be provided in-context approaches the size of entire training datasets. We study the behavior of in-context learning (ICL) at this extreme scale on…

Computation and Language · Computer Science 2025-03-05 Amanda Bertsch , Maor Ivgi , Emily Xiao , Uri Alon , Jonathan Berant , Matthew R. Gormley , Graham Neubig

Large Multimodal Models (LMMs) have demonstrated impressive performance in short video understanding tasks but face great challenges when applied to long video understanding. In contrast, Large Language Models (LLMs) exhibit outstanding…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Hongchen Wei , Zhenzhong Chen

While many advanced LLMs are designed to handle long sequence data, we can still observe notable quality degradation even within the sequence limit. In this work, we introduce a novel approach called Scaling to Emphasize Attention for…

Computation and Language · Computer Science 2025-06-24 Changhun Lee , Minsang Seok , Jun-gyu Jin , Younghyun Cho , Eunhyeok Park

Large language models (LLMs) with extended context windows enable tasks requiring extensive information integration but are limited by the scarcity of high-quality, diverse datasets for long-context instruction tuning. Existing data…

Computation and Language · Computer Science 2025-02-25 Jiaxi Li , Xingxing Zhang , Xun Wang , Xiaolong Huang , Li Dong , Liang Wang , Si-Qing Chen , Wei Lu , Furu Wei

Large language model (LLM) providers boast big numbers for maximum context window sizes. To test the real world use of context windows, we 1) define a concept of maximum effective context window, 2) formulate a testing method of a context…

Computation and Language · Computer Science 2026-04-24 Norman Paulsen

Modeling long sequences is crucial for various large-scale models; however, extending existing architectures to handle longer sequences presents significant technical and resource challenges. In this paper, we propose an efficient and…

Computation and Language · Computer Science 2024-10-08 Ning Wang , Zekun Li , Tongxin Bai , Guoqi Li

Large language models (LLMs) have achieved substantial progress in processing long contexts but still struggle with long-context reasoning. Existing approaches typically involve fine-tuning LLMs with synthetic data, which depends on…

Computation and Language · Computer Science 2024-11-14 Siheng Li , Cheng Yang , Zesen Cheng , Lemao Liu , Mo Yu , Yujiu Yang , Wai Lam

Large pre-training language models (PLMs) have shown promising in-context learning abilities. However, due to the backbone transformer architecture, existing PLMs are bottlenecked by the memory and computational cost when scaling up to a…

Computation and Language · Computer Science 2023-02-13 Mukai Li , Shansan Gong , Jiangtao Feng , Yiheng Xu , Jun Zhang , Zhiyong Wu , Lingpeng Kong

We present LongLoRA, an efficient fine-tuning approach that extends the context sizes of pre-trained large language models (LLMs), with limited computation cost. Typically, training LLMs with long context sizes is computationally expensive,…

Computation and Language · Computer Science 2024-03-11 Yukang Chen , Shengju Qian , Haotian Tang , Xin Lai , Zhijian Liu , Song Han , Jiaya Jia

Recent large reasoning models (LRMs) have demonstrated strong reasoning capabilities through reinforcement learning (RL). These improvements have primarily been observed within the short-context reasoning tasks. In contrast, extending LRMs…

Computation and Language · Computer Science 2025-05-28 Fanqi Wan , Weizhou Shen , Shengyi Liao , Yingcheng Shi , Chenliang Li , Ziyi Yang , Ji Zhang , Fei Huang , Jingren Zhou , Ming Yan

Long-context modeling capabilities have garnered widespread attention, leading to the emergence of Large Language Models (LLMs) with ultra-context windows. Meanwhile, benchmarks for evaluating long-context LLMs are gradually catching up.…

Computation and Language · Computer Science 2024-10-04 Minzheng Wang , Longze Chen , Cheng Fu , Shengyi Liao , Xinghua Zhang , Bingli Wu , Haiyang Yu , Nan Xu , Lei Zhang , Run Luo , Yunshui Li , Min Yang , Fei Huang , Yongbin Li

Large Language Diffusion Models, or diffusion LLMs, have emerged as a significant focus in NLP research, with substantial effort directed toward understanding their scalability and downstream task performance. However, their long-context…

Computation and Language · Computer Science 2025-11-12 Xiaoran Liu , Yuerong Song , Zhigeng Liu , Zengfeng Huang , Qipeng Guo , Ziwei He , Xipeng Qiu

Large language models (LLMs) have exhibited impressive performance and surprising emergent properties. However, their effectiveness remains limited by the fixed context window of the transformer architecture, posing challenges for…

Computation and Language · Computer Science 2025-06-16 Tianqi Du , Haotian Huang , Yifei Wang , Yisen Wang

Recent advances in transformer-based Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks. However, their quadratic computational complexity concerning sequence length remains a significant bottleneck…

Computation and Language · Computer Science 2025-06-05 Zichuan Fu , Wentao Song , Yejing Wang , Xian Wu , Yefeng Zheng , Yingying Zhang , Derong Xu , Xuetao Wei , Tong Xu , Xiangyu Zhao