English
Related papers

Related papers: Squid: Long Context as a New Modality for Energy-E…

200 papers

Transformer is important for text modeling. However, it has difficulty in handling long documents due to the quadratic complexity with input text length. In order to handle this problem, we propose a hierarchical interactive Transformer…

Computation and Language · Computer Science 2021-12-10 Chuhan Wu , Fangzhao Wu , Tao Qi , Yongfeng Huang

Long-context modeling capabilities are important for large language models (LLMs) in various applications. However, directly training LLMs with long context windows is insufficient to enhance this capability since some training samples do…

Computation and Language · Computer Science 2024-05-29 Longze Chen , Ziqiang Liu , Wanwei He , Yunshui Li , Run Luo , Min Yang

Deploying Large Language Model (LLM) services at the edge benefits latency-sensitive and privacy-aware applications. However, the stateless nature of LLMs makes managing user context (e.g., sessions, preferences) across geo-distributed edge…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-09 Mohammadreza Malekabbasi , Minghe Wang , David Bermbach

Today's large language models (LLMs) typically train on short text segments (e.g., <4K tokens) due to the quadratic complexity of their Transformer architectures. As a result, their performance suffers drastically on inputs longer than…

Computation and Language · Computer Science 2024-06-26 Chi Han , Qifan Wang , Hao Peng , Wenhan Xiong , Yu Chen , Heng Ji , Sinong Wang

Large language models (LLMs) have revolutionized AI, but are constrained by limited context windows, hindering their utility in tasks like extended conversations and document analysis. To enable using context beyond limited context windows,…

Artificial Intelligence · Computer Science 2024-02-13 Charles Packer , Sarah Wooders , Kevin Lin , Vivian Fang , Shishir G. Patil , Ion Stoica , Joseph E. Gonzalez

As large language models (LLMs) take on complex tasks, their inputs are supplemented with longer contexts that incorporate domain knowledge. Yet using long contexts is challenging, as nothing can be generated until the whole context is…

Despite the recent success of Large Language Models (LLMs), it remains challenging to feed LLMs with long prompts due to the fixed size of LLM inputs. As a remedy, prompt compression becomes a promising solution by removing redundant tokens…

Computation and Language · Computer Science 2025-01-06 Ziyang Yu , Yuyu Liu

Large Language Models (LLMs) with long context capabilities are integral to complex tasks in natural language processing and computational biology, such as text generation and protein sequence analysis. However, training LLMs directly on…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-14 Jinghan Yao , Sam Ade Jacobs , Masahiro Tanaka , Olatunji Ruwase , Hari Subramoni , Dhabaleswar K. Panda

Large language models (LLMs) have achieved remarkable success in many natural language processing (NLP) tasks. To achieve more accurate output, the prompts used to drive LLMs have become increasingly longer, which incurs higher…

Computation and Language · Computer Science 2025-09-19 Yaxin Gao , Yao Lu , Zongfei Zhang , Jiaqi Nie , Shanqing Yu , Qi Xuan

Long-context modeling is becoming a core capability of modern large vision-language models (LVLMs), enabling sustained context management across long-document understanding, video analysis, and multi-turn tool use in agentic workflows. Yet…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Zhaowei Wang , Lishu Luo , Haodong Duan , Weiwei Liu , Sijin Wu , Ji Luo , Shen Yan , Shuai Peng , Sihang Yuan , Chaoyi Huang , Yi Lin , Yangqiu Song

Large Language Models (LLMs) have demonstrated impressive quality when applied to predictive tasks such as relevance ranking and semantic search. However, deployment of such LLMs remains prohibitively expensive for industry applications…

Large language models (LLMs) have shown remarkable capabilities in natural language processing; however, they still face difficulties when tasked with understanding lengthy contexts and executing effective question answering. These…

Computation and Language · Computer Science 2025-08-18 Yanming Liu , Xinyue Peng , Jiannan Cao , Yanxin Shen , Tianyu Du , Sheng Cheng , Xun Wang , Jianwei Yin , Xuhong Zhang

The emergence of long-context large language models (LLMs) offers a promising alternative to traditional retrieval-augmented generation (RAG) for processing extensive documents. However, the computational overhead of long-context inference…

Computation and Language · Computer Science 2025-06-24 Guanzheng Chen , Qilong Feng , Jinjie Ni , Xin Li , Michael Qizhe Shieh

Recent advancements in Large Language Models (LLMs) have significantly enhanced their capacity to process long contexts. However, effectively utilizing this long context remains a challenge due to the issue of distraction, where irrelevant…

Computation and Language · Computer Science 2024-11-12 Zijun Wu , Bingyuan Liu , Ran Yan , Lei Chen , Thomas Delteil

Transformer-based models have emerged as one of the most widely used architectures for natural language processing, natural language generation, and image generation. The size of the state-of-the-art models has increased steadily reaching…

Hardware Architecture · Computer Science 2025-01-15 Rya Sanovar , Srikant Bharadwaj , Renee St. Amant , Victor Rühle , Saravan Rajmohan

Providing extensive context via prompting is vital for leveraging the capabilities of Large Language Models (LLMs). However, lengthy contexts significantly increase inference latency, as the computational cost of self-attention grows…

Artificial Intelligence · Computer Science 2026-02-17 Guojie Liu , Yiqi Wang , Yanfeng Yang , Wenqi Fan , Songlei Jian , Jianfeng Zhang , Jie Yu

Code generation under long contexts is becoming increasingly critical as Large Language Models (LLMs) are required to reason over extensive information in the codebase. While recent advances enable code LLMs to process long inputs, high API…

Computation and Language · Computer Science 2025-10-02 Yuling Shi , Yichun Qian , Hongyu Zhang , Beijun Shen , Xiaodong Gu

Efficient long-context LLM deployment is stalled by a dichotomy between amortized compression, which struggles with out-of-distribution generalization, and Test-Time Training, which incurs prohibitive synthetic data costs and requires…

Machine Learning · Computer Science 2026-02-26 Zeju Li , Yizhou Zhou , Qiang Xu

Large Language Models (LLMs) have shown impressive capabilities in complex reasoning tasks. However, current approaches employ uniform language density for both intermediate reasoning and final answers, leading to computational…

Computation and Language · Computer Science 2025-12-18 Zhengyi Zhao , Shubo Zhang , Yuxi Zhang , Huimin Wang , Binyang Li , Kam-Fai Wong

Computational resource constraints on edge devices make it difficult to develop a fully embedded AI companion system with a satisfactory user experience. AI companion and memory systems detailed in existing literature cannot be directly…

Artificial Intelligence · Computer Science 2026-01-14 Rahul Gupta , Stephen D. H. Hsu