English
Related papers

Related papers: Lost in the Middle: How Language Models Use Long C…

200 papers

We measure the performance of in-context learning as a function of task novelty and difficulty for open and closed questions. For that purpose, we created a novel benchmark consisting of hard scientific questions, each paired with a context…

Computation and Language · Computer Science 2024-07-03 Xiang Li , Haoran Tang , Siyu Chen , Ziwei Wang , Ryan Chen , Marcin Abram

Most existing large language models (LLMs) are expensive to adapt after deployment, especially when a task requires newly produced information or niche domain knowledge. Recent work has shown that, by manipulating and optimizing their…

Computation and Language · Computer Science 2026-05-15 Zeyu Huang , Adhiguna Kuncoro , Qixuan Feng , Jiajun Shen , Lucio Dery , Arthur Szlam , Marc'Aurelio Ranzato

Language models (LMs) have been used in cognitive modeling as well as engineering studies -- they compute information-theoretic complexity metrics that simulate humans' cognitive load during reading. This study highlights a limitation of…

Computation and Language · Computer Science 2022-11-02 Tatsuki Kuribayashi , Yohei Oseki , Ana Brassard , Kentaro Inui

Pre-trained LMs have shown impressive performance on downstream NLP tasks, but we have yet to establish a clear understanding of their sophistication when it comes to processing, retaining, and applying information presented in their input.…

Computation and Language · Computer Science 2021-09-28 Lalchand Pandia , Allyson Ettinger

Large language models (LLMs) trained on huge corpora of text datasets demonstrate intriguing capabilities, achieving state-of-the-art performance on tasks they were not explicitly trained for. The precise nature of LLM capabilities is often…

Artificial Intelligence · Computer Science 2024-04-17 Eric J. Bigelow , Ekdeep Singh Lubana , Robert P. Dick , Hidenori Tanaka , Tomer D. Ullman

Consistency is a key requirement of high-quality translation. It is especially important to adhere to pre-approved terminology and adapt to corrected translations in domain-specific projects. Machine translation (MT) has achieved…

Computation and Language · Computer Science 2024-01-29 Yasmin Moslem

Despite significant advancements, Large Language Models (LLMs) exhibit blind spots that impair their ability to retrieve and process relevant contextual data effectively. We demonstrate that LLM performance in graph tasks with complexities…

Artificial Intelligence · Computer Science 2025-01-03 Hamed Firooz , Maziar Sanjabi , Wenlong Jiang , Xiaoling Zhai

Broad textual understanding and in-context learning require language models that utilize full document contexts. Due to the implementation challenges associated with directly training long-context models, many methods have been proposed for…

Computation and Language · Computer Science 2024-09-24 Yi Lu , Jing Nathan Yan , Songlin Yang , Justin T. Chiu , Siyu Ren , Fei Yuan , Wenting Zhao , Zhiyong Wu , Alexander M. Rush

The scaling trend in Large Language Models (LLMs) has prioritized increasing the maximum context window to facilitate complex, long-form reasoning and document analysis. However, managing this expanded context introduces severe…

Computation and Language · Computer Science 2026-01-21 Ahilan Ayyachamy Nadar Ponnusamy , Karthic Chandran , M Maruf Hossain

In everyday conversations, humans can take on different roles and adapt their vocabulary to their chosen roles. We explore whether LLMs can take on, that is impersonate, different roles when they generate text in-context. We ask LLMs to…

Artificial Intelligence · Computer Science 2023-11-28 Leonard Salewski , Stephan Alaniz , Isabel Rio-Torto , Eric Schulz , Zeynep Akata

Large language models (LLMs) are increasingly being adopted in educational settings. These applications expand beyond English, though current LLMs remain primarily English-centric. In this work, we ascertain if their use in education…

Computation and Language · Computer Science 2025-08-06 Vansh Gupta , Sankalan Pal Chowdhury , Vilém Zouhar , Donya Rooein , Mrinmaya Sachan

Users often rely on Large Language Models (LLMs) for processing multiple documents or performing analysis over a number of instances. For example, analysing the overall sentiment of a number of movie reviews requires an LLM to process the…

Artificial Intelligence · Computer Science 2026-04-22 Jingxuan Chen , Mohammad Taher Pilehvar , Jose Camacho-Collados

Large language models are prominently used in real-world applications, often tasked with reasoning over large volumes of documents. An exciting development in this space is models boasting extended context capabilities, with some…

Computation and Language · Computer Science 2024-07-16 Amanda Dsouza , Christopher Glaze , Changho Shin , Frederic Sala

Self-consistency (SC) improves the performance of large language models (LLMs) across various tasks and domains that involve short content. However, does this support its effectiveness for long-context problems? We challenge the assumption…

Computation and Language · Computer Science 2025-10-03 Adam Byerly , Daniel Khashabi

Long context understanding remains challenging for large language models due to their limited context windows. This paper introduces Long Input Fine-Tuning (LIFT) for long context modeling, a novel framework that enhances LLM performance on…

Computation and Language · Computer Science 2024-12-19 Yansheng Mao , Jiaqi Li , Fanxu Meng , Jing Xiong , Zilong Zheng , Muhan Zhang

The ability to process long contexts is crucial for many natural language processing tasks, yet it remains a significant challenge. While substantial progress has been made in enhancing the efficiency of attention mechanisms, there is still…

Computation and Language · Computer Science 2025-03-06 Konstantin Donhauser , Charles Arnal , Mohammad Pezeshki , Vivien Cabannes , David Lopez-Paz , Kartik Ahuja

Recently proposed evaluation benchmarks aim to characterize the effective context length and the forgetting tendencies of large language models (LLMs). However, these benchmarks often rely on simplistic 'needle in a haystack' retrieval or…

Computation and Language · Computer Science 2025-10-07 Raquib Bin Yousuf , Aadyant Khatri , Shengzhe Xu , Mandar Sharma , Naren Ramakrishnan

The development of highly fluent large language models (LLMs) has prompted increased interest in assessing their reasoning and problem-solving capabilities. We investigate whether several LLMs can solve a classic type of deductive reasoning…

Computation and Language · Computer Science 2024-04-16 Spencer M. Seals , Valerie L. Shalin

Long-context modeling capabilities have garnered widespread attention, leading to the emergence of Large Language Models (LLMs) with ultra-context windows. Meanwhile, benchmarks for evaluating long-context LLMs are gradually catching up.…

Computation and Language · Computer Science 2024-10-04 Minzheng Wang , Longze Chen , Cheng Fu , Shengyi Liao , Xinghua Zhang , Bingli Wu , Haiyang Yu , Nan Xu , Lei Zhang , Run Luo , Yunshui Li , Min Yang , Fei Huang , Yongbin Li

Over the past few years, the abilities of large language models (LLMs) have received extensive attention, which have performed exceptionally well in complicated scenarios such as logical reasoning and symbolic inference. A significant…

Computation and Language · Computer Science 2024-02-20 Junbing Yan , Chengyu Wang , Jun Huang , Wei Zhang