English
Related papers

Related papers: Sequential-NIAH: A Needle-In-A-Haystack Benchmark …

200 papers

Recent large language models (LLMs) support long contexts ranging from 128K to 1M tokens. A popular method for evaluating these capabilities is the needle-in-a-haystack (NIAH) test, which involves retrieving a "needle" (relevant…

Computation and Language · Computer Science 2025-07-10 Ali Modarressi , Hanieh Deilamsalehy , Franck Dernoncourt , Trung Bui , Ryan A. Rossi , Seunghyun Yoon , Hinrich Schütze

The needle-in-a-haystack (NIAH) test, which examines the ability to retrieve a piece of information (the "needle") from long distractor texts (the "haystack"), has been widely adopted to evaluate long-context language models (LMs). However,…

Computation and Language · Computer Science 2024-08-08 Cheng-Ping Hsieh , Simeng Sun , Samuel Kriman , Shantanu Acharya , Dima Rekesh , Fei Jia , Yang Zhang , Boris Ginsburg

Recent advancements in Large Language Models (LLMs) have expanded their context windows to unprecedented lengths, sparking debates about the necessity of Retrieval-Augmented Generation (RAG). To address the fragmented evaluation paradigms…

Computation and Language · Computer Science 2025-03-04 Yunfan Gao , Yun Xiong , Wenlong Wu , Zijing Huang , Bohan Li , Haofen Wang

The Needle-in-a-haystack (NIAH) test is a general task used to assess language models' (LMs') abilities to recall particular information from long input context. This framework however does not provide a means of analyzing what factors,…

Computation and Language · Computer Science 2024-12-02 Hui Dai , Dan Pechi , Xinyi Yang , Garvit Banga , Raghav Mantri

With the rapid advancement of multimodal large language models (MLLMs), their evaluation has become increasingly comprehensive. However, understanding long multimodal content, as a foundational ability for real-world applications, remains…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Weiyun Wang , Shuibo Zhang , Yiming Ren , Yuchen Duan , Tiantong Li , Shuo Liu , Mengkang Hu , Zhe Chen , Kaipeng Zhang , Lewei Lu , Xizhou Zhu , Ping Luo , Yu Qiao , Jifeng Dai , Wenqi Shao , Wenhai Wang

Recent reports suggest that LLMs can handle increasingly long contexts. However, many existing benchmarks for context understanding embed substantial query-irrelevant content, which shifts evaluation toward retrieving relevant snippets…

Computation and Language · Computer Science 2026-01-05 Hyeonseok Moon , Heuiseok Lim

Current long-context benchmarks primarily focus on retrieval-based tests, requiring Large Language Models (LLMs) to locate specific information within extensive input contexts, such as the needle-in-a-haystack (NIAH) benchmark. Long-context…

Computation and Language · Computer Science 2024-10-25 Xiang Liu , Peijie Dong , Xuming Hu , Xiaowen Chu

The Needle In A Haystack (NIAH) task has been widely used to evaluate the long-context question-answering capabilities of Large Language Models (LLMs). However, its reliance on simple retrieval limits its effectiveness. To address this…

Computation and Language · Computer Science 2025-04-08 Yidong Wang

As the context limits of Large Language Models (LLMs) increase, the range of possible applications and downstream functions broadens. In many real-world tasks, decisions depend on details scattered across collections of often disparate…

Computation and Language · Computer Science 2025-04-24 Jonathan Roberts , Kai Han , Samuel Albanie

Many benchmarks exist for evaluating long-context language models (LCLMs), yet developers often rely on synthetic tasks such as needle-in-a-haystack (NIAH) or an arbitrary subset of tasks. However, it remains unclear whether these…

Computation and Language · Computer Science 2025-03-07 Howard Yen , Tianyu Gao , Minmin Hou , Ke Ding , Daniel Fleischer , Peter Izsak , Moshe Wasserblat , Danqi Chen

While recent large language models (LLMs) demonstrate remarkable abilities in responding to queries in diverse languages, their ability to handle long multilingual contexts is unexplored. As such, a systematic evaluation of the long-context…

Computation and Language · Computer Science 2024-08-20 Amey Hengle , Prasoon Bajpai , Soham Dan , Tanmoy Chakraborty

Current benchmarks like Needle-in-a-Haystack (NIAH), Ruler, and Needlebench focus on models' ability to understand long-context input sequences but fail to capture a critical dimension: the generation of high-quality long-form text.…

Computation and Language · Computer Science 2025-01-24 Yuhao Wu , Ming Shan Hee , Zhiqing Hu , Roy Ka-Wei Lee

Processing structured tabular data, particularly large and lengthy tables, constitutes a fundamental yet challenging task for large language models (LLMs). However, existing long-context benchmarks like Needle-in-a-Haystack primarily focus…

Computation and Language · Computer Science 2025-10-29 Lanrui Wang , Mingyu Zheng , Hongyin Tang , Zheng Lin , Yanan Cao , Jingang Wang , Xunliang Cai , Weiping Wang

Video sequences offer valuable temporal information, but existing large multimodal models (LMMs) fall short in understanding extremely long videos. Many works address this by reducing the number of visual tokens using visual resamplers.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Peiyuan Zhang , Kaichen Zhang , Bo Li , Guangtao Zeng , Jingkang Yang , Yuanhan Zhang , Ziyue Wang , Haoran Tan , Chunyuan Li , Ziwei Liu

Large language models (LLMs) are increasingly capable of processing long inputs and locating specific information within them, as evidenced by their performance on the Needle in a Haystack (NIAH) test. However, while models excel at…

Computation and Language · Computer Science 2025-06-16 Harvey Yiyun Fu , Aryan Shrivastava , Jared Moore , Peter West , Chenhao Tan , Ari Holtzman

Modern long-context large language models (LLMs) perform well on synthetic "needle-in-a-haystack" (NIAH) benchmarks, but such tests overlook how noisy contexts arise from biased retrieval and agentic workflows. We argue that haystack…

Computation and Language · Computer Science 2025-10-13 Mufei Li , Dongqi Fu , Limei Wang , Si Zhang , Hanqing Zeng , Kaan Sancak , Ruizhong Qiu , Haoyu Wang , Xiaoxin He , Xavier Bresson , Yinglong Xia , Chonglin Sun , Pan Li

Recent large language models (LLMs) have demonstrated versatile capabilities in long-context scenarios. Although some recent benchmarks have been developed to evaluate the long-context capabilities of LLMs, there is a lack of benchmarks…

Computation and Language · Computer Science 2024-10-08 Lei Wang , Shan Dong , Yuhui Xu , Hanze Dong , Yalu Wang , Amrita Saha , Ee-Peng Lim , Caiming Xiong , Doyen Sahoo

Multimodal Large Language Models (MLLMs) have shown significant promise in various applications, leading to broad interest from researchers and practitioners alike. However, a comprehensive evaluation of their long-context capabilities…

Machine Learning · Computer Science 2025-02-12 Hengyi Wang , Haizhou Shi , Shiwei Tan , Weiyi Qin , Wenyuan Wang , Tunyu Zhang , Akshay Nambi , Tanuja Ganu , Hao Wang

The proliferation of Large Language Models (LLMs) highlights the critical importance of conducting thorough evaluations to discern their comparative advantages, limitations, and optimal use cases. Particularly important is assessing their…

Computation and Language · Computer Science 2024-04-16 Daniel Machlab , Rick Battle

Video understanding is a crucial next step for multimodal large language models (MLLMs). Various benchmarks are introduced for better evaluating the MLLMs. Nevertheless, current video benchmarks are still inefficient for evaluating video…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Zijia Zhao , Haoyu Lu , Yuqi Huo , Yifan Du , Tongtian Yue , Longteng Guo , Bingning Wang , Weipeng Chen , Jing Liu
‹ Prev 1 2 3 10 Next ›