English
Related papers

Related papers: CorpusQA: A 10 Million Token Benchmark for Corpus-…

200 papers

Test-time compute is central to large reasoning models, yet analysing their reasoning behaviour through generated text is increasingly impractical and unreliable. Response length is often used as a brute proxy for reasoning effort, but this…

Computation and Language · Computer Science 2026-02-09 Quoc Tuan Pham , Mehdi Jafari , Flora Salim

Large language models (LLMs) have shown nearly saturated performance on many natural language processing (NLP) tasks. As a result, it is natural for people to believe that LLMs have also mastered abilities such as time understanding and…

Computation and Language · Computer Science 2023-10-10 Yifan Wei , Yisong Su , Huanhuan Ma , Xiaoyan Yu , Fangyu Lei , Yuanzhe Zhang , Jun Zhao , Kang Liu

Large language models (LLMs) have shown remarkable ability in various language tasks, especially with their emergent in-context learning capability. Extending LLMs to incorporate visual inputs, large vision-language models (LVLMs) have…

Machine Learning · Computer Science 2025-10-13 Aneesh Komanduri , Karuna Bhaila , Xintao Wu

Large Language Models (LLMs) are increasingly excelling and outpacing human performance on many tasks. However, to improve LLM reasoning, researchers either rely on ad-hoc generated datasets or formal mathematical proof systems such as the…

Artificial Intelligence · Computer Science 2025-11-03 Nikolaus Holzer , William Fishell , Baishakhi Ray , Mark Santolucito

Evaluating large language models (LLMs) on question answering often relies on static benchmarks that reward memorization and understate the role of retrieval, failing to capture the dynamic nature of world knowledge. We present…

Computation and Language · Computer Science 2025-11-07 Heng Zhou , Ao Yu , Yuchen Fan , Jianing Shi , Li Kang , Hejia Geng , Yongting Zhang , Yutao Fan , Yuhao Wu , Tiancheng He , Yiran Qin , Lei Bai , Zhenfei Yin

Commonsense reasoning is a pivotal skill for large language models, yet it presents persistent challenges in specific tasks requiring this competence. Traditional fine-tuning approaches can be resource-intensive and potentially compromise a…

Computation and Language · Computer Science 2023-09-26 Chenin Li , Qianglong Chen , Yin Zhang , Yifei Zhang , Hongxiang Yao

Large language models (LLMs) exhibit remarkable capabilities in question answering and reasoning thanks to their extensive parametric memory. However, their knowledge is inherently limited by the scope of their pre-training data, while…

Computation and Language · Computer Science 2025-06-10 Atahan Özer , Çağatay Yıldız

This paper introduces MedExQA, a novel benchmark in medical question-answering, to evaluate large language models' (LLMs) understanding of medical knowledge through explanations. By constructing datasets across five distinct medical…

Computation and Language · Computer Science 2024-07-04 Yunsoo Kim , Jinge Wu , Yusuf Abdulle , Honghan Wu

Evaluating whether Multimodal Large Language Models can produce trustworthy, verifiable reasoning over long, visually rich documents requires evaluation beyond end-to-end answer accuracy. We introduce DocScope, a benchmark that formulates…

Computation and Language · Computer Science 2026-05-15 Xiang Feng , Jiawei Zhou , Zhangfeng Huang , Kewei Wang , Shanshan Ye , Jinxin Hu , Zulong Chen , Yong Luo , Jing Zhang

Instructional documents are rich sources of knowledge for completing various tasks, yet their unique challenges in conversational question answering (CQA) have not been thoroughly explored. Existing benchmarks have primarily focused on…

Computation and Language · Computer Science 2024-10-02 Shiwei Wu , Chen Zhang , Yan Gao , Qimeng Wang , Tong Xu , Yao Hu , Enhong Chen

Large Language Models (LLMs) have demonstrated impressive capabilities across a range of scientific tasks including mathematics, physics, and chemistry. Despite their successes, the effectiveness of LLMs in handling complex statistical…

Computation and Language · Computer Science 2024-10-11 Yizhang Zhu , Shiyin Du , Boyan Li , Yuyu Luo , Nan Tang

Open-ended question answering (QA) evaluates a model's ability to perform contextualized reasoning beyond factual recall. This challenge is especially acute in practice-based domains, where knowledge is procedural and grounded in…

Computation and Language · Computer Science 2026-01-29 Si Chen , Le Huy Khiem , Annalisa Szymanski , Ronald Metoyer , Ting Hua , Nitesh V. Chawla

This paper introduces AQA-Bench, a novel benchmark to assess the sequential reasoning capabilities of large language models (LLMs) in algorithmic contexts, such as depth-first search (DFS). The key feature of our evaluation benchmark lies…

Computation and Language · Computer Science 2025-06-23 Siwei Yang , Bingchen Zhao , Cihang Xie

Time Series Language Models (TSLMs) promise reasoning over real-world temporal data, but their ability to retrieve and reason over long time-series remains largely untested. We introduce TS-Haystack, a multi-domain retrieval benchmark with…

Corpus linguistics has traditionally relied on human researchers to formulate hypotheses, construct queries, and interpret results - a process demanding specialized technical skills and considerable time. We propose Agent-Driven Corpus…

Computation and Language · Computer Science 2026-04-09 Jia Yu , Weiwei Yu , Pengfei Xiao , Fukun Xing

As the context limits of Large Language Models (LLMs) increase, the range of possible applications and downstream functions broadens. In many real-world tasks, decisions depend on details scattered across collections of often disparate…

Computation and Language · Computer Science 2025-04-24 Jonathan Roberts , Kai Han , Samuel Albanie

Large language models (LLMs) are increasingly deployed in clinical decision support, yet subtle demographic cues can influence their reasoning. Prior work has documented disparities in outputs across patient groups, but little is known…

Computation and Language · Computer Science 2025-10-16 Rajarshi Ghosh , Abhay Gupta , Hudson McBride , Anurag Vaidya , Faisal Mahmood

Medical question answering (QA) benchmarks often focus on multiple-choice or fact-based tasks, leaving open-ended answers to real patient questions underexplored. This gap is particularly critical in mental health, where patient questions…

Computation and Language · Computer Science 2026-05-15 Yahan Li , Jifan Yao , John Bosco S. Bunyi , Adam C. Frank , Angel Hsing-Chi Hwang , Ruishan Liu

Despite the remarkable advancements and widespread applications of deep neural networks, their ability to perform reasoning tasks remains limited, particularly in domains requiring structured, abstract thought. In this paper, we investigate…

Computation and Language · Computer Science 2025-09-16 Satyam Goyal , Soham Dan

Retrieval-augmented generation (RAG) has emerged as a leading approach to reducing hallucinations in large language models (LLMs). Current RAG evaluation benchmarks primarily focus on what we call local RAG: retrieving relevant chunks from…

Computation and Language · Computer Science 2025-11-05 Qi Luo , Xiaonan Li , Tingshuo Fan , Xinchi Chen , Xipeng Qiu