English
Related papers

Related papers: LastingBench: Defend Benchmarks Against Knowledge …

200 papers

Large Language Models (LLMs) have shown remarkable capabilities in knowledge-intensive tasks, while they remain vulnerable when encountering misinformation. Existing studies have explored the role of LLMs in combating misinformation, but…

Computation and Language · Computer Science 2025-05-29 Miao Peng , Nuo Chen , Jianheng Tang , Jia Li

Large Language Models (LLMs) are increasingly explored as knowledge bases (KBs), yet current evaluation methods focus too narrowly on knowledge retention, overlooking other crucial criteria for reliable performance. In this work, we rethink…

Computation and Language · Computer Science 2024-12-17 Danna Zheng , Mirella Lapata , Jeff Z. Pan

Large Language Models (LLMs), while being increasingly dominant on a myriad of knowledge-intensive activities, have only had limited success understanding lengthy table-text mixtures, such as academic papers and financial reports. Recent…

Computation and Language · Computer Science 2024-12-16 Yikang Pan , Yi Zhu , Rand Xie , Yizhi Liu

Factuality in Large Language Models (LLMs) is a persistent challenge. Current benchmarks often assess short factual answers, overlooking the critical ability to generate structured, multi-record tabular outputs from parametric knowledge. We…

Computation and Language · Computer Science 2025-05-28 Dario Satriani , Enzo Veltri , Donatello Santoro , Paolo Papotti

Scientific equation discovery is a fundamental task in the history of scientific progress, enabling the derivation of laws governing natural phenomena. Recently, Large Language Models (LLMs) have gained interest for this task due to their…

Computation and Language · Computer Science 2025-06-10 Parshin Shojaee , Ngoc-Hieu Nguyen , Kazem Meidani , Amir Barati Farimani , Khoa D Doan , Chandan K Reddy

Large language models (LLMs) show significant potential in healthcare, prompting numerous benchmarks to evaluate their capabilities. However, concerns persist regarding the reliability of these benchmarks, which often lack clinical…

Computation and Language · Computer Science 2026-04-30 Wenting Chen , Guo Yu , Yiu-Fai Cheung , Meidan Ding , Jie Liu , Zizhan Ma , Wenxuan Wang , Linlin Shen

Large Language Models (LLMs) serve as repositories of extensive world knowledge, enabling them to perform tasks such as question-answering and fact-checking. However, this knowledge can become obsolete as global contexts change. In this…

Computation and Language · Computer Science 2023-11-17 Yuhao Wu , Tongjun Shi , Karthick Sharma , Chun Wei Seah , Shuhao Zhang

Large Language Models (LLMs) vary in their abilities on a range of tasks. Initiatives such as the Open LLM Leaderboard aim to quantify these differences with several large benchmarks (sets of test items to which an LLM can respond either…

Computation and Language · Computer Science 2025-02-21 Alex Kipnis , Konstantinos Voudouris , Luca M. Schulze Buschoff , Eric Schulz

There is widespread optimism that frontier Large Language Models (LLMs) and LLM-augmented systems have the potential to rapidly accelerate scientific discovery across disciplines. Today, many benchmarks exist to measure LLM knowledge and…

Recent advancements in Large Language Models (LLMs) have pushed the boundaries of natural language processing, especially in long-context understanding. However, the evaluation of these models' long-context abilities remains a challenge due…

Computation and Language · Computer Science 2025-04-24 Cunxiang Wang , Ruoxi Ning , Boqi Pan , Tonghui Wu , Qipeng Guo , Cheng Deng , Guangsheng Bao , Xiangkun Hu , Zheng Zhang , Qian Wang , Yue Zhang

With the evolution of large language models (LLMs), their robustness against individual simple biases has been enhanced. However, we observe that the ensemble of multiple simple biases still exerts a significant adverse impact on LLMs.…

Computation and Language · Computer Science 2026-04-21 Zhouhao Sun , Zhiyuan Kan , Xiao Ding , Li Du , Bibo Cai , Yang Zhao , Bing Qin , Ting Liu

Large Language Models (LLMs) with agentic web search capabilities show strong potential for tasks requiring real-time information access and complex fact retrieval, yet evaluating such systems remains challenging. We introduce \bench, a…

Information Retrieval · Computer Science 2026-02-17 Yunfan Zhang , Kathleen McKeown , Smaranda Muresan

Large Language Models (LLMs) are being increasingly used in software engineering tasks, with an increased focus on bug report resolution over the past year. However, most proposed systems fail to properly handle uncertain or incorrect…

Software Engineering · Computer Science 2025-06-24 Noble Saji Mathews , Meiyappan Nagappan

Large Language Models (LLMs) are used for many tasks, including those related to coding. An important aspect of being able to utilize LLMs is the ability to assess their fitness for specific usages. The common practice is to evaluate LLMs…

Artificial Intelligence · Computer Science 2024-07-30 Marcel Zalmanovici , Orna Raz , Eitan Farchi , Iftach Freund

Many existing evaluation benchmarks for Large Language Models (LLMs) quickly become outdated due to the emergence of new models and training data. These benchmarks also fall short in assessing how LLM performance changes over time, as they…

Computation and Language · Computer Science 2025-07-09 Hui Dai , Ryan Teehan , Mengye Ren

In contrast to their remarkable performance on general knowledge QA, the true abilities of Large Language Models (LLMs) in tasks demanding deep, specialized reasoning, such as in protein biology, have yet to be thoroughly investigated.…

Quantitative Methods · Quantitative Biology 2025-12-30 Dingyi Rong , Zijian Chen , Qi Jia , Kaiwei Zhang , Haotian Lu , Guangtao Zhai , Ning Liu

Parametric knowledge in large language models (LLMs) is a cornerstone of their success, yet remains poorly understood. Existing knowledge benchmarks typically rely on predefined questions (e.g., "What is the birth date of M.L. King?"),…

Computation and Language · Computer Science 2026-05-27 Luca Giordano , Simon Razniewski

Large Language Models (LLMs) have transformed how people interact with artificial intelligence (AI) systems, achieving state-of-the-art results in various tasks, including scientific discovery and hypothesis generation. However, the lack of…

Computation and Language · Computer Science 2024-11-06 Sikun Guo , Amir Hassan Shariatmadari , Guangzhi Xiong , Albert Huang , Eric Xie , Stefan Bekiranov , Aidong Zhang

As large language models (LLMs) become increasingly capable and widely adopted, benchmarks play a central role in assessing their practical utility. For example, SWE-Bench Verified has emerged as a critical benchmark for evaluating LLMs'…

Artificial Intelligence · Computer Science 2025-12-02 Shanchao Liang , Spandan Garg , Roshanak Zilouchian Moghaddam

Large language models (LLMs) have achieved unprecedented performances in various applications, yet evaluating them is still challenging. Existing benchmarks are either manually constructed or are automatic, but lack the ability to evaluate…

Computation and Language · Computer Science 2024-11-05 Jio Oh , Soyeon Kim , Junseok Seo , Jindong Wang , Ruochen Xu , Xing Xie , Steven Euijong Whang