English
Related papers

Related papers: KoLA: Carefully Benchmarking World Knowledge of La…

200 papers

The advancement of large language models (LLMs) has led to a greater challenge of having a rigorous and systematic evaluation of complex tasks performed, especially in enterprise applications. Therefore, LLMs need to be able to benchmark…

Computation and Language · Computer Science 2024-10-18 Bing Zhang , Mikio Takeuchi , Ryo Kawahara , Shubhi Asthana , Md. Maruf Hossain , Guang-Jie Ren , Kate Soule , Yada Zhu

The versatility of large language models (LLMs) led to the creation of diverse benchmarks that thoroughly test a variety of language models' abilities. These benchmarks consist of tens of thousands of examples making evaluation of LLMs very…

Computation and Language · Computer Science 2024-05-28 Felipe Maia Polo , Lucas Weber , Leshem Choshen , Yuekai Sun , Gongjun Xu , Mikhail Yurochkin

Large language models (LLMs) have achieved remarkable progress in linguistic tasks, necessitating robust evaluation frameworks to understand their capabilities and limitations. Inspired by Feynman's principle of understanding through…

Computation and Language · Computer Science 2024-06-11 Zhiquan Tan , Lai Wei , Jindong Wang , Xing Xie , Weiran Huang

Knowledge graphs have emerged as a popular method for injecting up-to-date, factual knowledge into large language models (LLMs). This is typically achieved by converting the knowledge graph into text that the LLM can process in context.…

Computation and Language · Computer Science 2025-04-10 Elan Markowitz , Krupa Galiya , Greg Ver Steeg , Aram Galstyan

Although large language models (LLMs) have shown exceptional capabilities across a wide range of tasks, reliable evaluation remains a critical challenge due to data contamination, opaque operation, and subjective preferences. To address…

Artificial Intelligence · Computer Science 2026-04-15 Qianhong Guo , Wei Xie , Xiaofang Cai , Enze Wang , Shuoyoucheng Ma , Xiaobing Sun , Tian Xia , Kai Chen , Xiaofeng Wang , Baosheng Wang

Metacognition--the capacity to monitor and evaluate one's own knowledge and performance--is foundational to human decision-making, learning, and communication. As large language models (LLMs) become increasingly embedded in both high-stakes…

Artificial Intelligence · Computer Science 2025-10-14 Mark Steyvers , Megan A. K. Peters

Although large language models (LLMs) have made significant progress in understanding Structured Knowledge (SK) like KG and Table, existing evaluations for SK understanding are non-rigorous (i.e., lacking evaluations of specific…

Computation and Language · Computer Science 2025-09-01 Zhiqiang Liu , Enpei Niu , Yin Hua , Mengshu Sun , Lei Liang , Huajun Chen , Wen Zhang

LLMs and AI chatbots have improved people's efficiency in various fields. However, the necessary knowledge for answering the question may be beyond the models' knowledge boundaries. To mitigate this issue, many researchers try to introduce…

Computation and Language · Computer Science 2023-11-15 Yi Liu , Lianzhe Huang , Shicheng Li , Sishuo Chen , Hao Zhou , Fandong Meng , Jie Zhou , Xu Sun

Large language models (LLMs) as autonomous agents offer a novel avenue for tackling real-world challenges through a knowledge-driven manner. These LLM-enhanced methodologies excel in generalization and interpretability. However, the…

Artificial Intelligence · Computer Science 2024-07-22 Kemou Jiang , Xuan Cai , Zhiyong Cui , Aoyong Li , Yilong Ren , Haiyang Yu , Hao Yang , Daocheng Fu , Licheng Wen , Pinlong Cai

Vocabulary tests, once a cornerstone of language modeling evaluation, have been largely overlooked in the current landscape of Large Language Models (LLMs) like Llama, Mistral, and GPT. While most LLM evaluation benchmarks focus on specific…

Knowledge is fundamental to the overall capabilities of Large Language Models (LLMs). The knowledge paradigm of a model, which dictates how it encodes and utilizes knowledge, significantly affects its performance. Despite the continuous…

Computation and Language · Computer Science 2025-04-10 Xiaotian Ye , Mengqi Zhang , Shu Wu

Large language models (LLMs) are powerful tools capable of handling diverse tasks. Comparing and selecting appropriate LLMs for specific tasks requires systematic evaluation methods, as models exhibit varying capabilities across different…

Computation and Language · Computer Science 2025-06-04 Anna Sokol , Elizabeth Daly , Michael Hind , David Piorkowski , Xiangliang Zhang , Nuno Moniz , Nitesh Chawla

By design, large language models (LLMs) are static general-purpose models, expensive to retrain or update frequently. As they are increasingly adopted for knowledge-intensive tasks, it becomes evident that these design choices lead to…

Computation and Language · Computer Science 2024-03-25 Shangbin Feng , Weijia Shi , Yuyang Bai , Vidhisha Balachandran , Tianxing He , Yulia Tsvetkov

Existing benchmarks for large language models (LLMs) are largely restricted to high- or mid-resource languages, and often evaluate performance on higher-order tasks in reasoning and generation. However, plenty of evidence points to the fact…

Computation and Language · Computer Science 2025-12-01 Emily Chang , Niyati Bafna

Multimodal Large Language Models (MLLMs) have become a powerful tool for integrating visual and textual information. Despite their exceptional performance on visual understanding benchmarks, measuring their ability to reason abstractly…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Nilay Yilmaz , Maitreya Patel , Yiran Lawrence Luo , Tejas Gokhale , Chitta Baral , Suren Jayasuriya , Yezhou Yang

The increasing prevalence of online misinformation has heightened the demand for automated fact-checking solutions. Large Language Models (LLMs) have emerged as potential tools for assisting in this task, but their effectiveness remains…

Computers and Society · Computer Science 2025-03-10 Nicolo' Fontana , Francesco Corso , Enrico Zuccolotto , Francesco Pierri

Large Language Models are cognitively biased judges. Large Language Models (LLMs) have recently been shown to be effective as automatic evaluators with simple prompting and in-context learning. In this work, we assemble 15 LLMs of four…

Computation and Language · Computer Science 2024-09-26 Ryan Koo , Minhwa Lee , Vipul Raheja , Jong Inn Park , Zae Myung Kim , Dongyeop Kang

We introduce TeleQnA, the first benchmark dataset designed to evaluate the knowledge of Large Language Models (LLMs) in telecommunications. Comprising 10,000 questions and answers, this dataset draws from diverse sources, including…

Information Theory · Computer Science 2023-10-24 Ali Maatouk , Fadhel Ayed , Nicola Piovesan , Antonio De Domenico , Merouane Debbah , Zhi-Quan Luo

Large language models (LLMs) inevitably memorize sensitive, copyrighted, and harmful knowledge from the training corpus; therefore, it is crucial to erase this knowledge from the models. Machine unlearning is a promising solution for…

Computation and Language · Computer Science 2024-06-18 Zhuoran Jin , Pengfei Cao , Chenhao Wang , Zhitao He , Hongbang Yuan , Jiachun Li , Yubo Chen , Kang Liu , Jun Zhao

This paper investigates the capabilities of Large Language Models (LLMs) in the context of understanding their knowledge and uncertainty over questions. Specifically, we focus on addressing known-unknown questions, characterized by high…

Computation and Language · Computer Science 2024-07-03 Alfonso Amayuelas , Kyle Wong , Liangming Pan , Wenhu Chen , William Wang