English
Related papers

Related papers: When Facts Change: Probing LLMs on Evolving Knowle…

200 papers

This study delves into the capabilities and limitations of Large Language Models (LLMs) in the challenging domain of conditional question-answering. Utilizing the Conditional Question Answering (CQA) dataset and focusing on generative…

Computation and Language · Computer Science 2023-12-05 Syed-Amad Hussain , Parag Pravin Dakle , SaiKrishna Rallabandi , Preethi Raghavan

Temporal knowledge graph question answering (TKGQA) poses a significant challenge task, due to the temporal constraints hidden in questions and the answers sought from dynamic structured knowledge. Although large language models (LLMs) have…

Computation and Language · Computer Science 2024-07-25 Yifu Gao , Linbo Qiao , Zhigang Kan , Zhihua Wen , Yongquan He , Dongsheng Li

Recent advances in reasoning models have yielded impressive results in mathematics and coding. However, most approaches rely on static datasets, which have been suggested to encourage memorisation and limit generalisation. We introduce…

Machine Learning · Computer Science 2026-01-06 Willem Röpke , Samuel Coward , Andrei Lupu , Thomas Foster , Tim Rocktäschel , Jakob Foerster

Benchmarks play a crucial role in tracking the rapid advancement of large language models (LLMs) and identifying their capability boundaries. However, existing benchmarks predominantly curate questions at the question level, suffering from…

Faithful generation in large language models (LLMs) is challenged by knowledge conflicts between parametric memory and external context. Existing contrastive decoding methods tuned specifically to handle conflict often lack adaptability and…

Computation and Language · Computer Science 2025-08-28 Anant Khandelwal , Manish Gupta , Puneet Agrawal

With the widespread adoption of Large Language Models (LLMs), there is a growing need to establish best practices for leveraging their capabilities beyond traditional natural language tasks. In this paper, a novel cross-domain knowledge…

Machine Learning · Computer Science 2025-09-29 Mohammadmahdi Ghasemloo , Alireza Moradi

Knowledge is inherently time-sensitive and continuously evolves over time. Although current Retrieval-Augmented Generation (RAG) systems enrich LLMs with external knowledge, they largely ignore this temporal nature. This raises two…

Information Retrieval · Computer Science 2025-10-16 Jiale Han , Austin Cheung , Yubai Wei , Zheng Yu , Xusheng Wang , Bing Zhu , Yi Yang

The potential of using a large language model (LLM) as a knowledge base (KB) has sparked significant interest. To manage the knowledge acquired by LLMs, we need to ensure that the editing of learned facts respects internal logical…

Computation and Language · Computer Science 2023-12-05 Zichao Li , Ines Arous , Siva Reddy , Jackie C. K. Cheung

While large language models (LLMs) perform strongly on diverse tasks, their trustworthiness is limited by erratic behavior that is unfaithful to their internal knowledge. In particular, LLMs often fail on multiple-choice questions (MCQs)…

Computation and Language · Computer Science 2026-02-05 Yoonah Park , Haesung Pyun , Yohan Jo

Open-ended question answering (QA) evaluates a model's ability to perform contextualized reasoning beyond factual recall. This challenge is especially acute in practice-based domains, where knowledge is procedural and grounded in…

Computation and Language · Computer Science 2026-01-29 Si Chen , Le Huy Khiem , Annalisa Szymanski , Ronald Metoyer , Ting Hua , Nitesh V. Chawla

Large Language Models (LLMs) demonstrate an impressive capacity to recall a vast range of factual knowledge. However, understanding their underlying reasoning and internal mechanisms in exploiting this knowledge remains a key research area.…

Computation and Language · Computer Science 2024-08-07 Marco Bronzini , Carlo Nicolini , Bruno Lepri , Jacopo Staiano , Andrea Passerini

This paper introduces a novel, multi-source framework for the relational validation of Large Language Models (LLMs). While existing benchmarks have demonstrated LLMs' proficiency at factual recall, their ability to understand and reproduce…

Social and Information Networks · Computer Science 2026-05-22 Moses Boudourides

Large Language Models (LLMs) are pretrained on textual data up to a specific temporal cutoff. This creates a strict knowledge boundary beyond which models cannot provide accurate information without querying external sources. More subtly,…

Computation and Language · Computer Science 2025-11-18 Piotr Pęzik , Konrad Kaczyński , Maria Szymańska , Filip Żarnecki , Zuzanna Deckert , Jakub Kwiatkowski , Wojciech Janowski

Prior works have shown that fine-tuning on new knowledge can induce factual hallucinations in large language models (LLMs), leading to incorrect outputs when evaluated on previously known information. However, the specific manifestations of…

Computation and Language · Computer Science 2026-04-20 Renfei Dang , Peng Hu , Zhejian Lai , Changjiang Gao , Min Zhang , Shujian Huang

Knowledge-intensive question answering is central to large language models (LLMs) and is typically assessed using static benchmarks derived from sources like Wikipedia and textbooks. However, these benchmarks fail to capture evolving…

Computation and Language · Computer Science 2025-11-13 Yanhong Li , Tianyang Xu , Kenan Tang , Karen Livescu , David McAllester , Jiawei Zhou

In this work, we explore the use of Large Language Models (LLMs) for knowledge engineering tasks in the context of the ISWC 2023 LM-KBC Challenge. For this task, given subject and relation pairs sourced from Wikidata, we utilize pre-trained…

Computation and Language · Computer Science 2023-09-18 Bohui Zhang , Ioannis Reklos , Nitisha Jain , Albert Meroño Peñuela , Elena Simperl

In this paper, we introduce EconLogicQA, a rigorous benchmark designed to assess the sequential reasoning capabilities of large language models (LLMs) within the intricate realms of economics, business, and supply chain management.…

Computation and Language · Computer Science 2024-09-24 Yinzhu Quan , Zefang Liu

Visual Question Answering (VQA) benchmarks have largely emphasized perception-based tasks that can be solved from visual content alone. In contrast, many real-world scenarios require external knowledge that is not directly observable in the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Basel Shbita , Pengyuan Li , Anna Lisa Gentile

Retrieval-augmented generation (RAG) has emerged as a promising solution to mitigate the limitations of large language models (LLMs), such as hallucinations and outdated information. However, it remains unclear how LLMs handle knowledge…

Large language models (LLMs) demonstrate remarkable performance on knowledge-intensive tasks, suggesting that real-world knowledge is encoded in their model parameters. However, besides explorations on a few probing tasks in limited…

Computation and Language · Computer Science 2024-03-26 Yuyang Bai , Shangbin Feng , Vidhisha Balachandran , Zhaoxuan Tan , Shiqi Lou , Tianxing He , Yulia Tsvetkov