English
Related papers

Related papers: Evaluating Language Models for Knowledge Base Comp…

200 papers

Biomedical knowledge graphs (KGs) hold rich information on entities such as diseases, drugs, and genes. Predicting missing links in these graphs can boost many important applications, such as drug design and repurposing. Recent work has…

Computation and Language · Computer Science 2021-09-22 Rahul Nadkarni , David Wadden , Iz Beltagy , Noah A. Smith , Hannaneh Hajishirzi , Tom Hope

Knowledge bases (KBs) are often incomplete and constantly changing in practice. Yet, in many question answering applications coupled with knowledge bases, the sparse nature of KBs is often overlooked. To this end, we propose a case-based…

The advent of Large Language Models (LLM) has revolutionized the field of natural language processing, enabling significant progress in various applications. One key area of interest is the construction of Knowledge Bases (KB) using these…

Computation and Language · Computer Science 2023-08-28 Anmol Nayak , Hari Prasad Timmapathini

Knowledge Base Question Answering (KBQA) aims to answer natural language questions based on facts in knowledge bases. A typical approach to KBQA is semantic parsing, which translates a question into an executable logical form in a formal…

Computation and Language · Computer Science 2024-06-17 Jinxin Liu , Shulin Cao , Jiaxin Shi , Tingjian Zhang , Lunyiu Nie , Linmei Hu , Lei Hou , Juanzi Li

Machine reading comprehension (MRC) requires reasoning about both the knowledge involved in a document and knowledge about the world. However, existing datasets are typically dominated by questions that can be well solved by context…

Computation and Language · Computer Science 2018-09-13 Yibo Sun , Daya Guo , Duyu Tang , Nan Duan , Zhao Yan , Xiaocheng Feng , Bing Qin

Advances in information extraction have enabled the automatic construction of large knowledge graphs (e.g., Yago, Wikidata or Google KG), which are widely used in many applications like semantic search or data analytics. However, due to…

Computation and Language · Computer Science 2024-09-13 Zihang Peng , Daria Stepanova , Vinh Thinh Ho , Heike Adel , Alessandra Russo , Simon Ott

As language models (LMs) become integral to fields like healthcare, law, and journalism, their ability to differentiate between fact, belief, and knowledge is essential for reliable decision-making. Failure to grasp these distinctions can…

Computation and Language · Computer Science 2024-10-29 Mirac Suzgun , Tayfun Gur , Federico Bianchi , Daniel E. Ho , Thomas Icard , Dan Jurafsky , James Zou

Large Language Models (LLMs) store an extensive amount of factual knowledge obtained from vast collections of text. To effectively utilize these models for downstream tasks, it is crucial to have reliable methods for measuring their…

Computation and Language · Computer Science 2023-06-13 Pouya Pezeshkpour

Knowledge Graphs (KGs) store structured factual knowledge by linking entities through relationships, crucial for many applications. These applications depend on the KG's factual accuracy, so verifying facts is essential, yet challenging.…

Databases · Computer Science 2026-02-12 Farzad Shami , Stefano Marchesin , Gianmaria Silvello

Pre-trained Language Models (PLMs) are trained on vast unlabeled data, rich in world knowledge. This fact has sparked the interest of the community in quantifying the amount of factual knowledge present in PLMs, as this explains their…

Computation and Language · Computer Science 2023-12-06 Paul Youssef , Osman Alperen Koraş , Meijie Li , Jörg Schlötterer , Christin Seifert

Recent advances in fake news detection have exploited the success of large-scale pre-trained language models (PLMs). The predominant state-of-the-art approaches are based on fine-tuning PLMs on labelled fake news datasets. However,…

Computation and Language · Computer Science 2023-02-14 Chenxi Whitehouse , Tillman Weyde , Pranava Madhyastha , Nikos Komninos

In recent years, large language models (LLMs) have demonstrated significant success in performing varied natural language tasks such as language translation, question-answering, summarizing, fact-checking, etc. Despite LLMs' impressive…

Computation and Language · Computer Science 2025-03-03 Bishwamittra Ghosh , Sarah Hasan , Naheed Anjum Arafat , Arijit Khan

Previous works show the great potential of pre-trained language models (PLMs) for storing a large amount of factual knowledge. However, to figure out whether PLMs can be reliable knowledge sources and used as alternative knowledge bases…

Computation and Language · Computer Science 2022-03-01 Daniel Gao , Yantao Jia , Lei Li , Chengzhen Fu , Zhicheng Dou , Hao Jiang , Xinyu Zhang , Lei Chen , Zhao Cao

Large language models (LLMs) have demonstrated impressive impact in the field of natural language processing, but they still struggle with several issues regarding, such as completeness, timeliness, faithfulness and adaptability. While…

Computation and Language · Computer Science 2023-08-24 Xintao Wang , Qianwen Yang , Yongting Qiu , Jiaqing Liang , Qianyu He , Zhouhong Gu , Yanghua Xiao , Wei Wang

Language models (LMs) have shown great potential as implicit knowledge bases (KBs). And for their practical use, knowledge in LMs need to be updated periodically. However, existing tasks to assess LMs' efficacy as KBs do not adequately…

Computation and Language · Computer Science 2022-04-28 Kyungjae Lee , Wookje Han , Seung-won Hwang , Hwaran Lee , Joonsuk Park , Sang-Woo Lee

Recent work has suggested that language models (LMs) store both common-sense and factual knowledge learned from pre-training data. In this paper, we leverage this implicit knowledge to create an effective end-to-end fact checker using a…

Computation and Language · Computer Science 2020-07-27 Nayeon Lee , Belinda Z. Li , Sinong Wang , Wen-tau Yih , Hao Ma , Madian Khabsa

Large-scale knowledge bases (KBs) like Freebase and Wikidata house millions of structured knowledge. Knowledge Base Question Answering (KBQA) provides a user-friendly way to access these valuable KBs via asking natural language questions.…

Computation and Language · Computer Science 2024-06-24 Lingxi Zhang , Jing Zhang , Yanling Wang , Cuiping Li , Hong Chen

Knowledge bases such as Wikidata, DBpedia, or YAGO contain millions of entities and facts. In some knowledge bases, the correctness of these facts has been evaluated. However, much less is known about their completeness, i.e., the…

Databases · Computer Science 2016-12-20 Luis Galárraga , Simon Razniewski , Antoine Amarilli , Fabian M. Suchanek

Despite significant advances in large language models (LLMs), their knowledge memorization capabilities remain underexplored, due to the lack of standardized and high-quality test ground. In this paper, we introduce a novel, real-world and…

Computation and Language · Computer Science 2025-05-20 Yuwei Zhang , Wenhao Yu , Shangbin Feng , Yifan Zhu , Letian Peng , Jayanth Srinivasa , Gaowen Liu , Jingbo Shang

While pre-trained language models (LMs) have brought great improvements in many NLP tasks, there is increasing attention to explore capabilities of LMs and interpret their predictions. However, existing works usually focus only on a certain…

Computation and Language · Computer Science 2022-07-29 Yaozong Shen , Lijie Wang , Ying Chen , Xinyan Xiao , Jing Liu , Hua Wu