English
Related papers

Related papers: Pre-training and Diagnosing Knowledge Base Complet…

200 papers

Knowledge bases provide applications with the benefit of easily accessible, systematic relational knowledge but often suffer in practice from their incompleteness and lack of knowledge of new entities and relations. Much work has focused on…

Computation and Language · Computer Science 2013-03-19 Danqi Chen , Richard Socher , Christopher D. Manning , Andrew Y. Ng

Pre-trained language models (LMs) are used for knowledge intensive tasks like question answering, but their knowledge gets continuously outdated as the world changes. Prior work has studied targeted updates to LMs, injecting individual…

Computation and Language · Computer Science 2023-05-03 Yasumasa Onoe , Michael J. Q. Zhang , Shankar Padmanabhan , Greg Durrett , Eunsol Choi

We propose a simple and effective method for machine translation evaluation which does not require reference translations. Our approach is based on (1) grounding the entity mentions found in each source sentence and candidate translation…

Computation and Language · Computer Science 2020-09-24 Zorik Gekhman , Roee Aharoni , Genady Beryozkin , Markus Freitag , Wolfgang Macherey

Conventional Knowledge Graph Completion (KGC) assumes that all test entities appear during training. However, in real-world scenarios, Knowledge Graphs (KG) evolve fast with out-of-knowledge-graph (OOKG) entities added frequently, and we…

Computation and Language · Computer Science 2020-09-29 Damai Dai , Hua Zheng , Fuli Luo , Pengcheng Yang , Baobao Chang , Zhifang Sui

Knowledge graphs (KGs) are typically incomplete and we often wish to infer new facts given the existing ones. This can be thought of as a binary classification problem; we aim to predict if new facts are true or false. Unfortunately, we…

Machine Learning · Computer Science 2022-01-11 Ainaz Hajimoradlou , Mehran Kazemi

In entity linking, mentions of named entities in raw text are disambiguated against a knowledge base (KB). This work focuses on linking to unseen KBs that do not have training data and whose schema is unknown during training. Our approach…

Computation and Language · Computer Science 2020-10-23 Yogarshi Vyas , Miguel Ballesteros

Ontology embeddings map classes, roles, and individuals in ontologies into $\mathbb{R}^n$, and within $\mathbb{R}^n$ similarity between entities can be computed or new axioms inferred. For ontologies in the Description Logic…

Artificial Intelligence · Computer Science 2026-02-24 Olga Mashkova , Fernando Zhapa-Camacho , Robert Hoehndorf

Knowledge base construction entails acquiring structured information to create a knowledge base of factual and relational data, facilitating question answering, information retrieval, and semantic understanding. The challenge called…

Computation and Language · Computer Science 2023-10-13 Dong Yang , Xu Wang , Remzi Celebi

This paper tackles the problem of endogenous link prediction for Knowledge Base completion. Knowledge Bases can be represented as directed graphs whose nodes correspond to entities and edges to relationships. Previous attempts either…

Artificial Intelligence · Computer Science 2015-06-03 Alberto Garcia-Duran , Antoine Bordes , Nicolas Usunier , Yves Grandvalet

We study the problem of learning representations of entities and relations in knowledge graphs for predicting missing links. The success of such a task heavily relies on the ability of modeling and inferring the patterns of (or between) the…

Machine Learning · Computer Science 2019-02-28 Zhiqing Sun , Zhi-Hong Deng , Jian-Yun Nie , Jian Tang

There have been many recent investigations into prompt-based training of transformer language models for new text genres in low-resource settings. The prompt-based training approach has been found to be effective in generalizing pre-trained…

Computation and Language · Computer Science 2023-06-13 Jennifer D'Souza , Moussab Hrou , Sören Auer

Knowledge graphs are used to represent relational information in terms of triples. To enable learning about domains, embedding models, such as tensor factorization models, can be used to make predictions of new triples. Often there is…

Machine Learning · Computer Science 2018-12-11 Bahare Fatemi , Siamak Ravanbakhsh , David Poole

Knowledge Graph Embedding (KGE) techniques are crucial in learning compact representations of entities and relations within a knowledge graph, facilitating efficient reasoning and knowledge discovery. While existing methods typically focus…

Computation and Language · Computer Science 2024-10-29 Pengcheng Jiang , Lang Cao , Cao Xiao , Parminder Bhatia , Jimeng Sun , Jiawei Han

The factual knowledge acquired during pre-training and stored in the parameters of Language Models (LMs) can be useful in downstream tasks (e.g., question answering or textual inference). However, some facts can be incorrectly induced or…

Computation and Language · Computer Science 2021-09-10 Nicola De Cao , Wilker Aziz , Ivan Titov

Knowledge Graph Completion is a task of expanding the knowledge graph/base through estimating possible entities, or proper nouns, that can be connected using a set of predefined relations, or verb/predicates describing interconnections of…

Computation and Language · Computer Science 2021-01-25 Tong Chen , Sirou Zhu , Yiming Wen , Zhaomin Zheng

Knowledge graphs (KGs) play a crucial role in many applications, such as question answering, but incompleteness is an urgent issue for their broad application. Much research in knowledge graph completion (KGC) has been performed to resolve…

Artificial Intelligence · Computer Science 2023-01-10 Yinyu Lan , Shizhu He , Kang Liu , Jun Zhao

Most of previous work in knowledge base (KB) completion has focused on the problem of relation extraction. In this work, we focus on the task of inferring missing entity type instances in a KB, a fundamental task for KB competition yet…

Computation and Language · Computer Science 2015-04-28 Arvind Neelakantan , Ming-Wei Chang

Knowledge graph embeddings rank among the most successful methods for link prediction in knowledge graphs, i.e., the task of completing an incomplete collection of relational facts. A downside of these models is their strong sensitivity to…

Machine Learning · Statistics 2019-07-03 Robert Bamler , Farnood Salehi , Stephan Mandt

Recent progress in pretraining language models on large textual corpora led to a surge of improvements for downstream NLP tasks. Whilst learning linguistic knowledge, these models may also be storing relational knowledge present in the…

Computation and Language · Computer Science 2019-09-05 Fabio Petroni , Tim Rocktäschel , Patrick Lewis , Anton Bakhtin , Yuxiang Wu , Alexander H. Miller , Sebastian Riedel

Knowledge Graph (KG) alignment is to discover the mappings (i.e., equivalent entities, relations, and others) between two KGs. The existing methods can be divided into the embedding-based models, and the conventional reasoning and lexical…

Computation and Language · Computer Science 2021-06-14 Zhiyuan Qi , Ziheng Zhang , Jiaoyan Chen , Xi Chen , Yuejia Xiang , Ningyu Zhang , Yefeng Zheng