English
Related papers

Related papers: Knowledge Base Completion Meets Transfer Learning

200 papers

Transfer learning has aroused great interest in the statistical community. In this article, we focus on knowledge transfer for unsupervised learning tasks in contrast to the supervised learning tasks in the literature. Given the…

Machine Learning · Statistics 2024-03-13 Zeyu Li , Kangxiang Qin , Yong He , Wang Zhou , Xinsheng Zhang

Automated claim checking is the task of determining the veracity of a claim given evidence found in a knowledge base of trustworthy facts. While previous work has taken the knowledge base as given and optimized the claim-checking pipeline,…

Computation and Language · Computer Science 2022-03-14 Dominik Stammbach , Boya Zhang , Elliott Ash

In this study, we focus on heterogeneous knowledge transfer across entirely different model architectures, tasks, and modalities. Existing knowledge transfer methods (e.g., backbone sharing, knowledge distillation) often hinge on shared…

Machine Learning · Computer Science 2024-12-30 Kunxi Li , Tianyu Zhan , Kairui Fu , Shengyu Zhang , Kun Kuang , Jiwei Li , Zhou Zhao , Fan Wu , Fei Wu

We introduce techniques for rapidly transferring the information stored in one neural net into another neural net. The main purpose is to accelerate the training of a significantly larger neural net. During real-world workflows, one often…

Machine Learning · Computer Science 2016-04-26 Tianqi Chen , Ian Goodfellow , Jonathon Shlens

Methods of transfer learning try to combine knowledge from several related tasks (or domains) to improve performance on a test task. Inspired by causal methodology, we relax the usual covariate shift assumption and assume that it holds true…

Machine Learning · Statistics 2018-09-25 Mateo Rojas-Carulla , Bernhard Schölkopf , Richard Turner , Jonas Peters

Structured knowledge bases (KBs) are a foundation of many intelligent applications, yet are notoriously incomplete. Language models (LMs) have recently been proposed for unsupervised knowledge base completion (KBC), yet, despite encouraging…

Computation and Language · Computer Science 2023-03-21 Blerta Veseli , Sneha Singhania , Simon Razniewski , Gerhard Weikum

Transferring knowledge in cross-domain reinforcement learning is a challenging setting in which learning is accelerated by reusing knowledge from a task with different observation and/or action space. However, it is often necessary to…

Machine Learning · Computer Science 2023-12-08 Sergio A. Serrano , Jose Martinez-Carranza , L. Enrique Sucar

Predicting missing facts in a knowledge graph (KG) is a crucial task in knowledge base construction and reasoning, and it has been the subject of much research in recent works using KG embeddings. While existing KG embedding approaches…

Computation and Language · Computer Science 2020-10-09 Xuelu Chen , Muhao Chen , Changjun Fan , Ankith Uppunda , Yizhou Sun , Carlo Zaniolo

Most existing approaches for Knowledge Base Question Answering (KBQA) focus on a specific underlying knowledge base either because of inherent assumptions in the approach, or because evaluating it on a different knowledge base requires…

Meta-Learning is a subarea of Machine Learning that aims to take advantage of prior knowledge to learn faster and with fewer data [1]. There are different scenarios where meta-learning can be applied, and one of the most common is algorithm…

Machine Learning · Computer Science 2019-10-17 Gean Trindade Pereira , Moisés dos Santos , Edesio Alcobaça , Rafael Mantovani , André Carvalho

Link prediction in large knowledge graphs has received a lot of attention recently because of its importance for inferring missing relations and for completing and improving noisily extracted knowledge graphs. Over the years a number of…

Machine Learning · Statistics 2016-05-17 Pushpendre Rastogi , Benjamin Van Durme

Knowledge graphs (KGs) of real-world facts about entities and their relationships are useful resources for a variety of natural language processing tasks. However, because knowledge graphs are typically incomplete, it is useful to perform…

Computation and Language · Computer Science 2020-10-28 Dat Quoc Nguyen

This paper proposes a novel approach for relation extraction from free text which is trained to jointly use information from the text and from existing knowledge. Our model is based on two scoring functions that operate by learning…

Computation and Language · Computer Science 2013-08-02 Jason Weston , Antoine Bordes , Oksana Yakhnenko , Nicolas Usunier

This paper considers the problem of knowledge inference on large-scale imperfect repositories with incomplete coverage by means of embedding entities and relations at the first attempt. We propose IIKE (Imperfect and Incomplete Knowledge…

Artificial Intelligence · Computer Science 2015-03-30 Miao Fan , Qiang Zhou , Thomas Fang Zheng

Deep learning-empowered semantic communication is regarded as a promising candidate for future 6G networks. Although existing semantic communication systems have achieved superior performance compared to traditional methods, the end-to-end…

Artificial Intelligence · Computer Science 2023-11-07 Peng Yi , Yang Cao , Xin Kang , Ying-Chang Liang

We describe a neural network model that jointly learns distributed representations of texts and knowledge base (KB) entities. Given a text in the KB, we train our proposed model to predict entities that are relevant to the text. Our model…

Computation and Language · Computer Science 2017-11-08 Ikuya Yamada , Hiroyuki Shindo , Hideaki Takeda , Yoshiyasu Takefuji

Knowledge graph completion aims to predict missing relations between entities in a knowledge graph. In this work, we propose a relational message passing method for knowledge graph completion. Different from existing embedding-based…

Machine Learning · Computer Science 2021-05-31 Hongwei Wang , Hongyu Ren , Jure Leskovec

In complex transfer learning scenarios new tasks might not be tightly linked to previous tasks. Approaches that transfer information contained only in the final parameters of a source model will therefore struggle. Instead, transfer…

Machine Learning · Computer Science 2019-03-25 Sebastian Flennerhag , Pablo G. Moreno , Neil D. Lawrence , Andreas Damianou

Knowledge bases (KBs) are often incomplete and constantly changing in practice. Yet, in many question answering applications coupled with knowledge bases, the sparse nature of KBs is often overlooked. To this end, we propose a case-based…

Knowledge base (KB) completion adds new facts to a KB by making inferences from existing facts, for example by inferring with high likelihood nationality(X,Y) from bornIn(X,Y). Most previous methods infer simple one-hop relational synonyms…

Computation and Language · Computer Science 2015-05-29 Arvind Neelakantan , Benjamin Roth , Andrew McCallum