English
Related papers

Related papers: Pre-training Transformers for Knowledge Graph Comp…

200 papers

Different from traditional knowledge graphs (KGs) where facts are represented as entity-relation-entity triplets, hyper-relational KGs (HKGs) allow triplets to be associated with additional relation-entity pairs (a.k.a qualifiers) to convey…

Machine Learning · Computer Science 2021-04-19 Donghan Yu , Yiming Yang

Foundation models in language and vision have the ability to run inference on any textual and visual inputs thanks to the transferable representations such as a vocabulary of tokens in language. Knowledge graphs (KGs) have different entity…

Computation and Language · Computer Science 2024-04-11 Mikhail Galkin , Xinyu Yuan , Hesham Mostafa , Jian Tang , Zhaocheng Zhu

Knowledge graphs (KGs) are ubiquitous and widely used in various applications. However, most real-world knowledge graphs are incomplete, which significantly degrades their performance on downstream tasks. Additionally, the relationships in…

Artificial Intelligence · Computer Science 2025-04-08 Lihui Liu , Zihao Wang , Dawei Zhou , Ruijie Wang , Yuchen Yan , Bo Xiong , Sihong He , Kai Shu , Hanghang Tong

Multimodal Knowledge Graphs (MKGs), which organize visual-text factual knowledge, have recently been successfully applied to tasks such as information retrieval, question answering, and recommendation system. Since most MKGs are far from…

Computation and Language · Computer Science 2023-09-19 Xiang Chen , Ningyu Zhang , Lei Li , Shumin Deng , Chuanqi Tan , Changliang Xu , Fei Huang , Luo Si , Huajun Chen

Knowledge graphs, as the cornerstone of many AI applications, usually face serious incompleteness problems. In recent years, there have been many efforts to study automatic knowledge graph completion (KGC), most of which use existing…

Computation and Language · Computer Science 2022-10-13 Xin Lv , Yankai Lin , Zijun Yao , Kaisheng Zeng , Jiajie Zhang , Lei Hou , Juanzi Li

Multimodal knowledge graphs (MKGs), which intuitively organize information in various modalities, can benefit multiple practical downstream tasks, such as recommendation systems, and visual question answering. However, most MKGs are still…

Artificial Intelligence · Computer Science 2023-07-10 Ke Liang , Sihang Zhou , Yue Liu , Lingyuan Meng , Meng Liu , Xinwang Liu

Generating knowledge grounded responses in both goal and non-goal oriented dialogue systems is an important research challenge. Knowledge Graphs (KG) can be viewed as an abstraction of the real world, which can potentially facilitate a…

Computation and Language · Computer Science 2021-03-31 Debanjan Chaudhuri , Md Rashad Al Hasan Rony , Jens Lehmann

We propose the Interferometric Graph Transform (IGT), which is a new class of deep unsupervised graph convolutional neural network for building graph representations. Our first contribution is to propose a generic, complex-valued spectral…

Machine Learning · Computer Science 2020-06-11 Edouard Oyallon

An emerging trend in representation learning over knowledge graphs (KGs) moves beyond transductive link prediction tasks over a fixed set of known entities in favor of inductive tasks that imply training on one graph and performing…

Machine Learning · Computer Science 2022-04-20 Mikhail Galkin , Max Berrendorf , Charles Tapley Hoyt

In this work, we present an end-to-end Knowledge Graph Question Answering (KGQA) system named GETT-QA. GETT-QA uses T5, a popular text-to-text pre-trained language model. The model takes a question in natural language as input and produces…

Computation and Language · Computer Science 2023-03-29 Debayan Banerjee , Pranav Ajit Nair , Ricardo Usbeck , Chris Biemann

Recent work on Graph Neural Networks has demonstrated that self-supervised pretraining can further enhance performance on downstream graph, link, and node classification tasks. However, the efficacy of pretraining tasks has not been fully…

Machine Learning · Computer Science 2023-03-28 Jonathan Pilault , Michael Galkin , Bahare Fatemi , Perouz Taslakian , David Vasquez , Christopher Pal

Real-world Knowledge Graphs (KGs) often suffer from incompleteness, which limits their potential performance. Knowledge Graph Completion (KGC) techniques aim to address this issue. However, traditional KGC methods are computationally…

Computation and Language · Computer Science 2023-11-03 Alla Chepurova , Aydar Bulatov , Yuri Kuratov , Mikhail Burtsev

Knowledge graphs (KGs) consisting of a large number of triples have become widespread recently, and many knowledge graph embedding (KGE) methods are proposed to embed entities and relations of a KG into continuous vector spaces. Such…

Machine Learning · Computer Science 2022-05-09 Mingyang Chen , Wen Zhang , Yushan Zhu , Hongting Zhou , Zonggang Yuan , Changliang Xu , Huajun Chen

Knowledge representation learning has been commonly adopted to incorporate knowledge graph (KG) into various online services. Although existing knowledge representation learning methods have achieved considerable performance improvement,…

Machine Learning · Computer Science 2022-05-18 Binbin Hu , Zhiyang Hu , Zhiqiang Zhang , Jun Zhou , Chuan Shi

Inference on a large-scale knowledge graph (KG) is of great importance for KG applications like question answering. The path-based reasoning models can leverage much information over paths other than pure triples in the KG, which face…

Artificial Intelligence · Computer Science 2020-10-07 Guanglin Niu , Bo Li , Yongfei Zhang , Yongpan Sheng , Chuan Shi , Jingyang Li , Shiliang Pu

Knowledge graph embedding (KGE) models learn the representation of entities and relations in knowledge graphs. Distance-based methods show promising performance on link prediction task, which predicts the result by the distance between two…

Computation and Language · Computer Science 2022-12-26 Baoxin Wang , Qingye Meng , Ziyue Wang , Honghong Zhao , Dayong Wu , Wanxiang Che , Shijin Wang , Zhigang Chen , Cong Liu

In this paper, we propose an image quality transformer (IQT) that successfully applies a transformer architecture to a perceptual full-reference image quality assessment (IQA) task. Perceptual representation becomes more important in image…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Manri Cheon , Sung-Jun Yoon , Byungyeon Kang , Junwoo Lee

Relation prediction in knowledge graphs is dominated by embedding based methods which mainly focus on the transductive setting. Unfortunately, they are not able to handle inductive learning where unseen entities and relations are present…

Computation and Language · Computer Science 2021-03-15 Hanwen Zha , Zhiyu Chen , Xifeng Yan

Knowledge graphs (KGs), i.e. representation of information as a semantic graph, provide a significant test bed for many tasks including question answering, recommendation, and link prediction. Various amount of scholarly metadata have been…

Artificial Intelligence · Computer Science 2019-04-30 Mojtaba Nayyeri , Sahar Vahdati , Jens Lehmann , Hamed Shariat Yazdi

The goal of knowledge graph completion (KGC) is to predict missing links in a KG using trained facts that are already known. In recent, pre-trained language model (PLM) based methods that utilize both textual and structural information are…

Artificial Intelligence · Computer Science 2023-11-09 Sang-Hyun Je , Wontae Choi , Kwangjin Oh