English
Related papers

Related papers: Improving Knowledge Graph Representation Learning …

200 papers

The majority of knowledge graph embedding techniques treat entities and predicates as separate embedding matrices, using aggregation functions to build a representation of the input triple. However, these aggregations are lossy, i.e. they…

Computation and Language · Computer Science 2022-08-23 Alexander Kalinowski , Yuan An

Inspired by the success of large language models, there is a trend toward developing graph foundation models to conduct diverse downstream tasks in various domains. However, current models often require extra fine-tuning to apply their…

Machine Learning · Computer Science 2025-05-16 Kai Wang , Siqiang Luo , Caihua Shan , Yifei Shen

Fine-tuning pre-trained language models (PLMs) has recently shown a potential to improve knowledge graph completion (KGC). However, most PLM-based methods focus solely on encoding textual information, neglecting the long-tailed nature of…

Computation and Language · Computer Science 2025-02-03 Youmin Ko , Hyemin Yang , Taeuk Kim , Hyunjoon Kim

Traditional computer vision approaches, based on neural networks (NN), are typically trained on a large amount of image data. By minimizing the cross-entropy loss between a prediction and a given class label, the NN and its visual embedding…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Sebastian Monka , Lavdim Halilaj , Stefan Schmid , Achim Rettinger

Modelling learning objects (LO) within their context enables the learner to advance from a basic, remembering-level, learning objective to a higher-order one, i.e., a level with an application- and analysis objective. While hierarchical…

Information Retrieval · Computer Science 2024-01-25 Hasan Abu-Rasheed , Mareike Dornhöfer , Christian Weber , Gábor Kismihók , Ulrike Buchmann , Madjid Fathi

Most recently, there has been significant interest in learning contextual representations for various NLP tasks, by leveraging large scale text corpora to train large neural language models with self-supervised learning objectives, such as…

Computation and Language · Computer Science 2020-12-21 Peng Shi , Patrick Ng , Zhiguo Wang , Henghui Zhu , Alexander Hanbo Li , Jun Wang , Cicero Nogueira dos Santos , Bing Xiang

In the realm of computational knowledge representation, Knowledge Graph Reasoning (KG-R) stands at the forefront of facilitating sophisticated inferential capabilities across multifarious domains. The quintessence of this research…

Artificial Intelligence · Computer Science 2024-03-12 Chen Li , Haotian Zheng , Yiping Sun , Cangqing Wang , Liqiang Yu , Che Chang , Xinyu Tian , Bo Liu

In the task of Knowledge Graph Completion (KGC), the existing datasets and their inherent subtasks carry a wealth of shared knowledge that can be utilized to enhance the representation of knowledge triplets and overall performance. However,…

Computation and Language · Computer Science 2024-05-14 Yongxue Shan , Jie Zhou , Jie Peng , Xin Zhou , Jiaqian Yin , Xiaodong Wang

Conversational recommender systems (CRS) utilize natural language interactions and dialogue history to infer user preferences and provide accurate recommendations. Due to the limited conversation context and background knowledge, existing…

Computation and Language · Computer Science 2024-05-02 Zhangchi Qiu , Ye Tao , Shirui Pan , Alan Wee-Chung Liew

Knowledge Graph Embedding (KGE) techniques are crucial in learning compact representations of entities and relations within a knowledge graph, facilitating efficient reasoning and knowledge discovery. While existing methods typically focus…

Computation and Language · Computer Science 2024-10-29 Pengcheng Jiang , Lang Cao , Cao Xiao , Parminder Bhatia , Jimeng Sun , Jiawei Han

Knowledge Graph Completion (KGC) aims to infer missing information in Knowledge Graphs (KGs) to address their inherent incompleteness. Traditional structure-based KGC methods, while effective, face significant computational demands and…

Computation and Language · Computer Science 2025-04-01 Jianfang Chen , Kai Zhang , Aoran Gan , Shiwei Tong , Shuanghong Shen , Qi Liu

Conventional Knowledge Graph Completion (KGC) assumes that all test entities appear during training. However, in real-world scenarios, Knowledge Graphs (KG) evolve fast with out-of-knowledge-graph (OOKG) entities added frequently, and we…

Computation and Language · Computer Science 2020-09-29 Damai Dai , Hua Zheng , Fuli Luo , Pengcheng Yang , Baobao Chang , Zhifang Sui

Knowledge Graphs (KGs) are widely employed in artificial intelligence applications, such as question-answering and recommendation systems. However, KGs are frequently found to be incomplete. While much of the existing literature focuses on…

Artificial Intelligence · Computer Science 2024-06-28 Sakher Khalil Alqaaidi , Krzysztof Kochut

Intelligent systems designed using machine learning algorithms require a large number of labeled data. Background knowledge provides complementary, real world factual information that can augment the limited labeled data to train a machine…

Artificial Intelligence · Computer Science 2020-05-12 Shreyansh Bhatt , Amit Sheth , Valerie Shalin , Jinjin Zhao

Recent trends in NLP utilize knowledge graphs (KGs) to enhance pretrained language models by incorporating additional knowledge from the graph structures to learn domain-specific terminology or relationships between documents that might…

Computation and Language · Computer Science 2025-10-08 Anastasia Zhukova , Jonas Lührs , Christian E. Lobmüller , Bela Gipp

Knowledge graphs (KGs) contain rich information about world knowledge, entities and relations. Thus, they can be great supplements to existing pre-trained language models. However, it remains a challenge to efficiently integrate information…

Computation and Language · Computer Science 2020-10-05 Donghan Yu , Chenguang Zhu , Yiming Yang , Michael Zeng

Knowledge graphs can represent information about the real-world using entities and their relations in a structured and semantically rich manner and they enable a variety of downstream applications such as question-answering, recommendation…

Computation and Language · Computer Science 2023-05-16 Hanieh Khorashadizadeh , Nandana Mihindukulasooriya , Sanju Tiwari , Jinghua Groppe , Sven Groppe

Question Answering over Knowledge Graph (KGQA) aims to seek answer entities for the natural language question from a large-scale Knowledge Graph~(KG). To better perform reasoning on KG, recent work typically adopts a pre-trained language…

Computation and Language · Computer Science 2024-01-02 Jinhao Jiang , Kun Zhou , Wayne Xin Zhao , Yaliang Li , Ji-Rong Wen

Several recent efforts have been devoted to enhancing pre-trained language models (PLMs) by utilizing extra heterogeneous knowledge in knowledge graphs (KGs) and achieved consistent improvements on various knowledge-driven NLP tasks.…

Computation and Language · Computer Science 2023-04-06 Yusheng Su , Xu Han , Zhengyan Zhang , Peng Li , Zhiyuan Liu , Yankai Lin , Jie Zhou , Maosong Sun

Embedding knowledge graphs (KGs) into continuous vector spaces is a focus of current research. Early works performed this task via simple models developed over KG triples. Recent attempts focused on either designing more complicated triple…

Artificial Intelligence · Computer Science 2018-06-08 Boyang Ding , Quan Wang , Bin Wang , Li Guo