English
Related papers

Related papers: Zero-Shot Relational Learning for Multimodal Knowl…

200 papers

Large Language Models (LLMs) possess human-level cognitive and decision-making capabilities, making them a key technology for 6G. However, applying LLMs to the communication domain faces three major challenges: 1) Inadequate communication…

Information Theory · Computer Science 2025-02-27 Feibo Jiang , Wanyun Zhu , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan , Octavia A. Dobre

Recognizing multiple labels of an image is a practical yet challenging task, and remarkable progress has been achieved by searching for semantic regions and exploiting label dependencies. However, current works utilize RNN/LSTM to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Tianshui Chen , Liang Lin , Riquan Chen , Xiaolu Hui , Hefeng Wu

Existing pre-trained models for knowledge-graph-to-text (KG-to-text) generation simply fine-tune text-to-text pre-trained models such as BART or T5 on KG-to-text datasets, which largely ignore the graph structure during encoding and lack…

Computation and Language · Computer Science 2021-06-22 Pei Ke , Haozhe Ji , Yu Ran , Xin Cui , Liwei Wang , Linfeng Song , Xiaoyan Zhu , Minlie Huang

Multimodal knowledge graphs (MMKGs) enrich traditional knowledge graphs (KGs) by incorporating diverse modalities such as images and text. multimodal knowledge graph completion (MMKGC) seeks to exploit these heterogeneous signals to infer…

Computation and Language · Computer Science 2025-08-12 Yongkang Xiao , Rui Zhang

A large number of studies have emerged for Multimodal Knowledge Graph Completion (MKGC) to predict the missing links in MKGs. However, fewer studies have been proposed to study the inductive MKGC (IMKGC) involving emerging entities unseen…

Multimedia · Computer Science 2024-07-04 Yu Zhao , Ying Zhang , Baohang Zhou , Xinying Qian , Kehui Song , Xiangrui Cai

Knowledge Graphs (KGs) and their machine learning counterpart, Knowledge Graph Embedding Models (KGEMs), have seen ever-increasing use in a wide variety of academic and applied settings. In particular, KGEMs are typically applied to KGs to…

Machine Learning · Computer Science 2024-12-16 Jeffrey Sardina , John D. Kelleher , Declan O'Sullivan

Data continuously emitted from industrial ecosystems such as social or e-commerce platforms are commonly represented as heterogeneous graphs (HG) composed of multiple node/edge types. State-of-the-art graph learning methods for HGs known as…

Machine Learning · Computer Science 2022-10-14 Minji Yoon , John Palowitch , Dustin Zelle , Ziniu Hu , Ruslan Salakhutdinov , Bryan Perozzi

State-of-the-art deep learning algorithms yield remarkable results in many visual recognition tasks. However, they still fail to provide satisfactory results in scarce data regimes. To a certain extent this lack of data can be compensated…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Frederik Pahde , Oleksiy Ostapenko , Patrick Jähnichen , Tassilo Klein , Moin Nabi

Real-world multimodal data usually exhibit complex structural relationships beyond traditional one-to-one mappings like image-caption pairs. Entities across modalities interact in intricate ways, with images and text forming diverse…

Machine Learning · Computer Science 2025-10-21 Xuying Ning , Dongqi Fu , Tianxin Wei , Wujiang Xu , Jingrui He

Graph Convolutional Networks (GCNs) have recently been shown to be quite successful in modeling graph-structured data. However, the primary focus has been on handling simple undirected graphs. Multi-relational graphs are a more general and…

Machine Learning · Computer Science 2020-01-22 Shikhar Vashishth , Soumya Sanyal , Vikram Nitin , Partha Talukdar

With the development of foundation models such as large language models, zero-shot transfer learning has become increasingly significant. This is highlighted by the generative capabilities of NLP models like GPT-4, and the retrieval-based…

Machine Learning · Computer Science 2024-06-25 Yuhan Li , Peisong Wang , Zhixun Li , Jeffrey Xu Yu , Jia Li

Entity alignment is the task of linking entities with the same real-world identity from different knowledge graphs (KGs), which has been recently dominated by embedding-based methods. Such approaches work by learning KG representations so…

Computation and Language · Computer Science 2019-08-23 Yuting Wu , Xiao Liu , Yansong Feng , Zheng Wang , Rui Yan , Dongyan Zhao

Representation learning of knowledge graphs aims to embed entities and relations into low-dimensional vectors. Most existing works only consider the direct relations or paths between an entity pair. It is considered that such approaches…

Computation and Language · Computer Science 2022-10-24 Sirui Li , Kok Wai Wong , Dengya Zhu , Chun Che Fung

Knowledge graphs (KGs) are an important tool for representing complex relationships between entities in the biomedical domain. Several methods have been proposed for learning embeddings that can be used to predict new links in such graphs.…

Artificial Intelligence · Computer Science 2026-05-12 Daniel Daza , Dimitrios Alivanistos , Payal Mitra , Thom Pijnenburg , Michael Cochez , Paul Groth

Knowledge graphs have emerged as an important model for studying complex multi-relational data. This has given rise to the construction of numerous large scale but incomplete knowledge graphs encoding information extracted from various…

Machine Learning · Computer Science 2018-07-24 Rakshit Trivedi , Bunyamin Sisman , Jun Ma , Christos Faloutsos , Hongyuan Zha , Xin Luna Dong

Zero-shot learning transfers knowledge from seen classes to novel unseen classes to reduce human labor of labelling data for building new classifiers. Much effort on zero-shot learning however has focused on the standard multi-class…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Meng Ye , Yuhong Guo

Zero-shot visual question answering (ZS-VQA), an emerged critical research area, intends to answer visual questions without providing training samples. Existing research in ZS-VQA has proposed to leverage knowledge graphs or large language…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Qian Tao , Xiaoyang Fan , Yong Xu , Xingquan Zhu , Yufei Tang

We introduce KBGAN, an adversarial learning framework to improve the performances of a wide range of existing knowledge graph embedding models. Because knowledge graphs typically only contain positive facts, sampling useful negative…

Computation and Language · Computer Science 2018-04-17 Liwei Cai , William Yang Wang

Knowledge graphs (KGs) contain rich information about world knowledge, entities and relations. Thus, they can be great supplements to existing pre-trained language models. However, it remains a challenge to efficiently integrate information…

Computation and Language · Computer Science 2020-10-05 Donghan Yu , Chenguang Zhu , Yiming Yang , Michael Zeng

Joint representation learning of text and knowledge within a unified semantic space enables us to perform knowledge graph completion more accurately. In this work, we propose a novel framework to embed words, entities and relations into the…

Computation and Language · Computer Science 2016-11-15 Xu Han , Zhiyuan Liu , Maosong Sun