English
Related papers

Related papers: Multimodal Contrastive Representation Learning in …

200 papers

Knowledge graph completion (KGC) aims to predict missing triples in knowledge graphs (KGs) by leveraging existing triples and textual information. Recently, generative large language models (LLMs) have been increasingly employed for graph…

Artificial Intelligence · Computer Science 2025-11-11 Yongkang Xiao , Sinian Zhang , Yi Dai , Huixue Zhou , Jue Hou , Jie Ding , Rui Zhang

Knowledge graphs (KGs), as structured representations of real world facts, are intelligent databases incorporating human knowledge that can help machine imitate the way of human problem solving. However, KGs are usually huge and there are…

Machine Learning · Computer Science 2023-06-27 Haotian Li , Hongri Liu , Yao Wang , Guodong Xin , Yuliang Wei

Clinicians are increasingly looking towards machine learning to gain insights about patient evolutions. We propose a novel approach named Multi-Modal UMLS Graph Learning (MMUGL) for learning meaningful representations of medical concepts…

Machine Learning · Computer Science 2024-02-07 Manuel Burger , Gunnar Rätsch , Rita Kuznetsova

Latent representations of drugs and their targets produced by contemporary graph autoencoder-based models have proved useful in predicting many types of node-pair interactions on large networks, including drug-drug, drug-target, and…

Biomolecules · Quantitative Biology 2022-11-01 Nhat Khang Ngo , Truong Son Hy , Risi Kondor

Entities may have complex interactions in a knowledge graph (KG), such as multi-step relationships, which can be viewed as graph contextual information of the entities. Traditional knowledge representation learning (KRL) methods usually…

Computation and Language · Computer Science 2020-12-08 Bin He , Di Zhou , Jing Xie , Jinghui Xiao , Xin Jiang , Qun Liu

The paper utilizes the graph embeddings generated for entities of a large biomedical database to perform link prediction to capture various new relationships among different entities. A novel node similarity measure is proposed that…

Information Retrieval · Computer Science 2021-11-01 Prakhar Gurawa , Matthias Nickles

Biomedical knowledge graphs (BKGs) have emerged as powerful tools for organizing and leveraging the vast and complex data found across the biomedical field. Yet, current reviews of BKGs often limit their scope to specific domains or…

Computation and Language · Computer Science 2025-01-23 Yuxing Lu , Sin Yee Goi , Xukai Zhao , Jinzhuo Wang

Link prediction is critical for the application of incomplete knowledge graph (KG) in the downstream tasks. As a family of effective approaches for link predictions, embedding methods try to learn low-rank representations for both entities…

Computation and Language · Computer Science 2019-11-22 Canran Xu , Ruijiang Li

Knowledge graph completion (KGC), the task of predicting missing information based on the existing relational data inside a knowledge graph (KG), has drawn significant attention in recent years. However, the predictive power of KGC methods…

Computation and Language · Computer Science 2023-05-26 Weihang Zhang , Ovidiu Serban , Jiahao Sun , Yi-ke Guo

Biomedical knowledge graphs (KGs) are widely used in the life sciences, yet many are derived from unstructured documents and therefore lack schema-level constrains, whereas graphs assembled from structured resources are difficult to…

Artificial Intelligence · Computer Science 2026-05-01 Lucas Vittor , Ayush Noori , Iñaki Arango , Joaquín Polonuer , Sam Rodriques , Andrew White , David A. Clifton , Marinka Zitnik

Word embeddings play a significant role in today's Natural Language Processing tasks and applications. While pre-trained models may be directly employed and integrated into existing pipelines, they are often fine-tuned to better fit with…

Computation and Language · Computer Science 2022-11-10 Denys Amore Bondarenko , Roger Ferrod , Luigi Di Caro

The integration of Artificial Intelligence (AI) into the field of drug discovery has been a growing area of interdisciplinary scientific research. However, conventional AI models are heavily limited in handling complex biomedical structures…

Machine Learning · Computer Science 2024-07-25 Zhiqiang Zhong , Anastasia Barkova , Davide Mottin

Biological systems are governed by structured molecular interactions, where pathways, regulatory circuits, and functional gene relationships shape cellular behavior and disease progression. Much of this knowledge is naturally represented as…

Machine Learning · Computer Science 2026-05-26 Yuwei Xue , Sakib Mostafa , James Zou , Joseph Liao , Maximilian Diehn , Ash A. Alizadeh , Lei Xing , Md. Tauhidul Islam

Multimodal electronic health record (EHR) data is useful for disease risk prediction based on medical domain knowledge. However, general medical knowledge must be adapted to specific healthcare settings and patient populations to achieve…

Artificial Intelligence · Computer Science 2025-09-29 Mbithe Nzomo , Deshendran Moodley

Multi-modal knowledge graphs (MKGs) include not only the relation triplets, but also related multi-modal auxiliary data (i.e., texts and images), which enhance the diversity of knowledge. However, the natural incompleteness has…

Artificial Intelligence · Computer Science 2022-09-07 Shangfei Zheng , Weiqing Wang , Jianfeng Qu , Hongzhi Yin , Wei Chen , Lei Zhao

Knowledge graphs (KGs) are important products of the semantic web, which are widely used in various application domains. Healthcare is one of such domains where KGs are intensively used, due to the high requirement for knowledge accuracy…

Artificial Intelligence · Computer Science 2025-07-31 Yuzhang Xie , Xu Han , Ran Xu , Xiao Hu , Jiaying Lu , Carl Yang

Multimodal learning combines multiple data modalities, broadening the types and complexity of data our models can utilize: for example, from plain text to image-caption pairs. Most multimodal learning algorithms focus on modeling simple…

Artificial Intelligence · Computer Science 2023-10-13 Minji Yoon , Jing Yu Koh , Bryan Hooi , Ruslan Salakhutdinov

Logical query answering over Knowledge Graphs (KGs) is a fundamental yet complex task. A promising approach to achieve this is to embed queries and entities jointly into the same embedding space. Research along this line suggests that using…

Information Retrieval · Computer Science 2024-03-29 Yuhan Wu , Yuanyuan Xu , Wenjie Zhang , Xiwei Xu , Ying Zhang

Constructing domain-specific knowledge graphs from unstructured text remains challenging due to heterogeneous entity mentions, long-tail relation distributions, and the absence of standardized schemas. We present LEC-KG, a bidirectional…

Computation and Language · Computer Science 2026-03-02 Yikai Zeng , Yingchao Piao , Changhua Pei , Jianhui Li

Multimodal Knowledge Graphs (MMKGs), which represent explicit knowledge across multiple modalities, play a pivotal role by complementing the implicit knowledge of Multimodal Large Language Models (MLLMs) and enabling more grounded reasoning…

Computation and Language · Computer Science 2025-09-29 Hyeongcheol Park , Jiyoung Seo , MinHyuk Jang , Hogun Park , Ha Dam Baek , Gyusam Chang , Hyeonsoo Im , Sangpil Kim