English
Related papers

Related papers: Complementarity-driven Representation Learning for…

200 papers

Multimodal reasoning with large language models (LLMs) often suffers from hallucinations and the presence of deficient or outdated knowledge within LLMs. Some approaches have sought to mitigate these issues by employing textual knowledge…

Computation and Language · Computer Science 2024-06-06 Junlin Lee , Yequan Wang , Jing Li , Min Zhang

Clinicians are increasingly looking towards machine learning to gain insights about patient evolutions. We propose a novel approach named Multi-Modal UMLS Graph Learning (MMUGL) for learning meaningful representations of medical concepts…

Machine Learning · Computer Science 2024-02-07 Manuel Burger , Gunnar Rätsch , Rita Kuznetsova

Federated learning (FL) has obtained tremendous progress in providing collaborative training solutions for distributed data silos with privacy guarantees. However, few existing works explore a more realistic scenario where the clients hold…

Machine Learning · Computer Science 2024-06-18 Liwei Che , Jiaqi Wang , Xinyue Liu , Fenglong Ma

Recent years have witnessed the resurgence of knowledge engineering which is featured by the fast growth of knowledge graphs. However, most of existing knowledge graphs are represented with pure symbols, which hurts the machine's capability…

Artificial Intelligence · Computer Science 2022-12-20 Xiangru Zhu , Zhixu Li , Xiaodan Wang , Xueyao Jiang , Penglei Sun , Xuwu Wang , Yanghua Xiao , Nicholas Jing Yuan

Knowledge graph completion (KGC) tasks aim to infer missing facts in a knowledge graph (KG) for many knowledge-intensive applications. However, existing embedding-based KGC approaches primarily rely on factual triples, potentially leading…

Artificial Intelligence · Computer Science 2024-10-08 Guanglin Niu , Bo Li , Siling Feng

Biomedical knowledge graphs are increasingly large, dynamic, and multimodal, driven by rapid advances in biotechnology such as high-throughput sequencing. Machine learning models can infer previously unobserved biomedical relationships and…

Machine Learning · Computer Science 2026-05-12 Yousef A. Radwan , Yao Li , Qing Qing , Ziqi Xu , Qixin Zhang , Yongcheng Jing , Renqiang Luo , Xikun Zhang

Multimodal Knowledge Graph Completion (MMKGC) aims to address the critical issue of missing knowledge in multimodal knowledge graphs (MMKGs) for their better applications. However, both the previous MMGKC and negative sampling (NS)…

Artificial Intelligence · Computer Science 2025-01-28 Guanglin Niu , Xiaowei Zhang

Benefiting from the powerful expressive capability of graphs, graph-based approaches have achieved impressive performance in various biomedical applications. Most existing methods tend to define the adjacency matrix among samples manually…

Machine Learning · Computer Science 2021-07-02 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Zhenyu Guo , Yang Liu , Yao Zhao

Knowledge graph completion (KGC) aims to solve the incompleteness of knowledge graphs (KGs) by predicting missing links from known triples, numbers of knowledge graph embedding (KGE) models have been proposed to perform KGC by learning…

Artificial Intelligence · Computer Science 2023-06-14 Jining Wang , Delai Qiu , YouMing Liu , Yining Wang , Chuan Chen , Zibin Zheng , Yuren Zhou

Multi-modal entity alignment aims to identify equivalent entities between two multi-modal Knowledge graphs by integrating multi-modal data, such as images and text, to enrich the semantic representations of entities. However, existing…

Artificial Intelligence · Computer Science 2026-01-21 Zhifei Li , Ziyue Qin , Xiangyu Luo , Xiaoju Hou , Yue Zhao , Miao Zhang , Zhifang Huang , Kui Xiao , Bing Yang

Large Language Models (LLMs) often suffer from hallucinations, which Retrieval-Augmented Generation (RAG) and GraphRAG mitigate by incorporating external knowledge and knowledge graphs (KGs). However, GraphRAG remains text-centric due to…

Artificial Intelligence · Computer Science 2026-03-11 Xueyao Wan , Hang Yu

Multimodal knowledge graphs (MKGs), which intuitively organize information in various modalities, can benefit multiple practical downstream tasks, such as recommendation systems, and visual question answering. However, most MKGs are still…

Artificial Intelligence · Computer Science 2023-07-10 Ke Liang , Sihang Zhou , Yue Liu , Lingyuan Meng , Meng Liu , Xinwang Liu

Multimodal Action Quality Assessment (AQA) has recently emerged as a promising paradigm. By leveraging complementary information across shared contextual cues, it enhances the discriminative evaluation of subtle intra-class variations in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Huangbiao Xu , Huanqi Wu , Xiao Ke , Junyi Wu , Rui Xu , Jinglin Xu

As medical diagnoses increasingly leverage multimodal data, machine learning models are expected to effectively fuse heterogeneous information while remaining robust to missing modalities. In this work, we propose a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yi Gu , Kuniaki Saito , Jiaxin Ma

Real-world multimodal knowledge graphs (MKGs) are inherently heterogeneous, modeling entities that are associated with diverse modalities. Traditional knowledge graph embedding (KGE) methods excel at learning continuous representations of…

Artificial Intelligence · Computer Science 2026-03-16 Athanasios Efthymiou , Stevan Rudinac , Monika Kackovic , Nachoem Wijnberg , Marcel Worring

Knowledge graph embedding~(KGE) aims to represent entities and relations into low-dimensional vectors for many real-world applications. The representations of entities and relations are learned via contrasting the positive and negative…

Artificial Intelligence · Computer Science 2022-02-22 Feihu Che , Guohua Yang , Pengpeng Shao , Dawei Zhang , Jianhua Tao

Knowledge graph entity typing (KGET) aims at inferring plausible types of entities in knowledge graphs. Existing approaches to KGET focus on how to better encode the knowledge provided by the neighbors and types of an entity into its…

Computation and Language · Computer Science 2023-10-19 Zhiwei Hu , Víctor Gutiérrez-Basulto , Zhiliang Xiang , Ru Li , Jeff Z. Pan

The multimodal knowledge graph reasoning (MKGR) task aims to predict the missing facts in the incomplete MKGs by leveraging auxiliary images and descriptions of entities. Existing approaches are trained with single-target objectives, which…

Multimedia · Computer Science 2025-07-29 Yu Zhao , Ying Zhang , Xuhui Sui , Baohang Zhou , Haoze Zhu , Jeff Z. Pan , Xiaojie Yuan

Multi-Modal Entity Alignment aims to discover identical entities across heterogeneous knowledge graphs. While recent studies have delved into fusion paradigms to represent entities holistically, the elimination of features irrelevant to…

Computation and Language · Computer Science 2024-07-24 Yani Huang , Xuefeng Zhang , Richong Zhang , Junfan Chen , Jaein Kim

In recent years, the advancement of Graph Neural Networks (GNNs) has significantly propelled progress in Multi-View Clustering (MVC). However, existing methods face the problem of coarse-grained graph fusion. Specifically, current…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jian Zhu , Xin Zou , Jun Sun , Cheng Luo , Lei Liu , Lingfang Zeng , Ning Zhang , Bian Wu , Chang Tang , Lirong Dai