English
Related papers

Related papers: VL-KGE: Vision-Language Models Meet Knowledge Grap…

200 papers

Knowledge graph (KG) embeddings have shown great power in learning representations of entities and relations for link prediction tasks. Previous work usually embeds KGs into a single geometric space such as Euclidean space (zero curved),…

Machine Learning · Computer Science 2022-06-28 Zongsheng Cao , Qianqian Xu , Zhiyong Yang , Xiaochun Cao , Qingming Huang

Multimodal Large Language Models (MLLMs) have demonstrated impressive progress in single-image grounding and general multi-image understanding. Recently, some methods begin to address multi-image grounding. However, they are constrained by…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Shurong Zheng , Yousong Zhu , Hongyin Zhao , Fan Yang , Yufei Zhan , Ming Tang , Jinqiao Wang

Recent advances in multimodal training have significantly improved the integration of image understanding and generation within a unified model. This study investigates how vision-language models (VLMs) handle image-understanding tasks,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Alessandro Pietro Serra , Francesco Ortu , Emanuele Panizon , Lucrezia Valeriani , Lorenzo Basile , Alessio Ansuini , Diego Doimo , Alberto Cazzaniga

The rise of Multi-modal Pre-training highlights the necessity for a unified Multi-Modal Knowledge Graph (MMKG) representation learning framework. Such a framework is essential for embedding structured knowledge into multi-modal Large…

Computation and Language · Computer Science 2025-01-16 Zhuo Chen , Yin Fang , Yichi Zhang , Lingbing Guo , Jiaoyan Chen , Jeff Z. Pan , Huajun Chen , Wen Zhang

The multi-modal entity alignment (MMEA) aims to find all equivalent entity pairs between multi-modal knowledge graphs (MMKGs). Rich attributes and neighboring entities are valuable for the alignment task, but existing works ignore…

Computation and Language · Computer Science 2023-04-05 Qian Li , Shu Guo , Yangyifei Luo , Cheng Ji , Lihong Wang , Jiawei Sheng , Jianxin Li

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation. However, they often struggle with complex reasoning tasks and are prone to hallucination. Recent research has shown…

Computation and Language · Computer Science 2024-12-17 Xue Wu , Kostas Tsioutsiouliklis

Knowledge graph embedding (KGE) models have been proposed to improve the performance of knowledge graph reasoning. However, there is a general phenomenon in most of KGEs, as the training progresses, the symmetric relations tend to zero…

Artificial Intelligence · Computer Science 2019-05-24 Jinkui Yao , Lianghua Xu

Knowledge graph embedding (KGE) has become a fundamental technique for representation learning on multi-relational data. Many seminal models, such as TransE, operate in an unbounded Euclidean space, which presents inherent limitations in…

Machine Learning · Computer Science 2025-11-05 Xuan-Truong Quan , Xuan-Son Quan , Duc Do Minh , Vinh Nguyen Van

Many AI-related tasks involve the interactions of data in multiple modalities. It has been a new trend to merge multi-modal information into knowledge graph(KG), resulting in multi-modal knowledge graphs (MMKG). However, MMKGs usually…

Artificial Intelligence · Computer Science 2021-06-08 Hao Guo , Jiuyang Tang , Weixin Zeng , Xiang Zhao , Li Liu

Knowledge Graphs (KGs) play a pivotal role in advancing various AI applications, with the semantic web community's exploration into multi-modal dimensions unlocking new avenues for innovation. In this survey, we carefully review over 300…

Many recent works have demonstrated the benefits of knowledge graph embeddings in completing monolingual knowledge graphs. Inasmuch as related knowledge bases are built in several different languages, achieving cross-lingual knowledge…

Artificial Intelligence · Computer Science 2017-05-19 Muhao Chen , Yingtao Tian , Mohan Yang , Carlo Zaniolo

Representing entities and relations in an embedding space is a well-studied approach for machine learning on relational data. Existing approaches, however, primarily focus on simple link structure between a finite set of entities, ignoring…

Artificial Intelligence · Computer Science 2018-09-11 Pouya Pezeshkpour , Liyan Chen , Sameer Singh

Adversarial attacks on knowledge graph embeddings (KGE) aim to disrupt the model's ability of link prediction by removing or inserting triples. A recent black-box method has attempted to incorporate textual and structural information to…

Computation and Language · Computer Science 2025-10-15 Ting Li , Yang Yang , Yipeng Yu , Liang Yao , Guoqing Chao , Ruifeng Xu

Cross-modal entity linking refers to the ability to align entities and their attributes across different modalities. While cross-modal entity linking is a fundamental skill needed for real-world applications such as multimodal code…

Computation and Language · Computer Science 2025-06-02 Iñigo Alonso , Gorka Azkune , Ander Salaberria , Jeremy Barnes , Oier Lopez de Lacalle

Knowledge graph (KG) alignment - the task of recognizing entities referring to the same thing in different KGs - is recognized as one of the most important operations in the field of KG construction and completion. However, existing…

Computation and Language · Computer Science 2022-03-16 Vinh Van Tong , Thanh Trung Huynh , Thanh Tam Nguyen , Hongzhi Yin , Quoc Viet Hung Nguyen , Quyet Thang Huynh

Knowledge graphs (KGs) consist of links that describe relationships between entities. Due to the difficulty of manually enumerating all relationships between entities, automatically completing them is essential for KGs. Knowledge Graph…

Computation and Language · Computer Science 2024-06-07 Yusuke Sakai , Hidetaka Kamigaito , Katsuhiko Hayashi , Taro Watanabe

Knowledge-enhanced language representation learning has shown promising results across various knowledge-intensive NLP tasks. However, prior methods are limited in efficient utilization of multilingual knowledge graph (KG) data for language…

Computation and Language · Computer Science 2022-10-20 Linlin Liu , Xin Li , Ruidan He , Lidong Bing , Shafiq Joty , Luo Si

The advent of Large Language Models (LLMs) has significantly reshaped the trajectory of the AI revolution. Nevertheless, these LLMs exhibit a notable limitation, as they are primarily adept at processing textual information. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Akash Ghosh , Arkadeep Acharya , Sriparna Saha , Vinija Jain , Aman Chadha

The embedding of Biomedical Knowledge Graphs (BKGs) generates robust representations, valuable for a variety of artificial intelligence applications, including predicting drug combinations and reasoning disease-drug relationships.…

Databases · Computer Science 2023-10-17 Zhiguang Fan , Yuedong Yang , Mingyuan Xu , Hongming Chen

Visual encoders are fundamental components in vision-language models (VLMs), each showcasing unique strengths derived from various pre-trained visual foundation models. To leverage the various capabilities of these encoders, recent studies…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Jiajun Cao , Yuan Zhang , Tao Huang , Ming Lu , Qizhe Zhang , Ruichuan An , Ningning MA , Shanghang Zhang