English
Related papers

Related papers: Rethinking Uncertainly Missing and Ambiguous Visua…

200 papers

Multi-modal entity alignment (MMEA) aims to identify equivalent entities between multi-modal knowledge graphs (MMKGs), where the entities can be associated with related images. Most existing studies integrate multi-modal information heavily…

Computation and Language · Computer Science 2024-07-30 Taoyu Su , Jiawei Sheng , Shicheng Wang , Xinghua Zhang , Hongbo Xu , Tingwen Liu

Multi-Modal Entity Alignment (MMEA) aims to retrieve equivalent entities from different Multi-Modal Knowledge Graphs (MMKGs), a critical information retrieval task. Existing studies have explored various fusion paradigms and consistency…

Multimedia · Computer Science 2025-05-16 Taoyu Su , Jiawei Sheng , Duohe Ma , Xiaodong Li , Juwei Yue , Mengxiao Song , Yingkai Tang , Tingwen Liu

Multi-modal entity alignment (MMEA) aims to discover identical entities across different knowledge graphs (KGs) whose entities are associated with relevant images. However, current MMEA algorithms rely on KG-level modality fusion strategies…

Artificial Intelligence · Computer Science 2023-08-01 Zhuo Chen , Jiaoyan Chen , Wen Zhang , Lingbing Guo , Yin Fang , Yufeng Huang , Yichi Zhang , Yuxia Geng , Jeff Z. Pan , Wenting Song , Huajun Chen

Multi-modal entity alignment (MMEA) aims to identify equivalent entity pairs across different multi-modal knowledge graphs (MMKGs). Existing approaches focus on how to better encode and aggregate information from different modalities.…

Information Retrieval · Computer Science 2024-04-30 Zhiwei Hu , Víctor Gutiérrez-Basulto , Zhiliang Xiang , Ru Li , Jeff Z. Pan

The objective of Entity Alignment (EA) is to identify equivalent entity pairs from multiple Knowledge Graphs (KGs) and create a more comprehensive and unified KG. The majority of EA methods have primarily focused on the structural modality…

Computation and Language · Computer Science 2023-10-16 Bolin Zhu , Xiaoze Liu , Xin Mao , Zhuo Chen , Lingbing Guo , Tao Gui , Qi Zhang

Multi-modal entity alignment (MMEA) is essential for enhancing knowledge graphs and improving information retrieval and question-answering systems. Existing methods often focus on integrating modalities through their complementarity but…

Artificial Intelligence · Computer Science 2024-10-21 Wei Ai , Wen Deng , Hongyi Chen , Jiayi Du , Tao Meng , Yuntao Shou

In Multi-Modal Knowledge Graphs (MMKGs), Multi-Modal Entity Alignment (MMEA) is crucial for identifying identical entities across diverse modal attributes. However, semantic inconsistency, mainly due to missing modal attributes, poses a…

Information Retrieval · Computer Science 2024-03-20 Yuanyi Wang , Haifeng Sun , Jiabo Wang , Jingyu Wang , Wei Tang , Qi Qi , Shaoling Sun , Jianxin Liao

Multi-Modal Entity Alignment (MMEA) is a critical task that aims to identify equivalent entity pairs across multi-modal knowledge graphs (MMKGs). However, this task faces challenges due to the presence of different types of information,…

Computation and Language · Computer Science 2023-10-11 Qian Li , Cheng Ji , Shu Guo , Zhaoji Liang , Lihong Wang , Jianxin Li

Multi-modal entity alignment (MMEA) aims to identify equivalent entities between two multi-modal knowledge graphs (MMKGs), whose entities can be associated with relational triples and related images. Most previous studies treat the graph…

Computation and Language · Computer Science 2024-07-30 Taoyu Su , Xinghua Zhang , Jiawei Sheng , Zhenyu Zhang , Tingwen Liu

Multi-modal entity alignment (MMEA) aims to identify equivalent entities between two multi-modal knowledge graphs for integration. Unfortunately, prior arts have attempted to improve the interaction and fusion of multi-modal information,…

Machine Learning · Computer Science 2024-03-05 Luyao Wang , Pengnian Qi , Xigang Bao , Chunlai Zhou , Biao Qin

Entity alignment (EA) for knowledge graphs (KGs) plays a critical role in knowledge engineering. Existing EA methods mostly focus on utilizing the graph structures and entity attributes (including literals), but ignore images that are…

Artificial Intelligence · Computer Science 2023-03-14 Yangning Li , Jiaoyan Chen , Yinghui Li , Yuejia Xiang , Xi Chen , Hai-Tao Zheng

Entity alignment (EA) is to identify equivalent entities across different knowledge graphs (KGs), which can help fuse these KGs into a more comprehensive one. Previous EA methods mainly focus on aligning a pair of KGs, and to the best of…

Computation and Language · Computer Science 2025-02-12 Yaming Yang , Zhe Wang , Ziyu Guan , Wei Zhao , Weigang Lu , Xinyan Huang , Jiangtao Cui , Xiaofei He

The multi-modal entity alignment (MMEA) aims to find all equivalent entity pairs between multi-modal knowledge graphs (MMKGs). Rich attributes and neighboring entities are valuable for the alignment task, but existing works ignore…

Computation and Language · Computer Science 2023-04-05 Qian Li , Shu Guo , Yangyifei Luo , Cheng Ji , Lihong Wang , Jiawei Sheng , Jianxin Li

Multimodal Action Quality Assessment (AQA) has recently emerged as a promising paradigm. By leveraging complementary information across shared contextual cues, it enhances the discriminative evaluation of subtle intra-class variations in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Huangbiao Xu , Huanqi Wu , Xiao Ke , Junyi Wu , Rui Xu , Jinglin Xu

With the growing success of multi-modal learning, research on the robustness of multi-modal models, especially when facing situations with missing modalities, is receiving increased attention. Nevertheless, previous studies in this domain…

Artificial Intelligence · Computer Science 2023-10-11 Siting Li , Chenzhuang Du , Yue Zhao , Yu Huang , Hang Zhao

Multi-modal entity alignment aims to identify equivalent entities between two different multi-modal knowledge graphs, which consist of structural triples and images associated with entities. Most previous works focus on how to utilize and…

Computation and Language · Computer Science 2022-09-05 Zhenxi Lin , Ziheng Zhang , Meng Wang , Yinghui Shi , Xian Wu , Yefeng Zheng

Multi-Modal Entity Alignment aims to discover identical entities across heterogeneous knowledge graphs. While recent studies have delved into fusion paradigms to represent entities holistically, the elimination of features irrelevant to…

Computation and Language · Computer Science 2024-07-24 Yani Huang , Xuefeng Zhang , Richong Zhang , Junfan Chen , Jaein Kim

Cross-lingual entity alignment, which aims to precisely connect the same entities in different monolingual knowledge bases (KBs) together, often suffers challenges from feature inconsistency to sequence context unawareness. This paper…

Computation and Language · Computer Science 2021-04-19 Gong Zhang , Yang Zhou , Sixing Wu , Zeru Zhang , Dejing Dou

Understanding human intentions (e.g., emotions) from videos has received considerable attention recently. Video streams generally constitute a blend of temporal data stemming from distinct modalities, including natural language, facial…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Dingkang Yang , Mingcheng Li , Linhao Qu , Kun Yang , Peng Zhai , Song Wang , Lihua Zhang

Multimodal VAEs seek to model the joint distribution over heterogeneous data (e.g.\ vision, language), whilst also capturing a shared representation across such modalities. Prior work has typically combined information from the modalities…

Machine Learning · Computer Science 2022-12-19 Tom Joy , Yuge Shi , Philip H. S. Torr , Tom Rainforth , Sebastian M. Schmon , N. Siddharth
‹ Prev 1 2 3 10 Next ›