English
Related papers

Related papers: Multi-Grained Multimodal Interaction Network for E…

200 papers

Multimodal Entity Linking (MEL) is a task that aims to link ambiguous mentions within multimodal contexts to referential entities in a multimodal knowledge base. Recent methods for MEL adopt a common framework: they first interact and fuse…

Computation and Language · Computer Science 2023-10-10 Shangyu Xing , Fei Zhao , Zhen Wu , Chunhui Li , Jianbing Zhang , Xinyu Dai

Multimodal entity linking (MEL) aims to link ambiguous mentions within multimodal contexts to corresponding entities in a multimodal knowledge base. Most existing approaches to MEL are based on representation learning or vision-and-language…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zhiwei Hu , Víctor Gutiérrez-Basulto , Ru Li , Jeff Z. Pan

Multimodal Entity Linking (MEL) is a crucial task that aims at linking ambiguous mentions within multimodal contexts to the referent entities in a multimodal knowledge base, such as Wikipedia. Existing methods focus heavily on using complex…

Artificial Intelligence · Computer Science 2024-08-22 Liu Qi , He Yongyi , Lian Defu , Zheng Zhi , Xu Tong , Liu Che , Chen Enhong

Multimodal Entity Linking (MEL) aims to associate textual and visual mentions with entities in a multimodal knowledge graph. Despite its importance, current methods face challenges such as incomplete contextual information, coarse…

Computation and Language · Computer Science 2025-08-25 Fang Wang , Tianwei Yan , Zonghao Yang , Minghao Hu , Jun Zhang , Zhunchen Luo , Xiaoying Bai

Multimodal Entity Linking (MEL) aims to link ambiguous mentions within multimodal contexts to associated entities in a multimodal knowledge base. Existing approaches to MEL introduce multimodal interaction and fusion mechanisms to bridge…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Zhiwei Hu , Víctor Gutiérrez-Basulto , Zhiliang Xiang , Ru Li , Jeff Z. Pan

Multimodal Entity Linking (MEL) is the task of mapping mentions with multimodal contexts to the referent entities from a knowledge base. Existing MEL methods mainly focus on designing complex multimodal interaction mechanisms and require…

Computation and Language · Computer Science 2024-03-21 Senbao Shi , Zhenran Xu , Baotian Hu , Min Zhang

Multimodal Entity Linking (MEL) aims to link ambiguous mentions in multimodal contexts to entities in a multimodal knowledge graph. A pivotal challenge is to fully leverage multi-element correlations between mentions and entities to bridge…

Computation and Language · Computer Science 2024-06-06 Zefeng Zhang , Jiawei Sheng , Chuang Zhang , Yunzhi Liang , Wenyuan Zhang , Siqi Wang , Tingwen Liu

Entity linking (EL) aligns textual mentions with their corresponding entities in a knowledge base, facilitating various applications such as semantic search and question answering. Recent advances in multimodal entity linking (MEL) have…

Information Retrieval · Computer Science 2025-04-22 Juyeon Kim , Geon Lee , Taeuk Kim , Kijung Shin

With the continuous emergence of various social media platforms frequently used in daily life, the multimodal meme understanding (MMU) task has been garnering increasing attention. MMU aims to explore and comprehend the meanings of memes…

Computation and Language · Computer Science 2025-03-18 Li Zheng , Hao Fei , Ting Dai , Zuquan Peng , Fei Li , Huisheng Ma , Chong Teng , Donghong Ji

Multi-modal entity alignment (MMEA) aims to identify equivalent entity pairs across different multi-modal knowledge graphs (MMKGs). Existing approaches focus on how to better encode and aggregate information from different modalities.…

Information Retrieval · Computer Science 2024-04-30 Zhiwei Hu , Víctor Gutiérrez-Basulto , Zhiliang Xiang , Ru Li , Jeff Z. Pan

Multi-modal entity alignment (MMEA) aims to identify equivalent entities between two multi-modal knowledge graphs (MMKGs), whose entities can be associated with relational triples and related images. Most previous studies treat the graph…

Computation and Language · Computer Science 2024-07-30 Taoyu Su , Xinghua Zhang , Jiawei Sheng , Zhenyu Zhang , Tingwen Liu

Multimodal entity linking (MEL), a task aimed at linking mentions within multimodal contexts to their corresponding entities in a knowledge base (KB), has attracted much attention due to its wide applications in recent years. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Hongze Mi , Jinyuan Li , Xuying Zhang , Haoran Cheng , Jiahao Wang , Di Sun , Gang Pan

We propose attribute-aware multimodal entity linking, where the input consists of a mention described with a text paragraph and images, and the goal is to predict the corresponding target entity from a multimodal knowledge base (KB) where…

Computation and Language · Computer Science 2025-06-12 Barry Menglong Yao , Sijia Wang , Yu Chen , Qifan Wang , Minqian Liu , Zhiyang Xu , Licheng Yu , Lifu Huang

Multimodal Entity Linking (MEL) aims at linking ambiguous mentions with multimodal information to entity in Knowledge Graph (KG) such as Wikipedia, which plays a key role in many applications. However, existing methods suffer from…

Artificial Intelligence · Computer Science 2024-08-02 Shezheng Song , Shan Zhao , Chengyu Wang , Tianwei Yan , Shasha Li , Xiaoguang Mao , Meng Wang

In many information extraction applications, entity linking (EL) has emerged as a crucial task that allows leveraging information about named entities from a knowledge base. In this paper, we address the task of multimodal entity linking…

Information Retrieval · Computer Science 2021-04-08 Omar Adjali , Romaric Besançon , Olivier Ferret , Herve Le Borgne , Brigitte Grau

Multi-modal named entity recognition (MNER) aims at identifying entity spans and recognizing their categories in social media posts with the aid of images. However, in dominant MNER approaches, the interaction of different modalities is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Junyu Lu , Dixiang Zhang , Pingjian Zhang

Multimodal entity linking (MEL) aims to utilize multimodal information (usually textual and visual information) to link ambiguous mentions to unambiguous entities in knowledge base. Current methods facing main issues: (1)treating the entire…

Artificial Intelligence · Computer Science 2024-04-11 Shezheng Song , Shasha Li , Shan Zhao , Xiaopeng Li , Chengyu Wang , Jie Yu , Jun Ma , Tianwei Yan , Bin Ji , Xiaoguang Mao

Entities can be expressed in diverse formats, such as texts, images, or column names and cell values in tables. While existing entity linking (EL) models work well on per modality configuration, such as text-only EL, visual grounding, or…

The explosive growth of multimodal data has driven the rapid development of multimodal entity linking (MEL) models. However, existing studies have not systematically investigated the impact of visual adversarial attacks on MEL models. We…

Information Retrieval · Computer Science 2025-08-22 Fang Wang , Yongjie Wang , Zonghao Yang , Minghao Hu , Xiaoying Bai

Multimodal entity linking plays a crucial role in a wide range of applications. Recent advances in large language model-based methods have become the dominant paradigm for this task, effectively leveraging both textual and visual modalities…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Ziyan Liu , Junwen Li , Kaiwen Li , Tong Ruan , Chao Wang , Xinyan He , Zongyu Wang , Xuezhi Cao , Jingping Liu
‹ Prev 1 2 3 10 Next ›