English
Related papers

Related papers: VP-MEL: Visual Prompts Guided Multimodal Entity Li…

200 papers

Visual Entity Linking (VEL) is a task to link regions of images with their corresponding entities in Knowledge Bases (KBs), which is beneficial for many computer vision tasks such as image retrieval, image caption, and visual question…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Wenxiang Sun , Yixing Fan , Jiafeng Guo , Ruqing Zhang , Xueqi Cheng

Multimodal Entity Linking (MEL) is a crucial task that aims at linking ambiguous mentions within multimodal contexts to the referent entities in a multimodal knowledge base, such as Wikipedia. Existing methods focus heavily on using complex…

Artificial Intelligence · Computer Science 2024-08-22 Liu Qi , He Yongyi , Lian Defu , Zheng Zhi , Xu Tong , Liu Che , Chen Enhong

In many information extraction applications, entity linking (EL) has emerged as a crucial task that allows leveraging information about named entities from a knowledge base. In this paper, we address the task of multimodal entity linking…

Information Retrieval · Computer Science 2021-04-08 Omar Adjali , Romaric Besançon , Olivier Ferret , Herve Le Borgne , Brigitte Grau

Multimodal Entity Linking (MEL) is the task of mapping mentions with multimodal contexts to the referent entities from a knowledge base. Existing MEL methods mainly focus on designing complex multimodal interaction mechanisms and require…

Computation and Language · Computer Science 2024-03-21 Senbao Shi , Zhenran Xu , Baotian Hu , Min Zhang

Multimodal Entity Linking (MEL) aims to associate textual and visual mentions with entities in a multimodal knowledge graph. Despite its importance, current methods face challenges such as incomplete contextual information, coarse…

Computation and Language · Computer Science 2025-08-25 Fang Wang , Tianwei Yan , Zonghao Yang , Minghao Hu , Jun Zhang , Zhunchen Luo , Xiaoying Bai

Multimodal Entity Linking (MEL) which aims at linking mentions with multimodal contexts to the referent entities from a knowledge base (e.g., Wikipedia), is an essential task for many multimodal applications. Although much attention has…

Computation and Language · Computer Science 2022-04-14 Xuwu Wang , Junfeng Tian , Min Gui , Zhixu Li , Rui Wang , Ming Yan , Lihan Chen , Yanghua Xiao

Web-scale visual entity recognition, the task of associating images with their corresponding entities within vast knowledge bases like Wikipedia, presents significant challenges due to the lack of clean, large-scale training data. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Mathilde Caron , Alireza Fathi , Cordelia Schmid , Ahmet Iscen

Multimodal Entity Linking (MEL) aims at linking ambiguous mentions with multimodal information to entity in Knowledge Graph (KG) such as Wikipedia, which plays a key role in many applications. However, existing methods suffer from…

Artificial Intelligence · Computer Science 2024-08-02 Shezheng Song , Shan Zhao , Chengyu Wang , Tianwei Yan , Shasha Li , Xiaoguang Mao , Meng Wang

In recent years, multi-modal entity linking (MEL) has garnered increasing attention in the research community due to its significance in numerous multi-modal applications. Video, as a popular means of information transmission, has become…

Computation and Language · Computer Science 2024-03-05 Haiquan Zhao , Xuwu Wang , Shisong Chen , Zhixu Li , Xin Zheng , Yanghua Xiao

Entity linking (EL) aligns textual mentions with their corresponding entities in a knowledge base, facilitating various applications such as semantic search and question answering. Recent advances in multimodal entity linking (MEL) have…

Information Retrieval · Computer Science 2025-04-22 Juyeon Kim , Geon Lee , Taeuk Kim , Kijung Shin

Multimodal entity linking (MEL) aims to link ambiguous mentions within multimodal contexts to corresponding entities in a multimodal knowledge base. Most existing approaches to MEL are based on representation learning or vision-and-language…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zhiwei Hu , Víctor Gutiérrez-Basulto , Ru Li , Jeff Z. Pan

Multimodal entity linking (MEL) aims to utilize multimodal information (usually textual and visual information) to link ambiguous mentions to unambiguous entities in knowledge base. Current methods facing main issues: (1)treating the entire…

Artificial Intelligence · Computer Science 2024-04-11 Shezheng Song , Shasha Li , Shan Zhao , Xiaopeng Li , Chengyu Wang , Jie Yu , Jun Ma , Tianwei Yan , Bin Ji , Xiaoguang Mao

Multimodal Entity Linking (MEL) is a fundamental task in data management that maps ambiguous mentions with diverse modalities to the multimodal entities in a knowledge base. However, most existing MEL approaches primarily focus on…

Computation and Language · Computer Science 2026-04-23 Mo Zhou , Jianwei Wang , Kai Wang , Helen Paik , Ying Zhang , Wenjie Zhang

Multimodal Entity Linking (MEL) aims to link ambiguous mentions in multimodal contexts to entities in a multimodal knowledge graph. A pivotal challenge is to fully leverage multi-element correlations between mentions and entities to bridge…

Computation and Language · Computer Science 2024-06-06 Zefeng Zhang , Jiawei Sheng , Chuang Zhang , Yunzhi Liang , Wenyuan Zhang , Siqi Wang , Tingwen Liu

Multimodal Entity Linking (MEL) aims to link ambiguous mentions within multimodal contexts to associated entities in a multimodal knowledge base. Existing approaches to MEL introduce multimodal interaction and fusion mechanisms to bridge…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Zhiwei Hu , Víctor Gutiérrez-Basulto , Zhiliang Xiang , Ru Li , Jeff Z. Pan

To enhance research on multimodal knowledge base and multimodal information processing, we propose a new task called multimodal entity tagging (MET) with a multimodal knowledge base (MKB). We also develop a dataset for the problem using an…

Information Retrieval · Computer Science 2022-07-29 Hao Peng , Hang Li , Lei Hou , Juanzi Li , Chao Qiao

We propose attribute-aware multimodal entity linking, where the input consists of a mention described with a text paragraph and images, and the goal is to predict the corresponding target entity from a multimodal knowledge base (KB) where…

Computation and Language · Computer Science 2025-06-12 Barry Menglong Yao , Sijia Wang , Yu Chen , Qifan Wang , Minqian Liu , Zhiyang Xu , Licheng Yu , Lifu Huang

Multimodal entity linking (MEL) task, which aims at resolving ambiguous mentions to a multimodal knowledge graph, has attracted wide attention in recent years. Though large efforts have been made to explore the complementary effect among…

Artificial Intelligence · Computer Science 2023-07-20 Pengfei Luo , Tong Xu , Shiwei Wu , Chen Zhu , Linli Xu , Enhong Chen

Multimodal Entity Linking (MEL) is a task that aims to link ambiguous mentions within multimodal contexts to referential entities in a multimodal knowledge base. Recent methods for MEL adopt a common framework: they first interact and fuse…

Computation and Language · Computer Science 2023-10-10 Shangyu Xing , Fei Zhao , Zhen Wu , Chunhui Li , Jianbing Zhang , Xinyu Dai

Entity state tracking is a necessary component of world modeling that requires maintaining coherent representations of entities over time. Previous work has benchmarked entity tracking performance in purely text-based tasks. We introduce…

Computation and Language · Computer Science 2026-02-10 Vanya Cohen , Raymond Mooney
‹ Prev 1 2 3 10 Next ›