English
Related papers

Related papers: Multi-level Mixture of Experts for Multimodal Enti…

200 papers

Multimodal entity linking (MEL) aims to link ambiguous mentions within multimodal contexts to corresponding entities in a multimodal knowledge base. Most existing approaches to MEL are based on representation learning or vision-and-language…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zhiwei Hu , Víctor Gutiérrez-Basulto , Ru Li , Jeff Z. Pan

Multimodal Entity Linking (MEL) aims at linking ambiguous mentions with multimodal information to entity in Knowledge Graph (KG) such as Wikipedia, which plays a key role in many applications. However, existing methods suffer from…

Artificial Intelligence · Computer Science 2024-08-02 Shezheng Song , Shan Zhao , Chengyu Wang , Tianwei Yan , Shasha Li , Xiaoguang Mao , Meng Wang

Multimodal entity linking (MEL) aims to utilize multimodal information (usually textual and visual information) to link ambiguous mentions to unambiguous entities in knowledge base. Current methods facing main issues: (1)treating the entire…

Artificial Intelligence · Computer Science 2024-04-11 Shezheng Song , Shasha Li , Shan Zhao , Xiaopeng Li , Chengyu Wang , Jie Yu , Jun Ma , Tianwei Yan , Bin Ji , Xiaoguang Mao

Multimodal Entity Linking (MEL) is a crucial task that aims at linking ambiguous mentions within multimodal contexts to the referent entities in a multimodal knowledge base, such as Wikipedia. Existing methods focus heavily on using complex…

Artificial Intelligence · Computer Science 2024-08-22 Liu Qi , He Yongyi , Lian Defu , Zheng Zhi , Xu Tong , Liu Che , Chen Enhong

Multimodal Entity Linking (MEL) which aims at linking mentions with multimodal contexts to the referent entities from a knowledge base (e.g., Wikipedia), is an essential task for many multimodal applications. Although much attention has…

Computation and Language · Computer Science 2022-04-14 Xuwu Wang , Junfeng Tian , Min Gui , Zhixu Li , Rui Wang , Ming Yan , Lihan Chen , Yanghua Xiao

Multimodal Entity Linking (MEL) aims to associate textual and visual mentions with entities in a multimodal knowledge graph. Despite its importance, current methods face challenges such as incomplete contextual information, coarse…

Computation and Language · Computer Science 2025-08-25 Fang Wang , Tianwei Yan , Zonghao Yang , Minghao Hu , Jun Zhang , Zhunchen Luo , Xiaoying Bai

Multimodal Entity Linking (MEL) is a fundamental task in data management that maps ambiguous mentions with diverse modalities to the multimodal entities in a knowledge base. However, most existing MEL approaches primarily focus on…

Computation and Language · Computer Science 2026-04-23 Mo Zhou , Jianwei Wang , Kai Wang , Helen Paik , Ying Zhang , Wenjie Zhang

Multimodal Entity Linking (MEL) is the task of mapping mentions with multimodal contexts to the referent entities from a knowledge base. Existing MEL methods mainly focus on designing complex multimodal interaction mechanisms and require…

Computation and Language · Computer Science 2024-03-21 Senbao Shi , Zhenran Xu , Baotian Hu , Min Zhang

Multimodal entity linking (MEL) task, which aims at resolving ambiguous mentions to a multimodal knowledge graph, has attracted wide attention in recent years. Though large efforts have been made to explore the complementary effect among…

Artificial Intelligence · Computer Science 2023-07-20 Pengfei Luo , Tong Xu , Shiwei Wu , Chen Zhu , Linli Xu , Enhong Chen

Advances in multimodal models have greatly improved how interactions relevant to various tasks are modeled. Today's multimodal models mainly focus on the correspondence between images and text, using this for tasks like image-text matching.…

Computation and Language · Computer Science 2024-09-27 Haofei Yu , Zhengyang Qi , Lawrence Jang , Ruslan Salakhutdinov , Louis-Philippe Morency , Paul Pu Liang

Multimodal Entity Linking (MEL) aims to link ambiguous mentions in multimodal contexts to entities in a multimodal knowledge graph. A pivotal challenge is to fully leverage multi-element correlations between mentions and entities to bridge…

Computation and Language · Computer Science 2024-06-06 Zefeng Zhang , Jiawei Sheng , Chuang Zhang , Yunzhi Liang , Wenyuan Zhang , Siqi Wang , Tingwen Liu

In many information extraction applications, entity linking (EL) has emerged as a crucial task that allows leveraging information about named entities from a knowledge base. In this paper, we address the task of multimodal entity linking…

Information Retrieval · Computer Science 2021-04-08 Omar Adjali , Romaric Besançon , Olivier Ferret , Herve Le Borgne , Brigitte Grau

Multilevel data are prevalent in many real-world applications. However, it remains an open research problem to identify and justify a class of models that flexibly capture a wide range of multilevel data. Motivated by the versatility of the…

Statistics Theory · Mathematics 2022-10-03 Tsz Chai Fung , Spark C. Tseung

Multimodal Entity Linking (MEL) is a task that aims to link ambiguous mentions within multimodal contexts to referential entities in a multimodal knowledge base. Recent methods for MEL adopt a common framework: they first interact and fuse…

Computation and Language · Computer Science 2023-10-10 Shangyu Xing , Fei Zhao , Zhen Wu , Chunhui Li , Jianbing Zhang , Xinyu Dai

Mixture-of-Experts (MoE) presents a naturally compatible and scalable framework for multimodal learning, demonstrating strong adaptability across diverse modalities and tasks. Despite its growing success, a comprehensive and systematic…

Machine Learning · Computer Science 2026-05-28 Liangwei Nathan Zheng , Wei Emma Zhang , Olaf Maennel , Lin Yue , Weitong Chen

Multimodal entity linking (MEL), a task aimed at linking mentions within multimodal contexts to their corresponding entities in a knowledge base (KB), has attracted much attention due to its wide applications in recent years. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Hongze Mi , Jinyuan Li , Xuying Zhang , Haoran Cheng , Jiahao Wang , Di Sun , Gang Pan

Emotion Recognition in Conversations (ERC) presents unique challenges, requiring models to capture the temporal flow of multi-turn dialogues and to effectively integrate cues from multiple modalities. We propose Mixture of Speech-Text…

Computation and Language · Computer Science 2026-02-27 Soumya Dutta , Smruthi Balaji , Sriram Ganapathy

Model editing aims to efficiently alter the behavior of Large Language Models (LLMs) within a desired scope, while ensuring no adverse impact on other inputs. Recent years have witnessed various model editing methods been proposed. However,…

Computation and Language · Computer Science 2024-06-04 Renzhi Wang , Piji Li

Learning high-quality multi-modal entity representations is an important goal of multi-modal knowledge graph (MMKG) representation learning, which can enhance reasoning tasks within the MMKGs, such as MMKG completion (MMKGC). The main…

Artificial Intelligence · Computer Science 2025-04-08 Yichi Zhang , Zhuo Chen , Lingbing Guo , Yajing Xu , Binbin Hu , Ziqi Liu , Wen Zhang , Huajun Chen

Entity linking (EL) aligns textual mentions with their corresponding entities in a knowledge base, facilitating various applications such as semantic search and question answering. Recent advances in multimodal entity linking (MEL) have…

Information Retrieval · Computer Science 2025-04-22 Juyeon Kim , Geon Lee , Taeuk Kim , Kijung Shin
‹ Prev 1 2 3 10 Next ›