English
Related papers

Related papers: MNER-QG: An End-to-End MRC framework for Multimoda…

200 papers

Grounded Multimodal Named Entity Recognition (GMNER) identifies named entities, including their spans and types, in natural language text and grounds them to the corresponding regions in associated images. Most existing approaches split…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Hongbing Li , Jiamin Liu , Shuo Zhang , Bo Xiao

Grounded Multimodal Named Entity Recognition (GMNER) task aims to identify named entities, entity types and their corresponding visual regions. GMNER task exhibits two challenging attributes: 1) The tenuous correlation between images and…

Multimedia · Computer Science 2025-09-03 Jinyuan Li , Ziyan Li , Han Li , Jianfei Yu , Rui Xia , Di Sun , Gang Pan

This paper presents a novel framework, MGNER, for Multi-Grained Named Entity Recognition where multiple entities or entity mentions in a sentence could be non-overlapping or totally nested. Different from traditional approaches regarding…

Computation and Language · Computer Science 2020-04-06 Congying Xia , Chenwei Zhang , Tao Yang , Yaliang Li , Nan Du , Xian Wu , Wei Fan , Fenglong Ma , Philip Yu

Grounded Multimodal Named Entity Recognition (GMNER) is an emerging information extraction (IE) task, aiming to simultaneously extract entity spans, types, and corresponding visual regions of entities from given sentence-image pairs data.…

Information Retrieval · Computer Science 2025-01-28 Jielong Tang , Zhenxing Wang , Ziyang Gong , Jianxing Yu , Xiangwei Zhu , Jian Yin

Grounded Multimodal Named Entity Recognition (GMNER) is a nascent multimodal task that aims to identify named entities, entity types and their corresponding visual regions. GMNER task exhibits two challenging properties: 1) The weak…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Jinyuan Li , Han Li , Di Sun , Jiahao Wang , Wenkun Zhang , Zan Wang , Gang Pan

Recent advances in named entity recognition (NER) have pushed the boundary of the task to incorporate visual signals, leading to many variants, including multi-modal NER (MNER) or grounded MNER (GMNER). A key challenge to these tasks is…

Computation and Language · Computer Science 2024-04-03 Hyunjong Ok , Taeho Kil , Sukmin Seo , Jaeho Lee

Mining structured knowledge from tweets using named entity recognition (NER) can be beneficial for many down stream applications such as recommendation and intention understanding. With tweet posts tending to be multimodal, multimodal named…

Computation and Language · Computer Science 2024-01-05 Peipei Liu , Hong Li , Yimo Ren , Jie Liu , Shuaizong Si , Hongsong Zhu , Limin Sun

Named entity recognition (NER) is a fundamental task in natural language processing that involves identifying and classifying entities in sentences into pre-defined types. It plays a crucial role in various research fields, including entity…

Computation and Language · Computer Science 2024-04-29 Dongsheng Wang , Xiaoqin Feng , Zeming Liu , Chuan Wang

Grounded Multimodal Named Entity Recognition (GMNER) aims to jointly identify named entity mentions in text, predict their semantic types, and ground each entity to a corresponding visual region in an associated image. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Meng Zhang , Jinzhong Ning , Xiaolong Wu , Hongfei Lin , Yijia Zhang

Multimodal named entity recognition (MNER) requires to bridge the gap between language understanding and visual context. While many multimodal neural techniques have been proposed to incorporate images into the MNER task, the model's…

Computation and Language · Computer Science 2021-09-21 Shuguang Chen , Gustavo Aguilar , Leonardo Neves , Thamar Solorio

The emergence of multimodal content, particularly text and images on social media, has positioned Multimodal Named Entity Recognition (MNER) as an increasingly important area of research within Natural Language Processing. Despite progress…

Computation and Language · Computer Science 2025-05-09 Hussain Ahmad , Qingyang Zeng , Jing Wan

Multi-modal named entity recognition (MNER) aims at identifying entity spans and recognizing their categories in social media posts with the aid of images. However, in dominant MNER approaches, the interaction of different modalities is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Junyu Lu , Dixiang Zhang , Pingjian Zhang

Grounded Multimodal Named Entity Recognition (GMNER) aims to extract text-based entities, assign them semantic categories, and ground them to corresponding visual regions. In this work, we explore the potential of Multimodal Large Language…

Computation and Language · Computer Science 2026-02-05 Jinlong Ma , Yu Zhang , Xuefeng Bai , Kehai Chen , Yuwei Wang , Zeming Liu , Jun Yu , Min Zhang

Named Entity Recognition (NER) aims to extract and classify entity mentions in the text into pre-defined types (e.g., organization or person name). Recently, many works have been proposed to shape the NER as a machine reading comprehension…

Computation and Language · Computer Science 2023-09-21 Yibo Wang , Wenting Zhao , Yao Wan , Zhongfen Deng , Philip S. Yu

NER has been traditionally formulated as a sequence labeling task. However, there has been recent trend in posing NER as a machine reading comprehension task (Wang et al., 2020; Mengge et al., 2020), where entity name (or other information)…

Machine Learning · Computer Science 2022-05-13 Anubhav Shrimal , Avi Jain , Kartik Mehta , Promod Yenigalla

The challenge posed by multimodal named entity recognition (MNER) is mainly two-fold: (1) bridging the semantic gap between text and image and (2) matching the entity with its associated object in image. Existing methods fail to capture the…

Machine Learning · Computer Science 2023-08-08 Feng Chen , Jiajia Liu , Kaixiang Ji , Wang Ren , Jian Wang , Jingdong Wang

Named Entity Recognition (NER) is a challenging and widely studied task that involves detecting and typing entities in text. So far,NER still approaches entity typing as a task of classification into universal classes (e.g. date, person, or…

Computation and Language · Computer Science 2023-02-22 Tristan Luiggi , Laure Soulier , Vincent Guigue , Siwar Jendoubi , Aurélien Baelde

Named Entity Recognition (NER) on social media refers to discovering and classifying entities from unstructured free-form content, and it plays an important role for various applications such as intention understanding and user…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Peipei Liu , Gaosheng Wang , Hong Li , Jie Liu , Yimo Ren , Hongsong Zhu , Limin Sun

Biomedical named entity recognition (BNER) serves as the foundation for numerous biomedical text mining tasks. Unlike general NER, BNER require a comprehensive grasp of the domain, and incorporating external knowledge beyond training data…

Computation and Language · Computer Science 2023-07-06 Junyi Bian , Rongze Jiang , Weiqi Zhai , Tianyang Huang , Hong Zhou , Shanfeng Zhu

Named entity recognition (NER) is an important research problem in natural language processing. There are three types of NER tasks, including flat, nested and discontinuous entity recognition. Most previous sequential labeling models are…

Computation and Language · Computer Science 2023-03-21 Ying Mo , Hongyin Tang , Jiahao Liu , Qifan Wang , Zenglin Xu , Jingang Wang , Wei Wu , Zhoujun Li
‹ Prev 1 2 3 10 Next ›