English
Related papers

Related papers: E2E-GMNER: End-to-End Generative Grounded Multimod…

200 papers

Grounded Multimodal Named Entity Recognition (GMNER) task aims to identify named entities, entity types and their corresponding visual regions. GMNER task exhibits two challenging attributes: 1) The tenuous correlation between images and…

Multimedia · Computer Science 2025-09-03 Jinyuan Li , Ziyan Li , Han Li , Jianfei Yu , Rui Xia , Di Sun , Gang Pan

Grounded Multimodal Named Entity Recognition (GMNER) is a nascent multimodal task that aims to identify named entities, entity types and their corresponding visual regions. GMNER task exhibits two challenging properties: 1) The weak…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Jinyuan Li , Han Li , Di Sun , Jiahao Wang , Wenkun Zhang , Zan Wang , Gang Pan

Multimodal named entity recognition (MNER) is a critical step in information extraction, which aims to detect entity spans and classify them to corresponding entity types given a sentence-image pair. Existing methods either (1) obtain named…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Meihuizi Jia , Lei Shen , Xin Shen , Lejian Liao , Meng Chen , Xiaodong He , Zhendong Chen , Jiaqi Li

Grounded Multimodal Named Entity Recognition (GMNER) is an emerging information extraction (IE) task, aiming to simultaneously extract entity spans, types, and corresponding visual regions of entities from given sentence-image pairs data.…

Information Retrieval · Computer Science 2025-01-28 Jielong Tang , Zhenxing Wang , Ziyang Gong , Jianxing Yu , Xiangwei Zhu , Jian Yin

This paper presents a novel framework, MGNER, for Multi-Grained Named Entity Recognition where multiple entities or entity mentions in a sentence could be non-overlapping or totally nested. Different from traditional approaches regarding…

Computation and Language · Computer Science 2020-04-06 Congying Xia , Chenwei Zhang , Tao Yang , Yaliang Li , Nan Du , Xian Wu , Wei Fan , Fenglong Ma , Philip Yu

Grounded Multimodal Named Entity Recognition (GMNER) aims to extract named entities and localize their visual regions within image-text pairs, serving as a pivotal capability for various downstream applications. In open-world social media…

Information Retrieval · Computer Science 2026-04-23 Jielong Tang , Xujie Yuan , Jiayang Liu , Jianxing Yu , Xiao Dong , Lin Chen , Yunlai Teng , Shimin Di , Jian Yin

Grounded Multimodal Named Entity Recognition (GMNER) aims to extract text-based entities, assign them semantic categories, and ground them to corresponding visual regions. In this work, we explore the potential of Multimodal Large Language…

Computation and Language · Computer Science 2026-02-05 Jinlong Ma , Yu Zhang , Xuefeng Bai , Kehai Chen , Yuwei Wang , Zeming Liu , Jun Yu , Min Zhang

Grounded Multimodal Named Entity Recognition (GMNER) identifies named entities, including their spans and types, in natural language text and grounds them to the corresponding regions in associated images. Most existing approaches split…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Hongbing Li , Jiamin Liu , Shuo Zhang , Bo Xiao

In recent years, the fine-tuned generative models have been proven more powerful than the previous tagging-based or span-based models on named entity recognition (NER) task. It has also been found that the information related to entities,…

Computation and Language · Computer Science 2024-06-12 Guochao Jiang , Ziqin Luo , Yuchen Shi , Dixuan Wang , Jiaqing Liang , Deqing Yang

Ever-larger language models with ever-increasing capabilities are by now well-established text processing tools. Alas, information extraction tasks such as named entity recognition are still largely unaffected by this progress as they are…

Computation and Language · Computer Science 2023-08-16 Tobias Deußer , Lars Hillebrand , Christian Bauckhage , Rafet Sifa

Traditional named entity recognition (NER) aims to identify text mentions into pre-defined entity types. Continual Named Entity Recognition (CNER) is introduced since entity categories are continuously increasing in various real-world…

Computation and Language · Computer Science 2025-10-14 Yawen Yang , Fukun Ma , Shiao Meng , Aiwei Liu , Lijie Wen

End-to-end (E2E) learning has recently been proposed to jointly design the modulator and symbol detector by using deep neural networks (DNNs). However, existing schemes lack sufficient capability to cancel multi-user interference (MUI) in…

Signal Processing · Electrical Eng. & Systems 2026-02-20 Hao Chang , Hoang Triet Vo , Alva Kosasih , Branka Vucetic , Wibowo Hardjawana

The challenge posed by multimodal named entity recognition (MNER) is mainly two-fold: (1) bridging the semantic gap between text and image and (2) matching the entity with its associated object in image. Existing methods fail to capture the…

Machine Learning · Computer Science 2023-08-08 Feng Chen , Jiajia Liu , Kaixiang Ji , Wang Ren , Jian Wang , Jingdong Wang

Graph Neural Networks (GNNs) have emerged as powerful tools for modeling graph-structured data and have been widely used in recommender systems, such as for capturing complex user-item and item-item relations. However, most industrial…

Machine Learning · Computer Science 2026-02-24 Rui Xue , Shichao Zhu , Liang Qin , Tianfu Wu

This work studies ensemble learning for graph neural networks (GNNs) under the popular semi-supervised setting. Ensemble learning has shown superiority in improving the accuracy and robustness of traditional machine learning by combining…

Machine Learning · Computer Science 2024-05-07 Xin Zhang , Daochen Zha , Qiaoyu Tan

Stance detection is typically framed as predicting the sentiment in a given text towards a target entity. However, this setup overlooks the importance of the source entity, i.e., who is expressing the opinion. In this paper, we emphasize…

Computation and Language · Computer Science 2022-11-04 Xinliang Frederick Zhang , Nick Beauchamp , Lu Wang

Grounded Multimodal Named Entity Recognition (GMNER) extends traditional NER by jointly detecting textual mentions and grounding them to visual regions. While existing supervised methods achieve strong performance, they rely on costly…

Information Retrieval · Computer Science 2025-11-13 Jielong Tang , Shuang Wang , Zhenxing Wang , Jianxing Yu , Jian Yin

Recent advances in named entity recognition (NER) have pushed the boundary of the task to incorporate visual signals, leading to many variants, including multi-modal NER (MNER) or grounded MNER (GMNER). A key challenge to these tasks is…

Computation and Language · Computer Science 2024-04-03 Hyunjong Ok , Taeho Kil , Sukmin Seo , Jaeho Lee

Named Entity Recognition (NER) is a challenging and widely studied task that involves detecting and typing entities in text. So far,NER still approaches entity typing as a task of classification into universal classes (e.g. date, person, or…

Computation and Language · Computer Science 2023-02-22 Tristan Luiggi , Laure Soulier , Vincent Guigue , Siwar Jendoubi , Aurélien Baelde

Named entity recognition (NER) from text has been a widely studied problem and usually extracts semantic information from text. Until now, NER from speech is mostly studied in a two-step pipeline process that includes first applying an…

Computation and Language · Computer Science 2020-05-25 Hemant Yadav , Sreyan Ghosh , Yi Yu , Rajiv Ratn Shah
‹ Prev 1 2 3 10 Next ›