English
Related papers

Related papers: Joint Multimodal Entity-Relation Extraction Based …

200 papers

Multimodal entity linking plays a crucial role in a wide range of applications. Recent advances in large language model-based methods have become the dominant paradigm for this task, effectively leveraging both textual and visual modalities…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Ziyan Liu , Junwen Li , Kaiwen Li , Tong Ruan , Chao Wang , Xinyan He , Zongyu Wang , Xuezhi Cao , Jingping Liu

Entity and relation extraction is the necessary step in structuring medical text. However, the feature extraction ability of the bidirectional long short term memory network in the existing model does not achieve the best effect. At the…

Computation and Language · Computer Science 2019-10-23 Kui Xue , Yangming Zhou , Zhiyuan Ma , Tong Ruan , Huanhuan Zhang , Ping He

Retrieval-Augmented Generation (RAG) has emerged as a promising technique to enhance the quality and relevance of responses generated by large language models. While recent advancements have mainly focused on improving RAG for text-based…

Computation and Language · Computer Science 2025-09-30 Ainulla Khan , Yamada Moyuru , Srinidhi Akella

Document-level relation extraction aims to discover relations between entities across a whole document. How to build the dependency of entities from different sentences in a document remains to be a great challenge. Current approaches…

Computation and Language · Computer Science 2021-03-16 Jiaxin Pan , Min Peng , Yiyan Zhang

Multimodal Named Entity Recognition (MNER) is a crucial task for information extraction from social media platforms such as Twitter. Most current methods rely on attention weights to extract information from both text and images but are…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Weide Liu , Xiaoyang Zhong , Jingwen Hou , Shaohua Li , Haozhe Huang , Yuming Fang

Relation Extraction (RE) is a fundamental task of information extraction, which has attracted a large amount of research attention. Previous studies focus on extracting the relations within a sentence or document, while currently…

Computation and Language · Computer Science 2022-11-01 Fengqi Wang , Fei Li , Hao Fei , Jingye Li , Shengqiong Wu , Fangfang Su , Wenxuan Shi , Donghong Ji , Bo Cai

Fine-grained entity recognition is crucial for reasoning and decision-making in task-oriented dialogues, yet current large language models (LLMs) continue to face challenges in domain adaptation and retrieval controllability. We introduce…

Computation and Language · Computer Science 2025-11-18 Liang Xue , Haoyu Liu , Yajun Tian , Xinyu Zhong , Yang Liu

We present mGENRE, a sequence-to-sequence system for the Multilingual Entity Linking (MEL) problem -- the task of resolving language-specific mentions to a multilingual Knowledge Base (KB). For a mention in a given language, mGENRE predicts…

Relation extraction (RE) seeks to detect and classify semantic relationships between entities, which provides useful information for many NLP applications. Since the state-of-the-art RE models require large amounts of manually annotated…

Computation and Language · Computer Science 2019-11-13 Jian Ni , Radu Florian

Document-level relation extraction (DocRE) involves identifying relations between entities distributed in multiple sentences within a document. Existing methods focus on building a heterogeneous document graph to model the internal…

Computation and Language · Computer Science 2023-10-31 Chonggang Lu , Richong Zhang , Kai Sun , Jaein Kim , Cunwang Zhang , Yongyi Mao

This paper introduces FRAME (Fine-grained Recognition of Art-historical Metadata and Entities), a manually annotated dataset of art-historical image descriptions for Named Entity Recognition (NER) and Relation Extraction (RE). Descriptions…

Computation and Language · Computer Science 2026-02-24 Stefanie Schneider , Miriam Göldl , Julian Stalter , Ricarda Vollmer

Multimodal Entity Linking (MEL) aims to link ambiguous mentions within multimodal contexts to associated entities in a multimodal knowledge base. Existing approaches to MEL introduce multimodal interaction and fusion mechanisms to bridge…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Zhiwei Hu , Víctor Gutiérrez-Basulto , Zhiliang Xiang , Ru Li , Jeff Z. Pan

When extracting information from handwritten documents, text transcription and named entity recognition are usually faced as separate subsequent tasks. This has the disadvantage that errors in the first module affect heavily the performance…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Manuel Carbonell , Mauricio Villegas , Alicia Fornés , Josep Lladós

Named Entity Recognition (NER) is a critical task in natural language processing, yet it remains particularly challenging for discontinuous entities. The primary difficulty lies in text segmentation, as traditional methods often missegment…

Computation and Language · Computer Science 2026-01-01 Wen-Fang Su , Hsiao-Wei Chou , Wen-Yang Lin

With the rapid development of large language models (LLMs), more and more researchers have paid attention to information extraction based on LLMs. However, there are still some spaces to improve in the existing related methods. First,…

Computation and Language · Computer Science 2026-03-24 Jiang Liu , Ge Qiu , Hao Fei , Dongdong Xie , Jinbo Li , Fei Li , Chong Teng , Donghong Ji

Multi-modal named entity recognition (MNER) aims at identifying entity spans and recognizing their categories in social media posts with the aid of images. However, in dominant MNER approaches, the interaction of different modalities is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Junyu Lu , Dixiang Zhang , Pingjian Zhang

For Relation Extraction (RE), the manual annotation of training data may be prohibitively expensive, since the sentences that contain the target relations in texts can be very scarce and difficult to find. It is therefore beneficial to…

Computation and Language · Computer Science 2025-09-11 Zexuan Li , Hongliang Dai , Piji Li

Multimodal Entity Linking (MEL) is a fundamental task in data management that maps ambiguous mentions with diverse modalities to the multimodal entities in a knowledge base. However, most existing MEL approaches primarily focus on…

Computation and Language · Computer Science 2026-04-23 Mo Zhou , Jianwei Wang , Kai Wang , Helen Paik , Ying Zhang , Wenjie Zhang

Named Entity Recognition (NER) on social media refers to discovering and classifying entities from unstructured free-form content, and it plays an important role for various applications such as intention understanding and user…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Peipei Liu , Gaosheng Wang , Hong Li , Jie Liu , Yimo Ren , Hongsong Zhu , Limin Sun

Document-level relation extraction (DocRE) aims to extract semantic relations among entity pairs in a document. Typical DocRE methods blindly take the full document as input, while a subset of the sentences in the document, noted as the…

Computation and Language · Computer Science 2022-03-08 Yiqing Xie , Jiaming Shen , Sha Li , Yuning Mao , Jiawei Han