English
Related papers

Related papers: Joint Multimodal Entity-Relation Extraction Based …

200 papers

Multimodal relation extraction (MRE) is the task of identifying the semantic relationships between two entities based on the context of the sentence image pair. Existing retrieval-augmented approaches mainly focused on modeling the…

Computation and Language · Computer Science 2023-05-26 Xuming Hu , Zhijiang Guo , Zhiyang Teng , Irwin King , Philip S. Yu

Joint Multimodal Entity-Relation Extraction (JMERE) is a challenging task that aims to extract entities and their relations from text-image pairs in social media posts. Existing methods for JMERE require large amounts of labeled data.…

Computation and Language · Computer Science 2025-03-25 Li Yuan , Yi Cai , Junsheng Huang

Multi-modal named entity recognition (NER) and relation extraction (RE) aim to leverage relevant image information to improve the performance of NER and RE. Most existing efforts largely focused on directly extracting potentially useful…

Computation and Language · Computer Science 2022-12-06 Xinyu Wang , Jiong Cai , Yong Jiang , Pengjun Xie , Kewei Tu , Wei Lu

Entity and relation extraction is a key task in information extraction, where the output can be used for downstream NLP tasks. Existing approaches for entity and relation extraction tasks mainly focus on the English corpora and ignore other…

Computation and Language · Computer Science 2023-01-12 Zixiang Wang , Jian Yang , Tongliang Li , Jiaheng Liu , Ying Mo , Jiaqi Bai , Longtao He , Zhoujun Li

Multimodal relation extraction (MRE) is a crucial task in the fields of Knowledge Graph and Multimedia, playing a pivotal role in multimodal knowledge graph construction. However, existing methods are typically limited to extracting a…

Multimedia · Computer Science 2025-09-08 Xinkui Lin , Yongxiu Xu , Minghao Tang , Shilong Zhang , Hongbo Xu , Hao Xu , Yubin Wang

Multimodal named entity recognition and relation extraction (MNER and MRE) is a fundamental and crucial branch in information extraction. However, existing approaches for MNER and MRE usually suffer from error sensitivity when irrelevant…

Computation and Language · Computer Science 2022-12-01 Xiang Chen , Ningyu Zhang , Lei Li , Yunzhi Yao , Shumin Deng , Chuanqi Tan , Fei Huang , Luo Si , Huajun Chen

Document-level relation extraction is a complex human process that requires logical inference to extract relationships between named entities in text. Existing approaches use graph-based neural models with words as nodes and edges as…

Computation and Language · Computer Science 2019-09-04 Fenia Christopoulou , Makoto Miwa , Sophia Ananiadou

The challenge posed by multimodal named entity recognition (MNER) is mainly two-fold: (1) bridging the semantic gap between text and image and (2) matching the entity with its associated object in image. Existing methods fail to capture the…

Machine Learning · Computer Science 2023-08-08 Feng Chen , Jiajia Liu , Kaixiang Ji , Wang Ren , Jian Wang , Jingdong Wang

Multi-modal relation extraction (MMRE) is a challenging task that aims to identify relations between entities in text leveraging image information. Existing methods are limited by their neglect of the multiple entity pairs in one sentence…

Computation and Language · Computer Science 2024-04-19 Qian Li , Cheng Ji , Shu Guo , Yong Zhao , Qianren Mao , Shangguang Wang , Yuntao Wei , Jianxin Li

Existing research on multimodal relation extraction (MRE) faces two co-existing challenges, internal-information over-utilization and external-information under-exploitation. To combat that, we propose a novel framework that simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Shengqiong Wu , Hao Fei , Yixin Cao , Lidong Bing , Tat-Seng Chua

Recent works on relational triple extraction have shown the superiority of jointly extracting entities and relations over the pipelined extraction manner. However, most existing joint models fail to balance the modeling of entity features…

Computation and Language · Computer Science 2022-05-04 Zhepei Wei , Yantao Jia , Yuan Tian , Mohammad Javad Hosseini , Sujian Li , Mark Steedman , Yi Chang

Document-level joint entity and relation extraction is a challenging information extraction problem that requires a unified approach where a single neural network performs four sub-tasks: mention detection, coreference resolution, entity…

Computation and Language · Computer Science 2023-07-25 Witold Kosciukiewicz , Mateusz Wojcik , Tomasz Kajdanowicz , Adam Gonczarek

Events describe the state changes of entities. In a document, multiple events are connected by various relations (e.g., Coreference, Temporal, Causal, and Subevent). Therefore, obtaining the connections between events through Event-Event…

Computation and Language · Computer Science 2024-03-20 Haochen Li , Di Geng

Entity and Relation Extraction (ERE) is an important task in information extraction. Recent marker-based pipeline models achieve state-of-the-art performance, but still suffer from the error propagation issue. Also, most of current ERE…

Computation and Language · Computer Science 2023-10-27 Zhaohui Yan , Songlin Yang , Wei Liu , Kewei Tu

Joint entity and relation extraction is the fundamental task of information extraction, consisting of two subtasks: named entity recognition and relation extraction. However, most existing joint extraction methods suffer from issues of…

Computation and Language · Computer Science 2024-03-28 Wenjun Kong , Yamei Xia

Grounded Multimodal Named Entity Recognition (GMNER) is a nascent multimodal task that aims to identify named entities, entity types and their corresponding visual regions. GMNER task exhibits two challenging properties: 1) The weak…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Jinyuan Li , Han Li , Di Sun , Jiahao Wang , Wenkun Zhang , Zan Wang , Gang Pan

Joint entity-relation extraction (JERE) identifies both entities and their relationships simultaneously. Traditional machine-learning based approaches to performing this task require a large corpus of annotated data and lack the ability to…

Artificial Intelligence · Computer Science 2026-01-09 Trang Tran , Trung Hoang Le , Huiping Cao , Tran Cao Son

Information extraction techniques, including named entity recognition (NER) and relation extraction (RE), are crucial in many domains to support making sense of vast amounts of unstructured text data by identifying and connecting relevant…

Computation and Language · Computer Science 2024-01-17 Mingjie Li , Karin Verspoor

This paper studies the multimodal named entity recognition (MNER) and multimodal relation extraction (MRE), which are important for multimedia social platform analysis. The core of MNER and MRE lies in incorporating evident visual…

Multimedia · Computer Science 2024-02-12 Shiyao Cui , Jiangxia Cao , Xin Cong , Jiawei Sheng , Quangang Li , Tingwen Liu , Jinqiao Shi

Multimodal Relation Extraction is crucial for constructing flexible and realistic knowledge graphs. Recent studies focus on extracting the relation type with entity pairs present in different modalities, such as one entity in the text and…

Information Retrieval · Computer Science 2024-08-19 Lei Hei , Ning An , Tingjing Liao , Qi Ma , Jiaqi Wang , Feiliang Ren
‹ Prev 1 2 3 10 Next ›