English
Related papers

Related papers: Multimodal Relation Extraction with Cross-Modal Re…

200 papers

This paper studies the multimodal named entity recognition (MNER) and multimodal relation extraction (MRE), which are important for multimedia social platform analysis. The core of MNER and MRE lies in incorporating evident visual…

Multimedia · Computer Science 2024-02-12 Shiyao Cui , Jiangxia Cao , Xin Cong , Jiawei Sheng , Quangang Li , Tingwen Liu , Jinqiao Shi

Multimodal Relation Extraction is crucial for constructing flexible and realistic knowledge graphs. Recent studies focus on extracting the relation type with entity pairs present in different modalities, such as one entity in the text and…

Information Retrieval · Computer Science 2024-08-19 Lei Hei , Ning An , Tingjing Liao , Qi Ma , Jiaqi Wang , Feiliang Ren

Multi-Modal Relation Extraction (MMRE) aims at identifying the relation between two entities in texts that contain visual clues. Rich visual content is valuable for the MMRE task, but existing works cannot well model finer associations…

Computation and Language · Computer Science 2023-06-21 Qian Li , Shu Guo , Cheng Ji , Xutan Peng , Shiyao Cui , Jianxin Li

Relation Extraction (RE) aims to label relations between groups of marked entities in raw text. Most current RE models learn context-aware representations of the target entities that are then used to establish relation between them. This…

Computation and Language · Computer Science 2019-02-26 Gaurav Singh , Parminder Bhatia

Relation extraction (RE) seeks to detect and classify semantic relationships between entities, which provides useful information for many NLP applications. Since the state-of-the-art RE models require large amounts of manually annotated…

Computation and Language · Computer Science 2019-11-13 Jian Ni , Radu Florian

Since commonsense information has been recorded significantly less frequently than its existence, language models pre-trained by text generation have difficulty to learn sufficient commonsense knowledge. Several studies have leveraged text…

Computation and Language · Computer Science 2024-06-17 Wanqing Cui , Keping Bi , Jiafeng Guo , Xueqi Cheng

Grounding referring expressions in images aims to locate the object instance in an image described by a referring expression. It involves a joint understanding of natural language and image content, and is essential for a range of visual…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Sibei Yang , Guanbin Li , Yizhou Yu

Extracting relational facts from multimodal data is a crucial task in the field of multimedia and knowledge graphs that feeds into widespread real-world applications. The emphasis of recent studies centers on recognizing relational facts in…

Multimedia · Computer Science 2023-12-18 Liang He , Hongke Wang , Yongchang Cao , Zhen Wu , Jianbing Zhang , Xinyu Dai

Document-level Relation Extraction (DRE) aims to recognize the relations between two entities. The entity may correspond to multiple mentions that span beyond sentence boundary. Few previous studies have investigated the mention…

Computation and Language · Computer Science 2022-01-14 Chao Zhao , Daojian Zeng , Lu Xu , Jianhua Dai

Recent multimodal retrieval methods have endowed text-based retrievers with multimodal capabilities by utilizing pre-training strategies for visual-text alignment. They often directly fuse the two modalities for cross-reference during the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Yeong-Joon Ju , Ho-Joong Kim , Seong-Whan Lee

Multimodal relation extraction is an essential task for knowledge graph construction. In this paper, we take an in-depth empirical analysis that indicates the inaccurate information in the visual scene graph leads to poor modal alignment…

Computation and Language · Computer Science 2022-11-15 Lei Li , Xiang Chen , Shuofei Qiao , Feiyu Xiong , Huajun Chen , Ningyu Zhang

Document-level relation extraction (DocRE) is a task that focuses on identifying relations between entities within a document. However, existing DocRE models often overlook the correlation between relations and lack a quantitative analysis…

Information Retrieval · Computer Science 2023-10-23 Yusheng Huang , Zhouhan Lin

Document-level Relation Extraction (DocRE) involves identifying relations between entities across multiple sentences in a document. Evidence sentences, crucial for precise entity pair relationships identification, enhance focus on essential…

Computation and Language · Computer Science 2025-04-10 Khai Phan Tran , Xue Li

Relation extraction (RE) aims to identify relations between entities mentioned in texts. Although large language models (LLMs) have demonstrated impressive in-context learning (ICL) abilities in various tasks, they still suffer from poor…

Computation and Language · Computer Science 2024-04-30 Guozheng Li , Peng Wang , Wenjun Ke , Yikai Guo , Ke Ji , Ziyu Shang , Jiajun Liu , Zijie Xu

Continual relation extraction (CRE) aims to solve the problem of catastrophic forgetting when learning a sequence of newly emerging relations. Recent CRE studies have found that catastrophic forgetting arises from the model's lack of…

Computation and Language · Computer Science 2023-10-11 Weimin Xiong , Yifan Song , Peiyi Wang , Sujian Li

Document-level relation extraction (DocRE) involves identifying relations between entities distributed in multiple sentences within a document. Existing methods focus on building a heterogeneous document graph to model the internal…

Computation and Language · Computer Science 2023-10-31 Chonggang Lu , Richong Zhang , Kai Sun , Jaein Kim , Cunwang Zhang , Yongyi Mao

Relation extraction (RE) involves identifying the relations between entities from underlying content. RE serves as the foundation for many natural language processing (NLP) and information retrieval applications, such as knowledge graph…

Computation and Language · Computer Science 2024-06-25 Xiaoyan Zhao , Yang Deng , Min Yang , Lingzhi Wang , Rui Zhang , Hong Cheng , Wai Lam , Ying Shen , Ruifeng Xu

Document-level relation extraction (DocRE) is an active area of research in natural language processing (NLP) concerned with identifying and extracting relationships between entities beyond sentence boundaries. Compared to the more…

Relation Extraction (RE) has been extended to cross-document scenarios because many relations are not simply described in a single document. This inevitably brings the challenge of efficient open-space evidence retrieval to support the…

Computation and Language · Computer Science 2023-06-06 Keming Lu , I-Hung Hsu , Wenxuan Zhou , Mingyu Derek Ma , Muhao Chen

In natural language, often multiple entities appear in the same text. However, most previous works in Relation Extraction (RE) limit the scope to identifying the relation between two entities at a time. Such an approach induces a quadratic…

Computation and Language · Computer Science 2020-10-13 Zhijing Jin , Yongyi Yang , Xipeng Qiu , Zheng Zhang