English
Related papers

Related papers: Multimodal Relation Extraction with Cross-Modal Re…

200 papers

Dialogue relation extraction (DRE) aims to detect the relation between two entities mentioned in a multi-party dialogue. It plays an important role in constructing knowledge graphs from conversational data increasingly abundant on the…

Computation and Language · Computer Science 2021-06-22 Hui Chen , Pengfei Hong , Wei Han , Navonil Majumder , Soujanya Poria

Two modalities are often used to convey information in a complementary and beneficial manner, e.g., in online news, videos, educational resources, or scientific publications. The automatic understanding of semantic correlations between text…

Multimedia · Computer Science 2019-06-21 Christian Otto , Matthias Springstein , Avishek Anand , Ralph Ewerth

Multimodal Retrieval-Augmented Generation (MRAG) enhances large language models (LLMs) by integrating multimodal data (text, images, videos) into retrieval and generation processes, overcoming the limitations of text-only…

Information Retrieval · Computer Science 2025-04-15 Lang Mei , Siyu Mo , Zhihan Yang , Chong Chen

Document Understanding is an evolving field in Natural Language Processing (NLP). In particular, visual and spatial features are essential in addition to the raw text itself and hence, several multimodal models were developed in the field…

Computation and Language · Computer Science 2024-04-18 Wiam Adnan , Joel Tang , Yassine Bel Khayat Zouggari , Seif Edinne Laatiri , Laurent Lam , Fabien Caspani

Event Temporal Relation Extraction (ETRE) aims to identify the temporal relationship between two events, which plays an important role in natural language understanding. Most previous works follow a single-label classification style,…

Computation and Language · Computer Science 2024-08-15 Yutong Hu , Quzhe Huang , Yansong Feng

Events describe the state changes of entities. In a document, multiple events are connected by various relations (e.g., Coreference, Temporal, Causal, and Subevent). Therefore, obtaining the connections between events through Event-Event…

Computation and Language · Computer Science 2024-03-20 Haochen Li , Di Geng

Relation extraction (RE) is an indispensable information extraction task in several disciplines. RE models typically assume that named entity recognition (NER) is already performed in a previous step by another independent model. Several…

Computation and Language · Computer Science 2019-08-29 Tung Tran , Ramakanth Kavuluru

Relation extraction (RE) is a fundamental task in information extraction, whose extension to multilingual settings has been hindered by the lack of supervised resources comparable in size to large English datasets such as TACRED (Zhang et…

Computation and Language · Computer Science 2023-05-16 Leonhard Hennig , Philippe Thomas , Sebastian Möller

Document-level Relation Extraction (DocRE) is a more challenging task compared to its sentence-level counterpart. It aims to extract relations from multiple sentences at once. In this paper, we propose a semi-supervised framework for DocRE…

Computation and Language · Computer Science 2022-03-22 Qingyu Tan , Ruidan He , Lidong Bing , Hwee Tou Ng

Document-level relation extraction (DocRE) aims to extract relations between entities from unstructured document text. Compared to sentence-level relation extraction, it requires more complex semantic understanding from a broader text…

Computation and Language · Computer Science 2024-09-10 Yanxu Mao , Xiaohui Chen , Peipei Liu , Tiehan Cui , Zuhui Yue , Zheng Li

Detecting visual relationships, i.e. <Subject, Predicate, Object> triplets, is a challenging Scene Understanding task approached in the past via linguistic priors or spatial information in a single feature branch. We introduce a new deeply…

Computer Vision and Pattern Recognition · Computer Science 2019-02-18 Nikolaos Gkanatsios , Vassilis Pitsikalis , Petros Koutras , Athanasia Zlatintsi , Petros Maragos

Relation extraction (RE) models have been challenged by their reliance on training data with expensive annotations. Considering that summarization tasks aim at acquiring concise expressions of synoptical information from the longer context,…

Computation and Language · Computer Science 2022-10-24 Keming Lu , I-Hung Hsu , Wenxuan Zhou , Mingyu Derek Ma , Muhao Chen

Document-level relation extraction (DocRE) aims to determine the relation between two entities from a document of multiple sentences. Recent studies typically represent the entire document by sequence- or graph-based models to predict the…

Computation and Language · Computer Science 2022-04-28 Wang Xu , Kehai Chen , Lili Mou , Tiejun Zhao

Recently, prompt-tuning with pre-trained language models (PLMs) has demonstrated the significantly enhancing ability of relation extraction (RE) tasks. However, in low-resource scenarios, where the available training data is scarce,…

Computation and Language · Computer Science 2024-05-31 Chenghao Fan , Wei Wei , Xiaoye Qu , Zhenyi Lu , Wenfeng Xie , Yu Cheng , Dangyang Chen

Knowledge is a formal way of understanding the world, providing a human-level cognition and intelligence for the next-generation artificial intelligence (AI). One of the representations of knowledge is semantic relations between entities.…

Computation and Language · Computer Science 2021-02-09 Hailin Wang , Ke Qin , Rufai Yusuf Zakari , Guoming Lu , Jin Yin

Multimodal Entity Linking (MEL) aims at linking ambiguous mentions with multimodal information to entity in Knowledge Graph (KG) such as Wikipedia, which plays a key role in many applications. However, existing methods suffer from…

Artificial Intelligence · Computer Science 2024-08-02 Shezheng Song , Shan Zhao , Chengyu Wang , Tianwei Yan , Shasha Li , Xiaoguang Mao , Meng Wang

Relation Extraction (RE) is a task that identifies relationships between entities in a text, enabling the acquisition of relational facts and bridging the gap between natural language and structured knowledge. However, current RE models…

Computation and Language · Computer Science 2023-06-21 Pere-Lluís Huguet Cabot , Simone Tedeschi , Axel-Cyrille Ngonga Ngomo , Roberto Navigli

Cross-modal retrieval is gaining increasing efficacy and interest from the research community, thanks to large-scale training, novel architectural and learning designs, and its application in LLMs and multimodal LLMs. In this paper, we move…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Davide Caffagni , Sara Sarto , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Document-level Relation Extraction (RE) is a more challenging task than sentence RE as it often requires reasoning over multiple sentences. Yet, human annotators usually use a small number of sentences to identify the relationship between a…

Computation and Language · Computer Science 2021-06-04 Quzhe Huang , Shengqi Zhu , Yansong Feng , Yuan Ye , Yuxuan Lai , Dongyan Zhao

Relation extraction is a type of information extraction task that recognizes semantic relationships between entities in a sentence. Many previous studies have focused on extracting only one semantic relation between two entities in a single…

Computation and Language · Computer Science 2021-03-08 Seongsik Park , Harksoo Kim