English
Related papers

Related papers: Distilling Multi-Scale Knowledge for Event Tempora…

200 papers

Knowledge distillation is a critical technique to transfer knowledge between models, typically from a large model (the teacher) to a more fine-grained one (the student). The objective function of knowledge distillation is typically the…

Computation and Language · Computer Science 2021-06-03 Xinyu Wang , Yong Jiang , Zhaohui Yan , Zixia Jia , Nguyen Bach , Tao Wang , Zhongqiang Huang , Fei Huang , Kewei Tu

Facts extraction is pivotal for constructing knowledge graphs. Recently, the increasing demand for temporal facts in downstream tasks has led to the emergence of the task of temporal fact extraction. In this paper, we specifically address…

Computation and Language · Computer Science 2024-06-19 Jianhao Chen , Haoyuan Ouyang , Junyang Ren , Wentao Ding , Wei Hu , Yuzhong Qu

Inspired by the double temporality characteristic of narrative texts, we propose a novel approach for acquiring rich temporal "before/after" event knowledge across sentences in narrative stories. The double temporality states that a…

Computation and Language · Computer Science 2018-05-29 Wenlin Yao , Ruihong Huang

Recent state-of-the-art natural language understanding models, such as BERT and XLNet, score a pair of sentences (A and B) using multiple cross-attention operations - a process in which each word in sentence A attends to all words in…

Machine Learning · Computer Science 2019-11-22 Oren Barkan , Noam Razin , Itzik Malkiel , Ori Katz , Avi Caciularu , Noam Koenigstein

A principal barrier to training temporal relation extraction models in new domains is the lack of varied, high quality examples and the challenge of collecting more. We present a method of automatically collecting distantly-supervised…

Computation and Language · Computer Science 2021-09-16 Xinyu Zhao , Shih-ting Lin , Greg Durrett

Event extraction (EE) has considerably benefited from pre-trained language models (PLMs) by fine-tuning. However, existing pre-training methods have not involved modeling event characteristics, resulting in the developed EE models cannot…

Computation and Language · Computer Science 2021-06-01 Ziqi Wang , Xiaozhi Wang , Xu Han , Yankai Lin , Lei Hou , Zhiyuan Liu , Peng Li , Juanzi Li , Jie Zhou

Document-level relation extraction (RE) aims to extract the relations between entities from the input document that usually containing many difficultly-predicted entity pairs whose relations can only be predicted through relational…

Computation and Language · Computer Science 2022-11-29 Liang Zhang , Jinsong Su , Yidong Chen , Zhongjian Miao , Zijun Min , Qingguo Hu , Xiaodong Shi

Large language models (LLMs) have achieved commendable accomplishments in various natural language processing tasks. However, LLMs still encounter significant challenges when dealing with complex scenarios involving multiple entities. These…

Computation and Language · Computer Science 2024-06-07 Yanming Liu , Xinyue Peng , Tianyu Du , Jianwei Yin , Weihao Liu , Xuhong Zhang

Events describe the state changes of entities. In a document, multiple events are connected by various relations (e.g., Coreference, Temporal, Causal, and Subevent). Therefore, obtaining the connections between events through Event-Event…

Computation and Language · Computer Science 2024-03-20 Haochen Li , Di Geng

Distantly-supervised relation extraction (RE) is an effective method to scale RE to large corpora but suffers from noisy labels. Existing approaches try to alleviate noise through multi-instance learning and by providing additional…

Computation and Language · Computer Science 2021-02-03 Despina Christou , Grigorios Tsoumakas

Multimodal sentiment analysis (MSA) aims to understand human sentiment through multimodal data. Most MSA efforts are based on the assumption of modality completeness. However, in real-world applications, some practical factors cause…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Mingcheng Li , Dingkang Yang , Xiao Zhao , Shuaibing Wang , Yan Wang , Kun Yang , Mingyang Sun , Dongliang Kou , Ziyun Qian , Lihua Zhang

Since conventional knowledge embedding models cannot take full advantage of the abundant textual information, there have been extensive research efforts in enhancing knowledge embedding using texts. However, existing enhancement approaches…

Computation and Language · Computer Science 2023-05-05 Zhen Han , Ruotong Liao , Jindong Gu , Yao Zhang , Zifeng Ding , Yujia Gu , Heinz Köppl , Hinrich Schütze , Volker Tresp

Entity linking aims to link ambiguous mentions to their corresponding entities in a knowledge base. One of the key challenges comes from insufficient labeled data for specific domains. Although dense retrievers have achieved excellent…

Computation and Language · Computer Science 2023-10-20 Yulin Chen , Zhenran Xu , Baotian Hu , Min Zhang

Unsupervised relation extraction (URE) aims to extract relations between named entities from raw text without requiring manual annotations or pre-existing knowledge bases. In recent studies of URE, researchers put a notable emphasis on…

Computation and Language · Computer Science 2023-12-04 Qing Wang , Kang Zhou , Qiao Qiao , Yuepei Li , Qi Li

Relation Extraction (RE) is a vital step to complete Knowledge Graph (KG) by extracting entity relations from texts.However, it usually suffers from the long-tail issue. The training data mainly concentrates on a few types of relations,…

Computation and Language · Computer Science 2020-11-30 Yixin Cao , Jun Kuang , Ming Gao , Aoying Zhou , Yonggang Wen , Tat-Seng Chua

Large Language Models (LLMs) have demonstrated proficiency in a wide array of natural language processing tasks. However, its effectiveness over discourse-level event relation extraction (ERE) tasks remains unexplored. In this paper, we…

Computation and Language · Computer Science 2025-02-25 Kangda Wei , Aayush Gautam , Ruihong Huang

Often we wish to transfer representational knowledge from one neural network to another. Examples include distilling a large network into a smaller one, transferring knowledge from one sensory modality to a second, or ensembling a…

Machine Learning · Computer Science 2022-01-26 Yonglong Tian , Dilip Krishnan , Phillip Isola

Event Argument extraction refers to the task of extracting structured information from unstructured text for a particular event of interest. The existing works exhibit poor capabilities to extract causal event arguments like Reason and…

Computation and Language · Computer Science 2021-05-04 Debanjana Kar , Sudeshna Sarkar , Pawan Goyal

Observations with distributed sensors are essential in analyzing a series of human and machine activities (referred to as 'events' in this paper) in complex and extensive real-world environments. This is because the information obtained…

Multimedia · Computer Science 2024-04-15 Masahiro Yasuda , Noboru Harada , Yasunori Ohishi , Shoichiro Saito , Akira Nakayama , Nobutaka Ono

Relation extraction is the task of determining the relation between two entities in a sentence. Distantly-supervised models are popular for this task. However, sentences can be long and two entities can be located far from each other in a…

Computation and Language · Computer Science 2019-12-10 Tapas Nayak , Hwee Tou Ng