English
Related papers

Related papers: Contextualized Word Embeddings Enhanced Event Temp…

200 papers

Data-driven models have demonstrated state-of-the-art performance in inferring the temporal ordering of events in text. However, these models often overlook explicit temporal signals, such as dates and time windows. Rule-based methods can…

Computation and Language · Computer Science 2019-06-21 Tanya Goyal , Greg Durrett

Event coreference continues to be a challenging problem in information extraction. With the absence of any external knowledge bases for events, coreference becomes a clustering task that relies on effective representations of the context in…

Computation and Language · Computer Science 2024-04-09 Shafiuddin Rehan Ahmed , James H. Martin

Event Argument extraction refers to the task of extracting structured information from unstructured text for a particular event of interest. The existing works exhibit poor capabilities to extract causal event arguments like Reason and…

Computation and Language · Computer Science 2021-05-04 Debanjana Kar , Sudeshna Sarkar , Pawan Goyal

Automatic extraction of temporal relations between event pairs is an important task for several natural language processing applications such as Question Answering, Information Extraction, and Summarization. Since most existing methods are…

Machine Learning · Computer Science 2014-01-27 Seyed Abolghasem Mirroshandel , Gholamreza Ghassem-Sani

Predicting the subsequent event for an existing event context is an important but challenging task, as it requires understanding the underlying relationship between events. Previous methods propose to retrieve relational features from event…

Computation and Language · Computer Science 2022-05-24 Li Du , Xiao Ding , Yue Zhang , Kai Xiong , Ting Liu , Bing Qin

Temporal knowledge graph, serving as an effective way to store and model dynamic relations, shows promising prospects in event forecasting. However, most temporal knowledge graph reasoning methods are highly dependent on the recurrence or…

Artificial Intelligence · Computer Science 2022-12-05 Yi Xu , Junjie Ou , Hui Xu , Luoyi Fu

We conduct an empirical analysis of neural network architectures and data transfer strategies for causal relation extraction. By conducting experiments with various contextual embedding layers and architectural components, we show that a…

Computation and Language · Computer Science 2025-03-11 Sydney Anuyah , Jack Vanschaik , Palak Jain , Sawyer Lehman , Sunandan Chakraborty

Contextual word representations, typically trained on unstructured, unlabeled text, do not contain any explicit grounding to real world entities and are often unable to remember facts about those entities. We propose a general method to…

Computation and Language · Computer Science 2019-11-01 Matthew E. Peters , Mark Neumann , Robert L. Logan , Roy Schwartz , Vidur Joshi , Sameer Singh , Noah A. Smith

Extracting temporal relations among events from unstructured text has extensive applications, such as temporal reasoning and question answering. While it is difficult, recent development of Neural-symbolic methods has shown promising…

Computation and Language · Computer Science 2021-12-03 Bo-Ying Su , Shang-Ling Hsu , Kuan-Yin Lai , Jane Yung-jen Hsu

Focusing on the task of identifying event temporal status, we find that events directly or indirectly governing the target event in a dependency tree are most important contexts. Therefore, we extract dependency chains containing context…

Computation and Language · Computer Science 2017-10-13 Zeyu Dai , Wenlin Yao , Ruihong Huang

We propose a novel deep structured learning framework for event temporal relation extraction. The model consists of 1) a recurrent neural network (RNN) to learn scoring functions for pair-wise relations, and 2) a structured support vector…

Computation and Language · Computer Science 2019-09-26 Rujun Han , I-Hung Hsu , Mu Yang , Aram Galstyan , Ralph Weischedel , Nanyun Peng

In this study, a novel method for extracting named entities and relations from unstructured text based on the table representation is presented. By using contextualized word embeddings, the proposed method computes representations for…

Computation and Language · Computer Science 2022-01-28 Youmi Ma , Tatsuya Hiraoka , Naoaki Okazaki

Topic models extract groups of words from documents, whose interpretation as a topic hopefully allows for a better understanding of the data. However, the resulting word groups are often not coherent, making them harder to interpret.…

Computation and Language · Computer Science 2021-06-18 Federico Bianchi , Silvia Terragni , Dirk Hovy

Neural network-based representations ("embeddings") have dramatically advanced natural language processing (NLP) tasks, including clinical NLP tasks such as concept extraction. Recently, however, more advanced embedding methods and…

Computation and Language · Computer Science 2019-08-15 Yuqi Si , Jingqi Wang , Hua Xu , Kirk Roberts

Understanding natural language involves recognizing how multiple event mentions structurally and temporally interact with each other. In this process, one can induce event complexes that organize multi-granular events with temporal order…

Computation and Language · Computer Science 2021-05-04 Haoyu Wang , Muhao Chen , Hongming Zhang , Dan Roth

Models based on the transformer architecture, such as BERT, have marked a crucial step forward in the field of Natural Language Processing. Importantly, they allow the creation of word embeddings that capture important semantic information…

Computation and Language · Computer Science 2021-01-01 Jacob Turton , David Vinson , Robert Elliott Smith

In this paper, we seek to improve the faithfulness of TempRel extraction models from two perspectives. The first perspective is to extract genuinely based on contextual description. To achieve this, we propose to conduct counterfactual…

Computation and Language · Computer Science 2022-10-13 Haoyu Wang , Hongming Zhang , Yuqian Deng , Jacob R. Gardner , Dan Roth , Muhao Chen

We study the settings for which deep contextual embeddings (e.g., BERT) give large improvements in performance relative to classic pretrained embeddings (e.g., GloVe), and an even simpler baseline---random word embeddings---focusing on the…

Computation and Language · Computer Science 2020-05-20 Simran Arora , Avner May , Jian Zhang , Christopher Ré

Contextual embeddings, such as ELMo and BERT, move beyond global word representations like Word2Vec and achieve ground-breaking performance on a wide range of natural language processing tasks. Contextual embeddings assign each word a…

Computation and Language · Computer Science 2020-04-14 Qi Liu , Matt J. Kusner , Phil Blunsom

Electronic Health Records are large repositories of valuable clinical data, with a significant portion stored in unstructured text format. This textual data includes clinical events (e.g., disorders, symptoms, findings, medications and…

Computation and Language · Computer Science 2024-09-02 Shubham Agarwal , Thomas Searle , Mart Ratas , Anthony Shek , James Teo , Richard Dobson