English
Related papers

Related papers: Clinical Relation Extraction Using Transformer-bas…

200 papers

In this paper, we describe novel components for extracting clinically relevant information from medical conversations which will be available as Google APIs. We describe a transformer-based Recurrent Neural Network Transducer (RNN-T) model…

Machine Learning · Computer Science 2021-04-07 Hagen Soltau , Mingqiu Wang , Izhak Shafran , Laurent El Shafey

In natural language, often multiple entities appear in the same text. However, most previous works in Relation Extraction (RE) limit the scope to identifying the relation between two entities at a time. Such an approach induces a quadratic…

Computation and Language · Computer Science 2020-10-13 Zhijing Jin , Yongyi Yang , Xipeng Qiu , Zheng Zhang

Extracting cause and effect phrases from a sentence is an important NLP task, with numerous applications in various domains, including legal, medical, education, and scientific research. There are many unsupervised and supervised methods…

Machine Learning · Computer Science 2025-07-15 Md Ahsanul Kabir , Abrar Jahin , Mohammad Al Hasan

Joint entity and relation extraction is the fundamental task of information extraction, consisting of two subtasks: named entity recognition and relation extraction. However, most existing joint extraction methods suffer from issues of…

Computation and Language · Computer Science 2024-03-28 Wenjun Kong , Yamei Xia

Systematic comparison of methods for relation extraction (RE) is difficult because many experiments in the field are not described precisely enough to be completely reproducible and many papers fail to report ablation studies that would…

Computation and Language · Computer Science 2021-07-14 Geeticka Chauhan , Matthew B. A. McDermott , Peter Szolovits

The availability of biomedical text data and advances in natural language processing (NLP) have made new applications in biomedical NLP possible. Language models trained or fine tuned using domain specific corpora can outperform general…

Computation and Language · Computer Science 2021-07-12 Usman Naseem , Adam G. Dunn , Matloob Khushi , Jinman Kim

Pre-trained and fine-tuned transformer models like BERT and T5 have improved the state of the art in ad-hoc retrieval and question-answering, but not as yet in high-recall information retrieval, where the objective is to retrieve…

Information Retrieval · Computer Science 2022-08-16 Nima Sadri , Gordon V. Cormack

Recent years have seen a phenomenal rise in performance and applications of transformer neural networks. The family of transformer networks, including Bidirectional Encoder Representations from Transformer (BERT), Generative Pretrained…

Machine Learning · Computer Science 2023-07-18 Krishna Teja Chitty-Venkata , Sparsh Mittal , Murali Emani , Venkatram Vishwanath , Arun K. Somani

Deep neural networks such as BERT have made great progress in relation classification. Although they can achieve good performance, it is still a question of concern whether these models recognize the directionality of relations, especially…

Computation and Language · Computer Science 2021-12-02 Shengfei Lyu , Xingyu Wu , Jinlong Li , Qiuju Chen , Huanhuan Chen

Suicide is a critical global health problem involving more than 700,000 deaths yearly, particularly among young adults. Many people express their suicidal thoughts on social media platforms such as Reddit. This paper evaluates the…

Machine Learning · Computer Science 2025-03-11 Khalid Hasan , Jamil Saquer

A long-running goal of the clinical NLP community is the extraction of important variables trapped in clinical notes. However, roadblocks have included dataset shift from the general domain and a lack of public clinical corpora and…

Computation and Language · Computer Science 2022-12-01 Monica Agrawal , Stefan Hegselmann , Hunter Lang , Yoon Kim , David Sontag

Pre-trained language models have been dominating the field of natural language processing in recent years, and have led to significant performance gains for various complex natural language tasks. One of the most prominent pre-trained…

Computation and Language · Computer Science 2020-09-17 Pieter Delobelle , Thomas Winters , Bettina Berendt

Pre-trained Transformer-based models have achieved state-of-the-art performance for various Natural Language Processing (NLP) tasks. However, these models often have billions of parameters, and, thus, are too resource-hungry and…

Machine Learning · Computer Science 2021-09-29 Prakhar Ganesh , Yao Chen , Xin Lou , Mohammad Ali Khan , Yin Yang , Hassan Sajjad , Preslav Nakov , Deming Chen , Marianne Winslett

Connections between relations in relation extraction, which we call class ties, are common. In distantly supervised scenario, one entity tuple may have multiple relation facts. Exploiting class ties between relations of one entity tuple…

Artificial Intelligence · Computer Science 2017-08-08 Hai Ye , Wenhan Chao , Zhunchen Luo , Zhoujun Li

Document-level relation extraction (RE) aims to extract the relations between entities from the input document that usually containing many difficultly-predicted entity pairs whose relations can only be predicted through relational…

Computation and Language · Computer Science 2022-11-29 Liang Zhang , Jinsong Su , Yidong Chen , Zhongjian Miao , Zijun Min , Qingguo Hu , Xiaodong Shi

Recent years have witnessed a substantial increase in the use of deep learning to solve various natural language processing (NLP) problems. Early deep learning models were constrained by their sequential or unidirectional nature, such that…

Information Retrieval · Computer Science 2024-03-05 Jiajia Wang , Jimmy X. Huang , Xinhui Tu , Junmei Wang , Angela J. Huang , Md Tahmid Rahman Laskar , Amran Bhuiyan

Deep learning research on relation classification has achieved solid performance in the general domain. This study proposes a convolutional neural network (CNN) architecture with a multi-pooling operation for medical relation classification…

Computation and Language · Computer Science 2018-05-18 Bin He , Yi Guan , Rui Dai

Question Answering (QA) is a task in natural language processing that has seen considerable growth after the advent of transformers. There has been a surge in QA datasets that have been proposed to challenge natural language processing…

Computation and Language · Computer Science 2021-10-08 Kate Pearce , Tiffany Zhan , Aneesh Komanduri , Justin Zhan

Relation extraction (RE) involves identifying the relations between entities from underlying content. RE serves as the foundation for many natural language processing (NLP) and information retrieval applications, such as knowledge graph…

Computation and Language · Computer Science 2024-06-25 Xiaoyan Zhao , Yang Deng , Min Yang , Lingzhi Wang , Rui Zhang , Hong Cheng , Wai Lam , Ying Shen , Ruifeng Xu

This research on data extraction methods applies recent advances in natural language processing to evidence synthesis based on medical texts. Texts of interest include abstracts of clinical trials in English and in multilingual contexts.…

Computation and Language · Computer Science 2020-01-31 Lena Schmidt , Julie Weeds , Julian P. T. Higgins