English
Related papers

Related papers: Structured prediction models for RNN based sequenc…

200 papers

The widespread availability of electronic health records (EHRs) promises to usher in the era of personalized medicine. However, the problem of extracting useful clinical representations from longitudinal EHR data remains challenging. In…

Machine Learning · Computer Science 2017-01-27 Zhengping Che , Yu Cheng , Zhaonan Sun , Yan Liu

This paper introduces Graph Convolutional Recurrent Network (GCRN), a deep learning model able to predict structured sequences of data. Precisely, GCRN is a generalization of classical recurrent neural networks (RNN) to data structured by…

Machine Learning · Statistics 2016-12-23 Youngjoo Seo , Michaël Defferrard , Pierre Vandergheynst , Xavier Bresson

Structured prediction energy networks (SPENs; Belanger & McCallum 2016) use neural network architectures to define energy functions that can capture arbitrary dependencies among parts of structured outputs. Prior work used gradient descent…

Computation and Language · Computer Science 2018-03-12 Lifu Tu , Kevin Gimpel

This work proposes Recurrent Neural Network (RNN) models to predict structured 'image situations' -- actions and noun entities fulfilling semantic roles related to the action. In contrast to prior work relying on Conditional Random Fields…

Computer Vision and Pattern Recognition · Computer Science 2017-08-07 Arun Mallya , Svetlana Lazebnik

In this work, we consider the medical concept normalization problem, i.e., the problem of mapping a disease mention in free-form text to a concept in a controlled vocabulary, usually to the standard thesaurus in the Unified Medical Language…

Computation and Language · Computer Science 2018-11-30 Elena Tutubalina , Zulfat Miftahutdinov , Sergey Nikolenko , Valentin Malykh

As a step toward better document-level understanding, we explore classification of a sequence of sentences into their corresponding categories, a task that requires understanding sentences in context of the document. Recent successful…

Computation and Language · Computer Science 2021-03-24 Arman Cohan , Iz Beltagy , Daniel King , Bhavana Dalvi , Daniel S. Weld

In this paper we propose the Structured Deep Neural Network (Structured DNN) as a structured and deep learning algorithm, learning to find the best structured object (such as a label sequence) given a structured input (such as a vector…

Machine Learning · Computer Science 2015-06-04 Yi-Hsiu Liao , Hung-Yi Lee , Lin-shan Lee

We present an adaptation of RNN sequence models to the problem of multi-label classification for text, where the target is a set of labels, not a sequence. Previous such RNN models define probabilities for sequences but not for sets;…

Computation and Language · Computer Science 2019-04-12 Kechen Qin , Cheng Li , Virgil Pavlu , Javed A. Aslam

We study the segmental recurrent neural network for end-to-end acoustic modelling. This model connects the segmental conditional random field (CRF) with a recurrent neural network (RNN) used for feature extraction. Compared to most previous…

Computation and Language · Computer Science 2016-06-21 Liang Lu , Lingpeng Kong , Chris Dyer , Noah A. Smith , Steve Renals

This paper addresses the challenges posed by the unstructured nature and high-dimensional semantic complexity of electronic health record texts. A deep learning method based on attention mechanisms is proposed to achieve unified modeling…

Computation and Language · Computer Science 2025-07-03 Ting Xu , Xiaoxiao Deng , Xiandong Meng , Haifeng Yang , Yan Wu

Unsupervised structure learning in high-dimensional time series data has attracted a lot of research interests. For example, segmenting and labelling high dimensional time series can be helpful in behavior understanding and medical…

Machine Learning · Computer Science 2017-05-25 Hao Liu , Haoli Bai , Lirong He , Zenglin Xu

Crucial information about the practice of healthcare is recorded only in free-form text, which creates an enormous opportunity for high-impact NLP. However, annotated healthcare datasets tend to be small and expensive to obtain, which…

Computation and Language · Computer Science 2019-04-09 Yifeng Tao , Bruno Godefroy , Guillaume Genthial , Christopher Potts

Named entity recognition (NER) is a widely studied task in natural language processing. Recently, a growing number of studies have focused on the nested NER. The span-based methods, considering the entity recognition as a span…

Computation and Language · Computer Science 2021-06-22 Zeqi Tan , Yongliang Shen , Shuai Zhang , Weiming Lu , Yueting Zhuang

Over the last several years, the field of Structured prediction in NLP has had seen huge advancements with sophisticated probabilistic graphical models, energy-based networks, and its combination with deep learning-based approaches. This…

Computation and Language · Computer Science 2021-10-06 Chauhan Dev , Naman Biyani , Nirmal P. Suthar , Prashant Kumar , Priyanshu Agarwal

We propose two neural network architectures for nested named entity recognition (NER), a setting in which named entities may overlap and also be labeled with more than one label. We encode the nested labels using a linearized scheme. In our…

Computation and Language · Computer Science 2019-08-20 Jana Straková , Milan Straka , Jan Hajič

Recurrent Neural Networks (RNNs) have been widely used in processing natural language tasks and achieve huge success. Traditional RNNs usually treat each token in a sentence uniformly and equally. However, this may miss the rich semantic…

Computation and Language · Computer Science 2018-11-14 Chang Xu , Weiran Huang , Hongwei Wang , Gang Wang , Tie-Yan Liu

The Clinical E-Science Framework (CLEF) project was used to extract important information from medical texts by building a system for the purpose of clinical research, evidence-based healthcare and genotype-meets-phenotype informatics. The…

Information Retrieval · Computer Science 2013-06-24 Wafaa Tawfik Abdel-moneim , Mohamed Hashem Abdel-Aziz , Mohamed Monier Hassan

Convolutional Neural Networks (CNNs) are effective models for reducing spectral variations and modeling spectral correlations in acoustic features for automatic speech recognition (ASR). Hybrid speech recognition systems incorporating CNNs…

Computation and Language · Computer Science 2017-01-11 Ying Zhang , Mohammad Pezeshki , Philemon Brakel , Saizheng Zhang , Cesar Laurent Yoshua Bengio , Aaron Courville

Electronic Health Record (EHR) coding involves automatically classifying EHRs into diagnostic codes. While most previous research treats this as a multi-label classification task, generating probabilities for each code and selecting those…

Machine Learning · Computer Science 2023-06-28 Xiaofan Zhou , Xunzhu Tang

Reviewing radiology reports in emergency departments is an essential but laborious task. Timely follow-up of patients with abnormal cases in their radiology reports may dramatically affect the patient's outcome, especially if they have been…

Computation and Language · Computer Science 2018-12-06 Hamed Hassanzadeh , Mahnoosh Kholghi , Anthony Nguyen , Kevin Chu