English
Related papers

Related papers: Does BERT Pretrained on Clinical Notes Reveal Sens…

200 papers

Hospitals struggle to predict critical outcomes. Traditional early warning systems, like NEWS and MEWS, rely on static variables and fixed thresholds, limiting their adaptability, accuracy, and personalization. We previously developed the…

Each and every organisation releases information in a variety of forms ranging from annual reports to legal proceedings. Such documents may contain sensitive information and releasing them openly may lead to the leakage of confidential…

Computation and Language · Computer Science 2022-03-15 Roelien C. Timmer , David Liebowitz , Surya Nepal , Salil S. Kanhere

Electronic health record (EHR) data has emerged as a valuable resource for analyzing patient health status. However, the prevalence of missing data in EHR poses significant challenges to existing methods, leading to spurious correlations…

Machine Learning · Computer Science 2024-05-16 Zhihao Yu , Xu Chu , Yujie Jin , Yasha Wang , Junfeng Zhao

Deep learning models exhibit state-of-the-art performance for many predictive healthcare tasks using electronic health records (EHR) data, but these models typically require training data volume that exceeds the capacity of most healthcare…

Machine Learning · Computer Science 2018-10-24 Edward Choi , Cao Xiao , Walter F. Stewart , Jimeng Sun

Unstructured data in Electronic Health Records (EHRs) often contains critical information -- complementary to imaging -- that could inform radiologists' diagnoses. But the large volume of notes often associated with patients together with…

Computation and Language · Computer Science 2024-06-12 Hiba Ahsan , Denis Jered McInerney , Jisoo Kim , Christopher Potter , Geoffrey Young , Silvio Amir , Byron C. Wallace

Developing high-performance entity normalization algorithms that can alleviate the term variation problem is of great interest to the biomedical community. Although deep learning-based methods have been successfully applied to biomedical…

Information Retrieval · Computer Science 2019-08-12 Zongcheng Ji , Qiang Wei , Hua Xu

Healthcare data continues to flourish yet a relatively small portion, mostly structured, is being utilized effectively for predicting clinical outcomes. The rich subjective information available in unstructured clinical notes can possibly…

Machine Learning · Computer Science 2019-11-20 Mohammad Hashir , Rapinder Sawhney

Professionals in modern healthcare systems are increasingly burdened by documentation workloads. Documentation of the initial patient anamnesis is particularly relevant, forming the basis of successful further diagnostic measures. However,…

Computation and Language · Computer Science 2020-11-04 Anton Schäfer , Nils Blach , Oliver Rausch , Maximilian Warm , Nils Krüger

This study proposes a medical entity extraction method based on Transformer to enhance the information extraction capability of medical literature. Considering the professionalism and complexity of medical texts, we compare the performance…

Computation and Language · Computer Science 2025-04-08 Xiaokai Wang , Guiran Liu , Binrong Zhu , Jacky He , Hongye Zheng , Hanlu Zhang

Pre-trained Transformer-based models have achieved state-of-the-art performance for various Natural Language Processing (NLP) tasks. However, these models often have billions of parameters, and, thus, are too resource-hungry and…

Machine Learning · Computer Science 2021-09-29 Prakhar Ganesh , Yao Chen , Xin Lou , Mohammad Ali Khan , Yin Yang , Hassan Sajjad , Preslav Nakov , Deming Chen , Marianne Winslett

The emergence of foundation models in healthcare has opened new avenues for learning generalizable representations from large scale clinical data. Yet, existing approaches often struggle to reconcile the tabular and event based nature of…

Computation and Language · Computer Science 2025-10-17 Zhirong Chou , Quan Qin , Shi Li

The use of Electronic Health Records (EHRs) has increased dramatically in the past 15 years, as, it is considered an important source of managing data od patients. The EHRs are primary sources of disease diagnosis and demographic data of…

Machine Learning · Computer Science 2024-04-02 Bushra F. Alsaqer , Alaa F. Alsaqer , Amna Asif

Accurate prediction of clinical outcomes using Electronic Health Records (EHRs) is critical for early intervention, efficient resource allocation, and improved patient care. EHRs contain multimodal data, including both structured data and…

Machine Learning · Computer Science 2025-08-29 Rituparna Datta , Jiaming Cui , Zihan Guan , Vishal G. Reddy , Joshua C. Eby , Gregory Madden , Rupesh Silwal , Anil Vullikanti

Electronic Health Records (EHRs) aggregate diverse information at the patient level, holding a trajectory representative of the evolution of the patient health status throughout time. Although this information provides context and can be…

Machine Learning · Computer Science 2022-09-12 João Figueira Silva , Sérgio Matos

The wide implementation of electronic health record (EHR) systems facilitates the collection of large-scale health data from real clinical settings. Despite the significant increase in adoption of EHR systems, this data remains largely…

Quantitative Methods · Quantitative Biology 2018-10-26 Jinghe Zhang , Kamran Kowsari , James H. Harrison , Jennifer M. Lobo , Laura E. Barnes

Recent work explored the potential of large-scale Transformer-based pre-trained models, especially Pre-trained Language Models (PLMs) in natural language processing. This raises many concerns from various perspectives, e.g., financial costs…

Computation and Language · Computer Science 2022-05-23 Yuxin Ren , Benyou Wang , Lifeng Shang , Xin Jiang , Qun Liu

Despite the proven effectiveness of Transformer neural networks across multiple domains, their performance with Electronic Health Records (EHR) can be nuanced. The unique, multidimensional sequential nature of EHR data can sometimes make…

Machine Learning · Computer Science 2023-11-13 Yogesh Kumar , Alexander Ilin , Henri Salo , Sangita Kulathinal , Maarit K. Leinonen , Pekka Marttinen

This paper presents an iterative approach to performing Scientific Named Entity Recognition (SciNER) using BERT-based models. We leverage transfer learning to fine-tune pretrained models with a small but high-quality set of manually…

Computation and Language · Computer Science 2025-02-25 Kartik Gupta

Electronic health records (EHRs) provide a powerful basis for predicting the onset of health outcomes. Yet EHRs primarily capture in-clinic events and miss aspects of daily behavior and lifestyle containing rich health information. Consumer…

Medical named entity recognition (NER) has wide applications in intelligent healthcare. Sufficient labeled data is critical for training accurate medical NER model. However, the labeled data in a single medical platform is usually limited.…

Computation and Language · Computer Science 2020-03-26 Suyu Ge , Fangzhao Wu , Chuhan Wu , Tao Qi , Yongfeng Huang , Xing Xie