English
Related papers

Related papers: Does BERT Pretrained on Clinical Notes Reveal Sens…

200 papers

Unsupervised pretraining is an integral part of many natural language processing systems, and transfer learning with language models has achieved remarkable results in many downstream tasks. In the clinical application of medical code…

Computation and Language · Computer Science 2022-06-03 Shaoxiong Ji , Matti Hölttä , Pekka Marttinen

Various deep learning algorithms have been developed to analyze different types of clinical data including clinical text classification and extracting information from 'free text' and so on. However, automate the keyword extraction from the…

Computation and Language · Computer Science 2019-10-25 Matthew Tang , Priyanka Gandhi , Md Ahsanul Kabir , Christopher Zou , Jordyn Blakey , Xiao Luo

The growing adoption of electronic health record (EHR) systems has provided unprecedented opportunities for predictive modeling to guide clinical decision making. Structured EHRs contain longitudinal observations of patients across hospital…

Machine Learning · Computer Science 2026-03-12 Deyi Li , Zijun Yao , Qi Xu , Muxuan Liang , Lingyao Li , Zijian Xu , Mei Liu

The advent of large language models (LLMs) has opened new avenues for analyzing complex, unstructured data, particularly within the medical domain. Electronic Health Records (EHRs) contain a wealth of information in various formats,…

Information Retrieval · Computer Science 2025-06-10 Wu Hao Ran , Xi Xi , Furong Li , Jingyi Lu , Jian Jiang , Hui Huang , Yuzhuan Zhang , Shi Li

The development of electronic health records (EHR) systems has enabled the collection of a vast amount of digitized patient data. However, utilizing EHR data for predictive modeling presents several challenges due to its unique…

Machine Learning · Computer Science 2024-08-14 Jiaqi Wang , Junyu Luo , Muchao Ye , Xiaochen Wang , Yuan Zhong , Aofei Chang , Guanjie Huang , Ziyi Yin , Cao Xiao , Jimeng Sun , Fenglong Ma

Effective modeling of electronic health records (EHR) is rapidly becoming an important topic in both academia and industry. A recent study showed that using the graphical structure underlying EHR data (e.g. relationship between diagnoses…

Machine Learning · Computer Science 2020-01-22 Edward Choi , Zhen Xu , Yujia Li , Michael W. Dusenberry , Gerardo Flores , Yuan Xue , Andrew M. Dai

Longitudinal data in electronic health records (EHRs) represent an individual`s clinical history through a sequence of codified concepts, including diagnoses, procedures, medications, and laboratory tests. Generative pre-trained…

Foundation models hold promise for transforming AI in healthcare by providing modular components that are easily adaptable to downstream healthcare tasks, making AI development more scalable and cost-effective. Structured EHR foundation…

Electronic Health Records (EHRs) provide a wealth of information for machine learning algorithms to predict the patient outcome from the data including diagnostic information, vital signals, lab tests, drug administration, and demographic…

Machine Learning · Computer Science 2021-06-16 Byunggill Joe , Akshay Mehra , Insik Shin , Jihun Hamm

Electronic health records (EHR) contain narrative notes that provide extensive details on the medical condition and management of patients. Natural language processing (NLP) of clinical notes can use observed frequencies of clinical terms…

Computation and Language · Computer Science 2023-07-04 Bryan Cai , Sihang Zeng , Yucong Lin , Zheng Yuan , Doudou Zhou , Lu Tian

Synthetic Electronic Health Records (EHR) have emerged as a pivotal tool in advancing healthcare applications and machine learning models, particularly for researchers without direct access to healthcare data. Although existing methods,…

Clinical notes contain an extensive record of a patient's health status, such as smoking status or the presence of heart conditions. However, this detail is not replicated within the structured data of electronic health systems.…

Computation and Language · Computer Science 2020-09-18 Andriy Mulyar , Elliot Schumacher , Masoud Rouhizadeh , Mark Dredze

Foundation models (FMs) trained on electronic health records (EHRs) have shown strong performance on a range of clinical prediction tasks. However, adapting these models to local health systems remains challenging due to limited data…

Embedding algorithms are increasingly used to represent clinical concepts in healthcare for improving machine learning tasks such as clinical phenotyping and disease prediction. Recent studies have adapted state-of-the-art bidirectional…

Machine Learning · Computer Science 2021-12-07 Chao Pang , Xinzhuo Jiang , Krishna S Kalluri , Matthew Spotnitz , RuiJun Chen , Adler Perotte , Karthik Natarajan

This study proposes a Transformer-based longitudinal modeling method to address challenges in clinical risk classification with heterogeneous Electronic Health Record (EHR) data, including irregular temporal patterns, large modality…

Machine Learning · Computer Science 2025-11-07 Anzhuo Xie , Wei-Chen Chang

We investigated the feasibility of predicting Medical Subject Headings (MeSH) Publication Types (PTs) from MEDLINE citation metadata using pre-trained Transformer-based models BERT and DistilBERT. This study addresses limitations in the…

Digital Libraries · Computer Science 2025-06-05 Victor H. Cid , James Mork

Accurate extraction of breast cancer patients' phenotypes is important for clinical decision support and clinical research. Current models do not take full advantage of cancer domain-specific corpus, whether pre-training Bidirectional…

Information Retrieval · Computer Science 2022-03-10 Sicheng Zhou , Liwei Wang , Nan Wang , Hongfang Liu , Rui Zhang

Foundation models for structured electronic health records (EHRs) are pretrained on longitudinal sequences of timestamped clinical events to learn adaptable patient representations. Tokenization -- how these timelines are converted into…

Early detection of preventable diseases is important for better disease management, improved inter-ventions, and more efficient health-care resource allocation. Various machine learning approacheshave been developed to utilize information…

Machine Learning · Computer Science 2018-08-16 Jingshu Liu , Zachariah Zhang , Narges Razavian

The presence of detailed clinical information in electronic health record (EHR) systems presents promising prospects for enhancing patient care through automated retrieval techniques. Nevertheless, it is widely acknowledged that accessing…

Information Retrieval · Computer Science 2024-09-13 Abderrahim Oussama Batouche , Eugen Czeizler , Miika Koskinen , Tuomas Mirtti , Antti Sakari Rannikko