English
Related papers

Related papers: Bidirectional Representation Learning from Transfo…

200 papers

A wide variety of methods have been developed for identifying depression, but they focus primarily on measuring the degree to which individuals are suffering from depression currently. In this work we explore the possibility of predicting…

Machine Learning · Computer Science 2022-03-22 Guansong Pang , Ngoc Thien Anh Pham , Emma Baker , Rebecca Bentley , Anton van den Hengel

Electronic Health Records (EHRs) enable deep learning for clinical predictions, but the optimal method for representing patient data remains unclear due to inconsistent evaluation practices. We present the first systematic benchmark to…

Machine Learning · Computer Science 2025-10-13 Tianyi Chen , Mingcheng Zhu , Zhiyao Luo , Tingting Zhu

The temporal complexity of electronic health record (EHR) data presents significant challenges for predicting clinical outcomes using machine learning. This paper proposes ChronoFormer, an innovative transformer based architecture…

Machine Learning · Computer Science 2025-04-11 Yuanyun Zhang , Shi Li

Massive electronic health records (EHRs) enable the success of learning accurate patient representations to support various predictive health applications. In contrast, doctor representation was not well studied despite that doctors play…

Machine Learning · Computer Science 2019-11-26 Siddharth Biswal , Cao Xiao , Lucas M. Glass , Elizabeth Milkovits , Jimeng Sun

Analysis of longitudinal Electronic Health Record (EHR) data is an important goal for precision medicine. Difficulty in applying Machine Learning (ML) methods, either predictive or unsupervised, stems in part from the heterogeneity and…

Quantitative Methods · Quantitative Biology 2022-04-18 Alan D. Kaplan , Uttara Tipnis , Jean C. Beckham , Nathan A. Kimbrel , David W. Oslin , Benjamin H. McMahon

Foundation models trained on electronic health records show strong performance on many clinical prediction tasks but are limited by sparse and irregular documentation. Wearable devices provide dense continuous physiological signals but lack…

Machine Learning · Computer Science 2026-01-21 Yuanyun Zhang , Han Zhou , Li Feng , Yilin Hong , Shi Li

With the wide application of electronic health records (EHR) in healthcare facilities, health event prediction with deep learning has gained more and more attention. A common feature of EHR data used for deep-learning-based predictions is…

Machine Learning · Computer Science 2021-12-17 Chang Lu , Tian Han , Yue Ning

We show how to learn low-dimensional representations (embeddings) of patient visits from the corresponding electronic health record (EHR) where International Classification of Diseases (ICD) diagnosis codes are removed. We expect that these…

Computers and Society · Computer Science 2018-03-28 Jean-Baptiste Escudié , Alaa Saade , Alice Coucke , Marc Lelarge

In this paper we study the problem of predicting clinical diagnoses from textual Electronic Health Records (EHR) data. We show the importance of this problem in medical community and present comprehensive historical review of the problem…

Computation and Language · Computer Science 2020-09-29 Pavel Blinov , Manvel Avetisian , Vladimir Kokh , Dmitry Umerenkov , Alexander Tuzhilin

Early detection of preventable diseases is important for better disease management, improved inter-ventions, and more efficient health-care resource allocation. Various machine learning approacheshave been developed to utilize information…

Machine Learning · Computer Science 2018-08-16 Jingshu Liu , Zachariah Zhang , Narges Razavian

Distributed representations of medical concepts have been used to support downstream clinical tasks recently. Electronic Health Records (EHR) capture different aspects of patients' hospital encounters and serve as a rich source for…

Computation and Language · Computer Science 2020-01-07 Shaika Chowdhury , Chenwei Zhang , Philip S. Yu , Yuan Luo

Learning time-series representations for discriminative tasks, such as classification and regression, has been a long-standing challenge in the healthcare domain. Current pre-training methods are limited in either unidirectional next-token…

Artificial Intelligence · Computer Science 2024-08-27 Ziyang Song , Qincheng Lu , He Zhu , David Buckeridge , Yue Li

Sequential diagnosis prediction on the Electronic Health Record (EHR) has been proven crucial for predictive analytics in the medical domain. EHR data, sequential records of a patient's interactions with healthcare systems, has numerous…

Machine Learning · Computer Science 2021-09-08 Xueping Peng , Guodong Long , Tao Shen , Sen Wang , Jing Jiang

In this study, we introduce ExBEHRT, an extended version of BEHRT (BERT applied to electronic health records), and apply different algorithms to interpret its results. While BEHRT considers only diagnoses and patient age, we extend the…

Machine Learning · Computer Science 2023-08-14 Maurice Rupp , Oriane Peter , Thirupathi Pattipaka

Deep learning (DL) based predictive models from electronic health records (EHR) deliver impressive performance in many clinical tasks. Large training cohorts, however, are often required to achieve high accuracy, hindering the adoption of…

Computation and Language · Computer Science 2020-05-27 Laila Rasmy , Yang Xiang , Ziqian Xie , Cui Tao , Degui Zhi

Key features of mental illnesses are reflected in speech. Our research focuses on designing a multimodal deep learning structure that automatically extracts salient features from recorded speech samples for predicting various mental…

Machine Learning · Computer Science 2020-04-15 Habibeh Naderi , Behrouz Haji Soleimani , Stan Matwin

The availability of a large amount of electronic health records (EHR) provides huge opportunities to improve health care service by mining these data. One important application is clinical endpoint prediction, which aims to predict whether…

Artificial Intelligence · Computer Science 2018-11-20 Luchen Liu , Jianhao Shen , Ming Zhang , Zichang Wang , Jian Tang

Digital healthcare systems have enabled the collection of mass healthcare data in electronic healthcare records (EHRs), allowing artificial intelligence solutions for various healthcare prediction tasks. However, existing studies often…

Machine Learning · Computer Science 2025-08-27 Zi Cai , Yu Liu , Zhiyao Luo , Tingting Zhu

Depression is a common mental disorder. Automatic depression detection tools using speech, enabled by machine learning, help early screening of depression. This paper addresses two limitations that may hinder the clinical implementations of…

Computation and Language · Computer Science 2023-10-09 Qingkun Deng , Saturnino Luz , Sofia de la Fuente Garcia

Continuous electroencephalography (EEG) is routinely used in neurocritical care to monitor seizures and other harmful brain activity, including rhythmic and periodic patterns that are clinically significant. Although deep learning methods…

Human-Computer Interaction · Computer Science 2026-01-05 Argha Kamal Samanta , Deepak Mewada , Monalisa Sarma , Debasis Samanta