English
Related papers

Related papers: Serialized EHR make for good text representations

200 papers

Effective representation learning of electronic health records is a challenging task and is becoming more important as the availability of such data is becoming pervasive. The data contained in these records are irregular and contain…

Machine Learning · Computer Science 2020-05-05 Sajad Darabi , Mohammad Kachuee , Shayan Fazeli , Majid Sarrafzadeh

Despite the growing availability of Electronic Health Record (EHR) data, researchers often face substantial barriers in effectively using these data for translational research due to their complexity, heterogeneity, and lack of standardized…

Unstructured clinical text in EHRs contains crucial information for applications including decision support, trial matching, and retrospective research. Recent work has applied BERT-based models to clinical information extraction and text…

Computation and Language · Computer Science 2020-11-13 Kexin Huang , Sankeerth Garapati , Alexander S. Rich

The widespread adoption of Electronic Health Records (EHR) has significantly increased the amount of available healthcare data. This has allowed models inspired by Natural Language Processing (NLP) and Computer Vision, which scale…

While large-scale pretraining has revolutionized language modeling, its potential remains underexplored in healthcare with structured electronic health records (EHRs). We present RAVEN, a novel generative pretraining strategy for sequential…

We address the problem of predicting when a disease will develop, i.e., medical event time (MET), from a patient's electronic health record (EHR). The MET of non-communicable diseases like diabetes is highly correlated to cumulative health…

Machine Learning · Computer Science 2023-06-01 Takayuki Katsuki , Kohei Miyaguchi , Akira Koseki , Toshiya Iwamori , Ryosuke Yanagiya , Atsushi Suzuki

Sequential diagnosis prediction on the Electronic Health Record (EHR) has been proven crucial for predictive analytics in the medical domain. EHR data, sequential records of a patient's interactions with healthcare systems, has numerous…

Machine Learning · Computer Science 2021-09-08 Xueping Peng , Guodong Long , Tao Shen , Sen Wang , Jing Jiang

Evaluating the clinical similarities between pairwise patients is a fundamental problem in healthcare informatics. A proper patient similarity measure enables various downstream applications, such as cohort study and treatment comparative…

Machine Learning · Statistics 2019-02-12 Zihao Zhu , Changchang Yin , Buyue Qian , Yu Cheng , Jishang Wei , Fei Wang

Clinical events captured in Electronic Health Records (EHR) are irregularly sampled and may consist of a mixture of discrete events and numerical measurements, such as laboratory values or treatment dosages. The sequential nature of EHR,…

The development of electronic health records (EHR) systems has enabled the collection of a vast amount of digitized patient data. However, utilizing EHR data for predictive modeling presents several challenges due to its unique…

Machine Learning · Computer Science 2024-08-14 Jiaqi Wang , Junyu Luo , Muchao Ye , Xiaochen Wang , Yuan Zhong , Aofei Chang , Guanjie Huang , Ziyi Yin , Cao Xiao , Jimeng Sun , Fenglong Ma

Electronic Health Records (EHRs) contain rich temporal dynamics that conventional encoding approaches fail to adequately capture. While Large Language Models (LLMs) show promise for EHR modeling, they struggle to reason about sequential…

Artificial Intelligence · Computer Science 2025-10-01 Zekai Chen , Arda Pekis , Kevin Brown

The wide adoption of Electronic Health Records (EHR) has resulted in large amounts of clinical data becoming available, which promises to support service delivery and advance clinical and informatics research. Deep learning techniques have…

Machine Learning · Computer Science 2022-02-14 Thanh Nguyen-Duc , Natasha Mulligan , Gurdeep S. Mannu , Joao H. Bettencourt-Silva

In this paper we study the problem of predicting clinical diagnoses from textual Electronic Health Records (EHR) data. We show the importance of this problem in medical community and present comprehensive historical review of the problem…

Computation and Language · Computer Science 2020-09-29 Pavel Blinov , Manvel Avetisian , Vladimir Kokh , Dmitry Umerenkov , Alexander Tuzhilin

Domain-specific foundation models for healthcare have expanded rapidly in recent years, yet foundation models for critical care time series remain relatively underexplored due to the limited size and availability of datasets. In this work,…

Machine Learning · Computer Science 2025-09-25 Katja Naasunnguaq Jagd , Rachael DeVries , Ole Winther

Electronic Health Records (EHR) are time-series relational databases that record patient interactions and medical events over time, serving as a critical resource for healthcare research and applications. However, privacy concerns and…

Machine Learning · Computer Science 2026-03-03 Eunbyeol Cho , Jiyoun Kim , Minjae Lee , Sungjin Park , Edward Choi

Synthetic Electronic Health Records (EHR) have emerged as a pivotal tool in advancing healthcare applications and machine learning models, particularly for researchers without direct access to healthcare data. Although existing methods,…

Electronic Health Record (EHR) data can be represented as discrete counts over a high dimensional set of possible procedures, diagnoses, and medications. Supervised topic models present an attractive option for incorporating EHR data as…

Machine Learning · Computer Science 2019-11-21 Jason Ren , Russell Kunes , Finale Doshi-Velez

A meaningful understanding of clinical protocols and patient pathways helps improve healthcare outcomes. Electronic health records (EHR) reflect real-world treatment behaviours that are used to enhance healthcare management but present…

Machine Learning · Computer Science 2021-10-05 Adrian Caruana , Madhushi Bandara , Daniel Catchpoole , Paul J Kennedy

Electronic health records (EHR) offer unprecedented opportunities for in-depth clinical phenotyping and prediction of clinical outcomes. Combining multiple data sources is crucial to generate a complete picture of disease prevalence,…

Computation and Language · Computer Science 2022-12-01 Anna Munoz-Farre , Harry Rose , Sera Aylin Cakiroglu

Despite the widespread success of self-supervised learning via masked language models (MLM), accurately capturing fine-grained semantic relationships in the biomedical domain remains a challenge. This is of paramount importance for…

Computation and Language · Computer Science 2021-04-08 Fangyu Liu , Ehsan Shareghi , Zaiqiao Meng , Marco Basaldella , Nigel Collier