English
Related papers

Related papers: Serialized EHR make for good text representations

200 papers

In recent years, we have witnessed an increased interest in temporal modeling of patient records from large scale Electronic Health Records (EHR). While simpler RNN models have been used for such problems, memory networks, which in other…

Machine Learning · Computer Science 2020-07-15 Prithwish Chakraborty , Fei Wang , Jianying Hu , Daby Sow

Electronic health records (EHR) contain extensive structured and unstructured data, including tabular information and free-text clinical notes. Querying relevant patient information often requires complex database operations, increasing the…

Information Retrieval · Computer Science 2025-11-27 Mengliang ZHang

Large language models (LLMs) have emerged as promising tools for assisting in medical tasks, yet processing Electronic Health Records (EHRs) presents unique challenges due to their longitudinal nature. While LLMs' capabilities to perform…

Artificial Intelligence · Computer Science 2025-03-07 Hejie Cui , Alyssa Unell , Bowen Chen , Jason Alan Fries , Emily Alsentzer , Sanmi Koyejo , Nigam Shah

The academic literature of social sciences records human civilization and studies human social problems. With its large-scale growth, the ways to quickly find existing research on relevant issues have become an urgent demand for…

Computation and Language · Computer Science 2022-11-28 Si Shen , Jiangfeng Liu , Litao Lin , Ying Huang , Lin Zhang , Chang Liu , Yutong Feng , Dongbo Wang

The paper researches the problem of representation learning for electronic health records. We present the patient histories as temporal sequences of diseases for which embeddings are learned in an unsupervised setup with a transformer-based…

Computers and Society · Computer Science 2023-11-08 Pavel Blinov , Vladimir Kokh

Electronic health records (EHRs) are rich clinical data sources but complex repositories of patient data, spanning structured elements (demographics, vitals, lab results, codes), unstructured clinical notes and other modalities of data.…

Artificial Intelligence · Computer Science 2025-08-25 Sonish Sivarajkumar , Hang Zhang , Yuelyu Ji , Maneesh Bilalpur , Xizhi Wu , Chenyu Li , Min Gu Kwak , Shyam Visweswaran , Yanshan Wang

In the medical field, current ECG signal analysis approaches rely on supervised deep neural networks trained for specific tasks that require substantial amounts of labeled data. However, our paper introduces ECGBERT, a self-supervised…

Signal Processing · Electrical Eng. & Systems 2023-06-13 Seokmin Choi , Sajad Mousavi , Phillip Si , Haben G. Yhdego , Fatemeh Khadem , Fatemeh Afghah

Electronic Health Records (EHRs) provide vital contextual information to radiologists and other physicians when making a diagnosis. Unfortunately, because a given patient's record may contain hundreds of notes and reports, identifying…

Objective: To transform heterogeneous clinical data from electronic health records into clinically meaningful constructed features using data driven method that rely, in part, on temporal relations among data. Materials and Methods: The…

Machine Learning · Computer Science 2017-06-22 Edward Choi , Andy Schuetz , Walter F. Stewart , Jimeng Sun

The overwhelming amount of biomedical scientific texts calls for the development of effective language models able to tackle a wide range of biomedical natural language processing (NLP) tasks. The most recent dominant approaches are…

Computation and Language · Computer Science 2021-04-21 Giacomo Miolo , Giulio Mantoan , Carlotta Orsenigo

Deep learning models in healthcare may fail to generalize on data from unseen corpora. Additionally, no quantitative metric exists to tell how existing models will perform on new data. Previous studies demonstrated that NLP models of…

Computation and Language · Computer Science 2021-02-22 Mihir P. Khambete , William Su , Juan Garcia , Marcus A. Badgeley

Electronic Health Records are large repositories of valuable clinical data, with a significant portion stored in unstructured text format. This textual data includes clinical events (e.g., disorders, symptoms, findings, medications and…

Computation and Language · Computer Science 2024-09-02 Shubham Agarwal , Thomas Searle , Mart Ratas , Anthony Shek , James Teo , Richard Dobson

Rich Electronic Health Records (EHR), have created opportunities to improve clinical processes using machine learning methods. Prediction of the same patient events at different time horizons can have very different applications and…

Machine Learning · Computer Science 2023-03-07 Hao Liu , Muhan Zhang , Zehao Dong , Lecheng Kong , Yixin Chen , Bradley Fritz , Dacheng Tao , Christopher King

Electronic Health Records (EHR) are high-dimensional data with implicit connections among thousands of medical concepts. These connections, for instance, the co-occurrence of diseases and lab-disease correlations can be informative when…

Machine Learning · Computer Science 2021-03-29 Weicheng Zhu , Narges Razavian

Clinical language models are important for many applications in healthcare, but their development depends on access to extensive clinical text for pretraining. However, obtaining clinical notes from electronic health records (EHRs) at scale…

Computation and Language · Computer Science 2024-12-02 Jinghui Liu , Anthony Nguyen

Longitudinal multimodal data, including electronic health records (EHR) and sequential chest X-rays (CXRs), is critical for modeling disease progression, yet remains underutilized due to two key challenges: (1) redundancy in consecutive CXR…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Chen Liu , Wenfang Yao , Kejing Yin , William K. Cheung , Jing Qin

Embeddings of medical concepts such as medication, procedure and diagnosis codes in Electronic Medical Records (EMRs) are central to healthcare analytics. Previous work on medical concept embedding takes medical concepts and EMRs as words…

Computation and Language · Computer Science 2018-06-11 Xiangrui Cai , Jinyang Gao , Kee Yuan Ngiam , Beng Chin Ooi , Ying Zhang , Xiaojie Yuan

Alzheimer's disease is a progressive, debilitating neurodegenerative disease that affects 50 million people globally. Despite this substantial health burden, available treatments for the disease are limited and its fundamental causes remain…

Machine Learning · Computer Science 2024-04-02 Matthew West , Colin Magdamo , Lily Cheng , Yingnan He , Sudeshna Das

Sequence labeling for extraction of medical events and their attributes from unstructured text in Electronic Health Record (EHR) notes is a key step towards semantic understanding of EHRs. It has important applications in health informatics…

Computation and Language · Computer Science 2016-07-13 Abhyuday Jagannatha , Hong Yu

Research is a tertiary priority in the EHR, where the priorities are patient care and billing. Because of this, the data is not standardized or formatted in a manner easily adapted to machine learning approaches. Data may be missing for a…

Machine Learning · Computer Science 2017-07-25 Brett K. Beaulieu-Jones