English
Related papers

Related papers: A Multimodal Transformer: Fusing Clinical Notes wi…

200 papers

As the volume of Electronic Health Records (EHR) sharply grows, there has been emerging interest in learning the representation of EHR for healthcare applications. Representation learning of EHR requires appropriate modeling of the two…

Computation and Language · Computer Science 2022-03-21 Sungjin Park , Seongsu Bae , Jiho Kim , Tackeun Kim , Edward Choi

In intensive care units (ICUs), critically ill patients are monitored with electroencephalograms (EEGs) to prevent serious brain injury. The number of patients who can be monitored is constrained by the availability of trained physicians to…

Electronic Health Records (EHR) have been heavily used in modern healthcare systems for recording patients' admission information to hospitals. Many data-driven approaches employ temporal features in EHR for predicting specific diseases,…

Machine Learning · Computer Science 2021-12-07 Chang Lu , Chandan K. Reddy , Yue Ning

Electronic health records (EHR) are irregular, asynchronous multivariate time series. As time-series foundation models increasingly tokenize events rather than discretizing time, the input layout becomes a key design choice. Grids expose…

Machine Learning · Computer Science 2026-03-13 Joohyung Lee , Kwanhyung Lee , Changhun Kim , Eunho Yang

Accurate clinical prognosis requires synthesizing structured Electronic Health Records (EHRs) with real-time physiological signals like the Electrocardiogram (ECG). Large Language Models (LLMs) offer a powerful reasoning engine for this…

Machine Learning · Computer Science 2026-01-27 Jialu Tang , Tong Xia , Yuan Lu , Aaqib Saeed

Various deep learning algorithms have been developed to analyze different types of clinical data including clinical text classification and extracting information from 'free text' and so on. However, automate the keyword extraction from the…

Computation and Language · Computer Science 2019-10-25 Matthew Tang , Priyanka Gandhi , Md Ahsanul Kabir , Christopher Zou , Jordyn Blakey , Xiao Luo

Machine learning models depend on the quality of input data. As electronic health records are widely adopted, the amount of data in health care is growing, along with complaints about the quality of medical notes. We use two prediction…

Computation and Language · Computer Science 2020-12-10 Chao-Chun Hsu , Shantanu Karnwal , Sendhil Mullainathan , Ziad Obermeyer , Chenhao Tan

Postoperative complications pose a significant challenge in the healthcare industry, resulting in elevated healthcare expenses and prolonged hospital stays, and in rare instances, patient mortality. To improve patient outcomes and reduce…

Machine Learning · Computer Science 2023-06-07 Reza Shirkavand , Fei Zhang , Heng Huang

Large language models (LLMs) excel at text generation, but their ability to handle clinical classification tasks involving structured data, such as time series, remains underexplored. In this work, we adapt instruction-tuned LLMs using…

Computation and Language · Computer Science 2025-09-18 Iyadh Ben Cheikh Larbi , Ajay Madhavan Ravichandran , Aljoscha Burchardt , Roland Roller

Machine learning methods in healthcare have traditionally focused on using data from a single modality, limiting their ability to effectively replicate the clinical practice of integrating multiple sources of information for improved…

Machine Learning · Computer Science 2024-02-13 Felix Krones , Umar Marikkar , Guy Parsons , Adam Szmul , Adam Mahdi

Sequential diagnosis prediction on the Electronic Health Record (EHR) has been proven crucial for predictive analytics in the medical domain. EHR data, sequential records of a patient's interactions with healthcare systems, has numerous…

Machine Learning · Computer Science 2021-09-08 Xueping Peng , Guodong Long , Tao Shen , Sen Wang , Jing Jiang

Foundation models hold promise for transforming AI in healthcare by providing modular components that are easily adaptable to downstream healthcare tasks, making AI development more scalable and cost-effective. Structured EHR foundation…

This study proposes a risk prediction method based on a Multi-Scale Temporal Alignment Network (MSTAN) to address the challenges of temporal irregularity, sampling interval differences, and multi-scale dynamic dependencies in Electronic…

Machine Learning · Computer Science 2025-11-27 Wei-Chen Chang , Lu Dai , Ting Xu

This project performs multimodal sentiment analysis using the CMU-MOSEI dataset, using transformer-based models with early fusion to integrate text, audio, and visual modalities. We employ BERT-based encoders for each modality, extracting…

Computation and Language · Computer Science 2025-07-16 Jugal Gajjar , Kaustik Ranaware

This paper proposes a multimodal emotion recognition system based on hybrid fusion that classifies the emotions depicted by speech utterances and corresponding images into discrete classes. A new interpretability technique has been…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Puneet Kumar , Sarthak Malik , Balasubramanian Raman

Electronic health records (EHR's) are only a first step in capturing and utilizing health-related data - the problem is turning that data into useful information. Models produced via data mining and predictive analysis profile inherited…

Databases · Computer Science 2011-12-08 Casey Bennett , Thomas Doub

Within the intensive care unit (ICU), a wealth of patient data, including clinical measurements and clinical notes, is readily available. This data is a valuable resource for comprehending patient health and informing medical decisions, but…

Machine Learning · Computer Science 2023-12-13 Ryan King , Tianbao Yang , Bobak Mortazavi

Electronic health records (EHRs) include simple features like patient age together with more complex data like care history that are informative but not easily represented as individual features. To better harness such data, we developed an…

Artificial Intelligence · Computer Science 2023-02-14 Jacqueline K. Kueper , Jennifer Rayner , Daniel J. Lizotte

In this paper, we present our approach to extracting structured information from unstructured Electronic Health Records (EHR) [2] which can be used to, for example, study adverse drug reactions in patients due to chemicals in their…

Computation and Language · Computer Science 2020-01-30 Amogh Kamat Tarcar , Aashis Tiwari , Vineet Naique Dhaimodker , Penjo Rebelo , Rahul Desai , Dattaraj Rao

Transformer-based deep learning models have shown promise for disease risk prediction using electronic health records(EHRs), but modeling temporal dependencies remains a key challenge due to irregular visit intervals and lack of uniform…

Machine Learning · Computer Science 2025-11-10 Daniel S. Lee , Mayra S. Haedo-Cruz , Chen Jiang , Oshin Miranda , LiRong Wang