English
Related papers

Related papers: A Multimodal Transformer: Fusing Clinical Notes wi…

200 papers

Background: Elderly patients with MODS have high risk of death and poor prognosis. The performance of current scoring systems assessing the severity of MODS and its mortality remains unsatisfactory. This study aims to develop an…

Today, the acquisition of various behavioral log data has enabled deeper understanding of customer preferences and future behaviors in the marketing field. In particular, multimodal deep learning has achieved highly accurate predictions by…

Computational Engineering, Finance, and Science · Computer Science 2024-05-14 Junichiro Niimi

The wide implementation of electronic health record (EHR) systems facilitates the collection of large-scale health data from real clinical settings. Despite the significant increase in adoption of EHR systems, this data remains largely…

Quantitative Methods · Quantitative Biology 2018-10-26 Jinghe Zhang , Kamran Kowsari , James H. Harrison , Jennifer M. Lobo , Laura E. Barnes

The integration of multimodal Electronic Health Records (EHR) data has significantly improved clinical predictive capabilities. Leveraging clinical notes and multivariate time-series EHR, existing models often lack the medical context…

Artificial Intelligence · Computer Science 2024-02-13 Yinghao Zhu , Changyu Ren , Shiyun Xie , Shukai Liu , Hangyuan Ji , Zixiang Wang , Tao Sun , Long He , Zhoujun Li , Xi Zhu , Chengwei Pan

Multimodal deep learning has been used to predict clinical endpoints and diagnoses from clinical routine data. However, these models suffer from scaling issues: they have to learn pairwise interactions between each piece of information in…

Clinical outcome prediction based on the Electronic Health Record (EHR) plays a crucial role in improving the quality of healthcare. Conventional deep sequential models fail to capture the rich temporal patterns encoded in the longand…

Machine Learning · Computer Science 2019-08-27 Luchen Liu , Haoran Li , Zhiting Hu , Haoran Shi , Zichang Wang , Jian Tang , Ming Zhang

The large amount of time clinicians spend sifting through patient notes and documenting in electronic health records (EHRs) is a leading cause of clinician burnout. By proactively and dynamically retrieving relevant notes during the…

Information Retrieval · Computer Science 2023-08-17 Sharon Jiang , Shannon Shen , Monica Agrawal , Barbara Lam , Nicholas Kurtzman , Steven Horng , David Karger , David Sontag

The combination of electronic health records (EHR) and medical images is crucial for clinicians in making diagnoses and forecasting prognosis. Strategically fusing these two data modalities has great potential to improve the accuracy of…

Image and Video Processing · Electrical Eng. & Systems 2024-10-24 Wenfang Yao , Kejing Yin , William K. Cheung , Jia Liu , Jing Qin

Foundation models have emerged as a powerful approach for processing electronic health records (EHRs), offering flexibility to handle diverse medical data modalities. In this study, we present a comprehensive benchmark that evaluates the…

Machine Learning · Computer Science 2025-07-22 Kunyu Yu , Rui Yang , Jingchi Liao , Siqi Li , Huitao Li , Irene Li , Yifan Peng , Rishikesan Kamaleswaran , Nan Liu

Augmentation of disease diagnosis and decision-making in healthcare with machine learning algorithms is gaining much impetus in recent years. In particular, in the current epidemiological situation caused by COVID-19 pandemic, swift and…

Computers and Society · Computer Science 2021-02-23 Leopold Franz , Yash Raj Shrestha , Bibek Paudel

With the increasing availability of patient data, modern medicine is shifting towards prospective healthcare. Electronic health records offer a variety of information useful for clinical patient characterization and the development of…

Machine Learning · Computer Science 2025-05-27 Fabio Azzalini , Tommaso Dolci , Marco Vagaggini

Predicting the risk of in-hospital mortality from electronic health records (EHRs) has received considerable attention. Such predictions will provide early warning of a patient's health condition to healthcare professionals so that timely…

Machine Learning · Computer Science 2023-08-22 Yuxi Liu , Zhenhao Zhang , Shaowen Qin , Flora D. Salim , Antonio Jimeno Yepes

Large-scale pretraining has transformed modeling of language and other data types, but its potential remains underexplored in healthcare with structured electronic health records (EHRs). We present a novel generative pretraining strategy…

In the dynamic hospital setting, decision support can be a valuable tool for improving patient outcomes. Data-driven inference of future outcomes is challenging in this dynamic setting, where long sequences such as laboratory tests and…

Quantitative Methods · Quantitative Biology 2024-04-25 Alan D. Kaplan , Priyadip Ray , John D. Greene , Vincent X. Liu

High hospital readmission rates are associated with significant costs and health risks for patients. Therefore, it is critical to develop predictive models that can support clinicians to determine whether or not a patient will return to the…

Machine Learning · Computer Science 2025-04-01 Tiago Almeida , Plinio Moreno , Catarina Barata

Electronic health records (EHRs) recorded in hospital settings typically contain a wide range of numeric time series data that is characterized by high sparsity and irregular observations. Effective modelling for such data must exploit its…

Multimodal sentiment analysis is an important research area that predicts speaker's sentiment tendency through features extracted from textual, visual and acoustic modalities. The central challenge is the fusion method of the multimodal…

Computation and Language · Computer Science 2020-09-29 Zilong Wang , Zhaohong Wan , Xiaojun Wan

Emotion Recognition in Conversation (ERC) plays an important role in driving the development of human-machine interaction. Emotions can exist in multiple modalities, and multimodal ERC mainly faces two problems: (1) the noise problem in the…

Computation and Language · Computer Science 2023-10-10 Shihao Zou , Xianying Huang , Xudong Shen

Intensive Care in-hospital mortality prediction has various clinical applications. Neural prediction models, especially when capitalising on clinical notes, have been put forward as improvement on currently existing models. However, to be…

Computation and Language · Computer Science 2022-12-14 Miguel Rios , Ameen Abu-Hanna

The inherent complexity of structured longitudinal Electronic Health Records (EHR) data poses a significant challenge when integrated with Large Language Models (LLMs), which are traditionally tailored for natural language processing.…

Computation and Language · Computer Science 2024-02-13 Yinghao Zhu , Zixiang Wang , Junyi Gao , Yuning Tong , Jingkun An , Weibin Liao , Ewen M. Harrison , Liantao Ma , Chengwei Pan