English
Related papers

Related papers: Clinical XLNet: Modeling Sequential Clinical Notes…

200 papers

With the proliferation of Electronic Health Records (EHRs), a critical challenge in building predictive models is determining the optimal historical data time window to maximize accuracy. This study investigates the impact of various…

Machine Learning · Computer Science 2026-05-04 Ramin Mohammadi , Vahab vahdat , Sarthak Jain , Amir T. Namin , Ramya Palacholla , Sagar Kamarthi

Medical image-language pre-training aims to align medical images with clinically relevant text to improve model performance on various downstream tasks. However, existing models often struggle with the variability and ambiguity inherent in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Shreyank N Gowda , Ruichi Zhang , Xiao Gu , Ying Weng , Lu Yang

Clinical language models have achieved strong performance on downstream tasks by pretraining on domain specific corpora such as discharge summaries and medical notes. However, most approaches treat the electronic health record as a static…

Computation and Language · Computer Science 2025-04-28 Tatsunori Tanaka , Fi Zheng , Kai Sato , Zhifeng Li , Yuanyun Zhang , Shi Li

Past studies on the ICD coding problem focus on predicting clinical codes primarily based on the discharge summary. This covers only a small fraction of the notes generated during each hospital stay and leaves potential for improving…

Machine Learning · Computer Science 2023-02-27 Clarence Boon Liang Ng , Diogo Santos , Marek Rei

Healthcare is becoming a more and more important research topic recently. With the growing data in the healthcare domain, it offers a great opportunity for deep learning to improve the quality of medical service. However, the complexity of…

Computation and Language · Computer Science 2021-11-01 Bo Yang , Lijun Wu

We introduce a new class of time-continuous recurrent neural network models. Instead of declaring a learning system's dynamics by implicit nonlinearities, we construct networks of linear first-order dynamical systems modulated via nonlinear…

Machine Learning · Computer Science 2020-12-16 Ramin Hasani , Mathias Lechner , Alexander Amini , Daniela Rus , Radu Grosu

Despite the progress in utilizing deep learning to automate chest radiograph interpretation and disease diagnosis tasks, change between sequential Chest X-rays (CXRs) has received limited attention. Monitoring the progression of pathologies…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Gaurang Karwande , Amarachi Mbakawe , Joy T. Wu , Leo A. Celi , Mehdi Moradi , Ismini Lourentzou

How to model distribution of sequential data, including but not limited to speech and human motions, is an important ongoing research problem. It has been demonstrated that model capacity can be significantly enhanced by introducing…

Machine Learning · Computer Science 2018-06-19 Guokun Lai , Bohan Li , Guoqing Zheng , Yiming Yang

Clinical data from electronic medical records, registries or trials provide a large source of information to apply machine learning methods in order to foster precision medicine, e.g. by finding new disease phenotypes or performing…

Machine Learning · Computer Science 2020-08-17 Maria Hügle , Gabriel Kalweit , Thomas Huegle , Joschka Boedecker

We analyse multimodal time-series data corresponding to weight, sleep and steps measurements. We focus on predicting whether a user will successfully achieve his/her weight objective. For this, we design several deep long short-term memory…

Objective: realtime monitoring of invasive ventilation (iV) in intensive care units (ICUs) plays a crucial role in ensuring prompt interventions and better patient outcomes. However, conventional methods often overlook valuable insights…

Computation and Language · Computer Science 2024-10-08 Arash Pakbin , Aaron Su , Donald K. K. Lee , Bobak J. Mortazavi

Large language models have exhibited exceptional performance on various Natural Language Processing (NLP) tasks, leveraging techniques such as the pre-training, and instruction fine-tuning. Despite these advances, their effectiveness in…

Computation and Language · Computer Science 2023-06-19 Guangyu Wang , Guoxing Yang , Zongxin Du , Longjun Fan , Xiaohu Li

$\textbf{Objective}$ Develop an automatic diagnostic system which only uses textual admission information from Electronic Health Records (EHRs) and assist clinicians with a timely and statistically proved decision tool. The hope is that the…

Computation and Language · Computer Science 2017-12-08 Christy Li , Dimitris Konomis , Graham Neubig , Pengtao Xie , Carol Cheng , Eric Xing

Large Language Models (LLMs) are increasingly deployed in medicine. However, their utility in non-generative clinical prediction, often presumed inferior to specialized models, remains under-evaluated, leading to ongoing debate within the…

Air quality prediction is key to mitigating health impacts and guiding decisions, yet existing models tend to focus on temporal trends while overlooking spatial generalization. We propose AQ-Net, a spatiotemporal reanalysis model for both…

Machine Learning · Computer Science 2026-04-13 Ammar Kheder , Benjamin Foreback , Lili Wang , Zhi-Song Liu , Michael Boy

Analysis of longitudinal Electronic Health Record (EHR) data is an important goal for precision medicine. Difficulty in applying Machine Learning (ML) methods, either predictive or unsupervised, stems in part from the heterogeneity and…

Quantitative Methods · Quantitative Biology 2022-04-18 Alan D. Kaplan , Uttara Tipnis , Jean C. Beckham , Nathan A. Kimbrel , David W. Oslin , Benjamin H. McMahon

Electronic health records arise from the complex interaction between patients and the healthcare system. This observation process of interactions, referred to as clinical presence, often impacts observed outcomes. When using electronic…

Machine Learning · Computer Science 2025-08-08 Vincent Jeanselme , Glen Martin , Matthew Sperrin , Niels Peek , Brian Tom , Jessica Barrett

Predictive models in acute care settings must be able to immediately recognize precipitous changes in a patient's status when presented with data reflecting such changes. Recurrent neural networks (RNNs) have become common for training and…

Machine Learning · Computer Science 2020-07-30 David Ledbetter , Eugene Laksana , Melissa Aczon , Randall Wetzel

Advances in large language models (LLMs) provide new opportunities in healthcare for improved patient care, clinical decision-making, and enhancement of physician and administrator workflows. However, the potential of these models…

Computation and Language · Computer Science 2024-02-27 Salman Rahman , Lavender Yao Jiang , Saadia Gabriel , Yindalon Aphinyanaphongs , Eric Karl Oermann , Rumi Chunara

Clinical data for ambulatory care, which accounts for 90% of the nations healthcare spending, is characterized by relatively small sample sizes of longitudinal data, unequal spacing between visits for each patient, with unequal numbers of…

Machine Learning · Computer Science 2018-12-03 Beau Norgeot , Dmytro Lituiev , Benjamin S. Glicksberg , Atul J. Butte