English
Related papers

Related papers: Representation Before Training: A Fixed-Budget Ben…

200 papers

The electrocardiogram (ECG) is a key diagnostic tool in cardiovascular health. Single-lead ECG recording is integrated into both clinical-grade and consumer wearables. While self-supervised pretraining of foundation models on unlabeled ECGs…

Machine Learning · Computer Science 2025-12-03 Yuxuan Shu , Peter H. Charlton , Fahim Kawsar , Jussi Hernesniemi , Mohammad Malekzadeh

Reinforcement Learning (RL) has recently been applied to sequential estimation and prediction problems identifying and developing hypothetical treatment strategies for septic patients, with a particular focus on offline learning with…

Machine Learning · Computer Science 2020-11-24 Taylor W. Killian , Haoran Zhang , Jayakumar Subramanian , Mehdi Fatemi , Marzyeh Ghassemi

To improve the performance of Intensive Care Units (ICUs), the field of bio-statistics has developed scores which try to predict the likelihood of negative outcomes. These help evaluate the effectiveness of treatments and clinical practice,…

Machine Learning · Computer Science 2019-08-23 William Caicedo-Torres , Jairo Gutierrez

Contrastive pre-training on image-text pairs, exemplified by CLIP, becomes a standard technique for learning multi-modal visual-language representations. Although CLIP has demonstrated remarkable performance, training it from scratch on…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Jihao Liu , Jinliang Zheng , Boxiao Liu , Yu Liu , Hongsheng Li

Medical events of interest, such as mortality, often happen at a low rate in electronic medical records, as most admitted patients survive. Training models with this imbalance rate (class density discrepancy) may lead to suboptimal…

Machine Learning · Computer Science 2022-08-02 Zepeng Huo , Xiaoning Qian , Shuai Huang , Zhangyang Wang , Bobak J. Mortazavi

Healthcare data continues to flourish yet a relatively small portion, mostly structured, is being utilized effectively for predicting clinical outcomes. The rich subjective information available in unstructured clinical notes can possibly…

Machine Learning · Computer Science 2019-11-20 Mohammad Hashir , Rapinder Sawhney

Foundation models trained on patient electronic health records (EHRs) require tokenizing medical data into sequences of discrete vocabulary items. Existing tokenizers treat medical codes from EHRs as isolated textual tokens. However, each…

Computation and Language · Computer Science 2025-07-01 Xiaorui Su , Shvat Messica , Yepeng Huang , Ruth Johnson , Lukas Fesser , Shanghua Gao , Faryad Sahneh , Marinka Zitnik

Autoregressive models can predict clinical events, but generating patient-conditioned multi-step trajectories that respond to intervention tokens and testing whether those responses preserve known pharmacological associations has received…

Machine Learning · Computer Science 2026-05-07 Chris Sainsbury , Feng Dong , Andreas Karwath

Every year, millions of patients pass through emergency departments and intensive care units, where clinicians must make high-stakes decisions under time pressure and uncertainty. Machine learning could support prediction of deterioration,…

Machine Learning · Computer Science 2026-05-27 Yusuf Brima , Marcellin Atemkeng

Generic pre-trained speech and text representations promise to reduce the need for large labeled datasets on specific speech and language tasks. However, it is not clear how to effectively adapt these representations for speech emotion…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-28 Sundararajan Srinivasan , Zhaocheng Huang , Katrin Kirchhoff

Assessing acute brain dysfunction (ABD), including delirium and coma in the intensive care unit (ICU), is a critical challenge due to its prevalence and severe implications for patient outcomes. Current diagnostic methods rely on infrequent…

Objective. Standard Magnetic Resonance Imaging (MRI) reconstruction pipelines discard phase information captured during acquisition, despite evidence that it encodes tissue properties relevant to tumor diagnosis. Current machine learning…

Image and Video Processing · Electrical Eng. & Systems 2026-04-17 Marco Schlimbach , Moritz Rempe , Jessica Mnischek , Lukas T. Rotkopf , Jens Weingarten , Jens Kleesiek , Kevin Kröninger

Time-to-event endpoints are central to evaluate treatment efficacy across many disease areas. Many trial protocols include interim analyses within group-sequential designs that control type I error via spending functions or boundary…

Methodology · Statistics 2026-01-19 Edoardo Ratti , Federico L. Perlino , Stefania Galimberti , Maria G. Valsecchi

Generative recommendation has recently emerged as a transformative paradigm that directly generates target items, surpassing traditional cascaded approaches. It typically involves two components: a tokenizer that learns item identifiers and…

Information Retrieval · Computer Science 2026-01-27 Jialei Li , Yang Zhang , Yimeng Bai , Shuai Zhu , Ziqi Xue , Xiaoyan Zhao , Dingxian Wang , Frank Yang , Andrew Rabinovich , Xiangnan He

Machine learning for early syndrome diagnosis aims to solve the intricate task of predicting a ground truth label that most often is the outcome (effect) of a medical consensus definition applied to observed clinical measurements (causes),…

Machine Learning · Computer Science 2024-08-27 Michael Staniek , Marius Fracarolli , Michael Hagmann , Stefan Riezler

Predicting time-to-event outcomes in large databases can be a challenging but important task. One example of this is in predicting the time to a clinical outcome for patients in intensive care units (ICUs), which helps to support critical…

Computation · Statistics 2019-08-06 Yingying Xu , Joon Lee , Joel A. Dubin

Prognostic information is essential for decision-making in breast cancer management. Recently trials have predominantly focused on genomic prognostication tools, even though clinicopathological prognostication is less costly and more widely…

In healthcare, patient risk stratification models are often learned using time-series data extracted from electronic health records. When extracting data for a clinical prediction task, several formulations exist, depending on how one…

Machine Learning · Computer Science 2018-12-03 Eli Sherman , Hitinder Gurm , Ulysses Balis , Scott Owens , Jenna Wiens

The choice of tokenizer can profoundly impact language model performance, yet accessible and reliable evaluations of tokenizer quality remain an open challenge. Inspired by scaling consistency, we show that smaller models can accurately…

Computation and Language · Computer Science 2025-06-04 Jonas F. Lotz , António V. Lopes , Stephan Peitz , Hendra Setiawan , Leonardo Emili

The rapid progress of Large Multimodal Models (LMMs) and cloud-based AI agents is transforming human-AI collaboration into bidirectional, multimodal interaction. However, existing codecs remain optimized for unimodal, one-way communication,…

Artificial Intelligence · Computer Science 2025-09-29 Qi Mao , Tinghan Yang , Jiahao Li , Bin Li , Libiao Jin , Yan Lu