English
Related papers

Related papers: Self-Supervised Predictive Coding with Multimodal …

200 papers

Accurate Intensive Care Unit (ICU) outcome prediction is critical for improving patient treatment quality and ICU resource allocation. Existing research mainly focuses on structured data, e.g. demographics and vital signs, and lacks…

Information Theory · Computer Science 2025-02-26 Yucheng Ruan , Daniel J. Tan , See Kiong Ng , Ling Huang , Mengling Feng

Integration of multimodal information from various sources has been shown to boost the performance of machine learning models and thus has received increased attention in recent years. Often such models use deep modality-specific networks…

Machine Learning · Computer Science 2022-11-22 Shiv Shankar , Laure Thompson , Madalina Fiterau

Anticipating human actions is an important task that needs to be addressed for the development of reliable intelligent agents, such as self-driving cars or robot assistants. While the ability to make future predictions with high accuracy is…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Olga Zatsarynna , Yazan Abu Farha , Juergen Gall

Intensive Care Units usually carry patients with a serious risk of mortality. Recent research has shown the ability of Machine Learning to indicate the patients' mortality risk and point physicians toward individuals with a heightened need…

Machine Learning · Computer Science 2025-02-03 Korbinian Randl , Núria Lladós Armengol , Lena Mondrejevski , Ioanna Miliou

3D patient body modeling is critical to the success of automated patient positioning for smart medical scanning and operating rooms. Existing CNN-based end-to-end patient modeling solutions typically require a) customized network designs…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Meng Zheng , Benjamin Planche , Xuan Gong , Fan Yang , Terrence Chen , Ziyan Wu

Cardiac disease evaluation depends on multiple diagnostic modalities: electrocardiogram (ECG) to diagnose abnormal heart rhythms, and imaging modalities such as Magnetic Resonance Imaging (MRI), Computed Tomography (CT) and echocardiography…

Signal Processing · Electrical Eng. & Systems 2024-12-25 Evariste Njomgue Fotso , Buntheng Ly , Hubert Cochet , Maxime Sermesant

As artificial intelligence systems move toward clinical deployment, ensuring reliable prediction behavior is fundamental for safety-critical decision-making tasks. One proposed safeguard is selective prediction, where models can defer…

Machine Learning · Computer Science 2026-05-25 L. Julián Lechuga López , Farah E. Shamout , Tim G. J. Rudner

Uncertainty Quantification (UQ) is crucial for ensuring the reliability of machine learning models deployed in real-world autonomous systems. However, existing approaches typically quantify task-level output prediction uncertainty without…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Luke Chen , Junyao Wang , Trier Mortlock , Pramod Khargonekar , Mohammad Abdullah Al Faruque

Early identification of intensive care patients at risk of in-hospital mortality enables timely intervention and efficient resource allocation. Despite high predictive performance, existing machine learning approaches lack transparency and…

Machine Learning · Computer Science 2025-11-21 Alexander Bakumenko , Janine Hoelscher , Hudson Smith

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. To achieve the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Qinghua Lin , Guang-Hai Liu , Zuoyong Li , Yang Li , Yuting Jiang , Xiang Wu

Background Predicting mortality and resource utilization from electronic health records (EHRs) is challenging yet crucial for optimizing patient outcomes and managing costs in intensive care unit (ICU). Existing approaches predominantly…

Computation and Language · Computer Science 2025-08-29 Yucheng Ruan , Xiang Lan , Daniel J. Tan , Hairil Rizal Abdullah , Mengling Feng

Social media popularity prediction plays a crucial role in content optimization, marketing strategies, and user engagement enhancement across digital platforms. However, predicting post popularity remains challenging due to the complex…

Multimedia · Computer Science 2025-07-02 Liliang Ye , Yunyao Zhang , Yafeng Wu , Yi-Ping Phoebe Chen , Junqing Yu , Wei Yang , Zikai Song

Cardiac amyloidosis, a rare and highly morbid condition, presents significant challenges for detection through echocardiography. Recently, there has been a surge in proposing machine-learning algorithms to identify cardiac amyloidosis, with…

Image and Video Processing · Electrical Eng. & Systems 2024-06-10 Zishun Feng , Joseph A. Sivak , Ashok K. Krishnamurthy

Managing fluid balance in dialysis patients is crucial, as improper management can lead to severe complications. In this paper, we propose a multimodal approach that integrates visual features from lung ultrasound images with clinical data…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Tianqi Yang , Nantheera Anantrasirichai , Oktay Karakuş , Marco Allinovi , Alin Achim

The current cancer treatment practice collects multimodal data, such as radiology images, histopathology slides, genomics and clinical data. The importance of these data sources taken individually has fostered the recent raise of radiomics…

Machine Learning · Computer Science 2023-06-16 Matteo Tortora , Ermanno Cordelli , Rosa Sicilia , Lorenzo Nibid , Edy Ippolito , Giuseppe Perrone , Sara Ramella , Paolo Soda

Multimodal clinical prediction is widely used to integrate heterogeneous data such as Electronic Health Records (EHR) and biosignals. However, existing methods tend to rely on static modality integration schemes and simple fusion…

Machine Learning · Computer Science 2026-01-16 Jongseok Kim , Seongae Kang , Jonghwan Shin , Yuhan Lee , Ohyun Jo

Background: Elderly patients with MODS have high risk of death and poor prognosis. The performance of current scoring systems assessing the severity of MODS and its mortality remains unsatisfactory. This study aims to develop an…

Mental disorders are among the foremost contributors to the global healthcare challenge. Research indicates that timely diagnosis and intervention are vital in treating various mental disorders. However, the early somatization symptoms of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Yichun Li , Shuanglin Li , Syed Mohsen Naqvi

The majority of biomedical studies use limited datasets that may not generalize over large heterogeneous datasets that have been collected over several decades. The current paper develops and validates several multimodal models that can…

Accurate time-series forecasting is crucial in various scientific and industrial domains, yet deep learning models often struggle to capture long-term dependencies and adapt to data distribution shifts over time. We introduce Future-Guided…

Machine Learning · Computer Science 2025-09-30 Skye Gunasekaran , Assel Kembay , Hugo Ladret , Rui-Jie Zhu , Laurent Perrinet , Omid Kavehei , Jason Eshraghian