English
Related papers

Related papers: MedPatch: Confidence-Guided Multi-Stage Fusion for…

200 papers

Sleep abnormalities can have severe health consequences. Automated sleep staging, i.e. labelling the sequence of sleep stages from the patient's physiological recordings, could simplify the diagnostic process. Previous work on automated…

Signal Processing · Electrical Eng. & Systems 2023-04-14 Konstantinos Kontras , Christos Chatzichristos , Huy Phan , Johan Suykens , Maarten De Vos

Clinical decision-making requires synthesizing heterogeneous evidence, including patient histories, clinical guidelines, and trajectories of comparable cases. While large language models (LLMs) offer strong reasoning capabilities, they…

Artificial Intelligence · Computer Science 2026-03-03 Shuheng Chen , Namratha Patil , Haonan Pan , Angel Hsing-Chi Hwang , Yao Du , Ruishan Liu , Jieyu Zhao

The performance of vision models in medical imaging is often hindered by the prevailing paradigm of fine-tuning backbones pre-trained on out-of-domain natural images. To address this fundamental domain gap, we propose MedDChest, a new…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Mahmoud Soliman , Islam Osman , Mohamed S. Shehata , Rasika Rajapakshe

Multimodal AI has demonstrated superior performance over unimodal approaches by leveraging diverse data sources for more comprehensive analysis. However, applying this effectiveness in healthcare is challenging due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Pranav Poudel , Prashant Shrestha , Sanskar Amgain , Yash Raj Shrestha , Prashnna Gyawali , Binod Bhattarai

For many conditions, it is of clinical importance to know not just the ability of a test to distinguish between those with and without the disease, but also the sensitivity to detect disease at different stages: in particular, the test's…

Methodology · Statistics 2026-02-10 Efthymia Derezea , Nicky J Welton , Gabriel Rogers , Hayley E Jones

The current cancer treatment practice collects multimodal data, such as radiology images, histopathology slides, genomics and clinical data. The importance of these data sources taken individually has fostered the recent raise of radiomics…

Machine Learning · Computer Science 2023-06-16 Matteo Tortora , Ermanno Cordelli , Rosa Sicilia , Lorenzo Nibid , Edy Ippolito , Giuseppe Perrone , Sara Ramella , Paolo Soda

Federated learning (FL) enables collaborative model training across decentralized medical institutions while preserving data privacy. However, medical FL benchmarks remain scarce, with existing efforts focusing mainly on unimodal or bimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Aavash Chhetri , Bibek Niroula , Pratik Shrestha , Yash Raj Shrestha , Lesley A Anderson , Prashnna K Gyawali , Loris Bazzani , Binod Bhattarai

Single image depth estimation is a foundational task in computer vision and generative modeling. However, prevailing depth estimation models grapple with accommodating the increasing resolutions commonplace in today's consumer cameras and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Zhenyu Li , Shariq Farooq Bhat , Peter Wonka

Clinical machine learning faces a critical dilemma in high-stakes medical applications: algorithms achieving optimal diagnostic performance typically sacrifice the interpretability essential for physician decision-making, while…

Machine Learning · Computer Science 2025-09-23 Xiuqi Ge , Zhibo Yao , Yaosong Du

Multimodal medical image fusion (MMIF) extracts the most meaningful information from multiple source images, enabling a more comprehensive and accurate diagnosis. Achieving high-quality fusion results requires a careful balance of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Dan He , Weisheng Li , Guofen Wang , Yuping Huang , Shiqiang Liu

To develop intelligent speech assistants and integrate them seamlessly with intra-operative decision-support frameworks, accurate and efficient surgical phase recognition is a prerequisite. In this study, we propose a multimodal framework…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-24 Kubilay Can Demir , Belen Lojo Rodriguez , Tobias Weise , Andreas Maier , Seung Hee Yang

Clinical decision making (CDM) is a complex, dynamic process crucial to healthcare delivery, yet it remains a significant challenge for artificial intelligence systems. While Large Language Model (LLM)-based agents have been tested on…

Computation and Language · Computer Science 2025-10-13 Jie Liu , Wenxuan Wang , Zizhan Ma , Guolin Huang , Yihang SU , Kao-Jung Chang , Wenting Chen , Haoliang Li , Linlin Shen , Michael Lyu

Recent advances in medical multi-modal models focus on specialized image analysis like dermatology, pathology, or radiology. However, they do not fully capture the complexity of real-world clinical diagnostics, which involve heterogeneous…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Jiao Xu , Junwei Liu , Jiangwei Lao , Qi Zhu , Yunpeng Zhao , Congyun Jin , Shinan Liu , Zhihong Lu , Lihe Zhang , Xin Chen , Jian Wang , Ping Wang

Protecting patient privacy remains a fundamental barrier to scaling machine learning across healthcare institutions, where centralizing sensitive data is often infeasible due to ethical, legal, and regulatory constraints. Federated learning…

Machine Learning · Computer Science 2026-03-24 Vagish Kumar , Syed Bahauddin Alam , Souvik Chakraborty

Text-guided image editing has seen significant progress in natural image domains, but its application in medical imaging remains limited and lacks standardized evaluation frameworks. Such editing could revolutionize clinical practices by…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Minghao Liu , Zhitao He , Zhiyuan Fan , Qingyun Wang , Yi R. Fung

Purpose High dimensional, multimodal data can nowadays be analyzed by huge deep neural networks with little effort. Several fusion methods for bringing together different modalities have been developed. Given the prevalence of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Christian Gapp , Elias Tappeiner , Martin Welk , Karl Fritscher , Elke Ruth Gizewski , Rainer Schubert

In semi-supervised segmentation, capturing meaningful semantic structures from unlabeled data is essential. This is particularly challenging in histopathology image analysis, where objects are densely distributed. To address this issue, we…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Meilong Xu , Xiaoling Hu , Shahira Abousamra , Chen Li , Chao Chen

Recent advances in transformer architectures have revolutionised natural language processing, but their application to healthcare domains presents unique challenges. Patient timelines are characterised by irregular sampling, variable…

Computation and Language · Computer Science 2025-05-26 Linglong Qian , Zina Ibrahim

Synthesizing missing modalities in multi-modal magnetic resonance imaging (MRI) is vital for ensuring diagnostic completeness, particularly when full acquisitions are infeasible due to time constraints, motion artifacts, and patient…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yue Zhang , Zhizheng Zhuo , Siyao Xu , Shan Lv , Zhaoxi Liu , Jun Qiu , Qiuli Wang , Yaou Liu , S. Kevin Zhou

Recent advances in clinical AI have enabled remarkable progress across many clinical domains. However, existing benchmarks and models are primarily limited to a small set of modalities and tasks, which hinders the development of large-scale…

Machine Learning · Computer Science 2025-03-21 Wei Dai , Peilin Chen , Malinda Lu , Daniel Li , Haowen Wei , Hejie Cui , Paul Pu Liang