English
Related papers

Related papers: Curia: A Multi-Modal Foundation Model for Radiolog…

200 papers

In healthcare, the integration of multimodal data is pivotal for developing comprehensive diagnostic and predictive models. However, managing missing data remains a significant challenge in real-world applications. We introduce MARIA…

Machine Learning · Computer Science 2026-03-13 Camillo Maria Caruso , Paolo Soda , Valerio Guarrasi

Cardiac Magnetic Resonance (CMR) is established as a non-invasive imaging technique for evaluation of heart function, anatomy, and myocardial tissue characterization. Quantitative biomarkers are central for diagnosis and management of heart…

Image and Video Processing · Electrical Eng. & Systems 2024-04-04 Hui Xue , Rhodri H Davies , James Howard , Hunain Shiwani , Azaan Rehman , Iain Pierce , Henry Procter , Marianna Fontana , James C Moon , Eylem Levelt , Peter Kellman

Solving tough clinical questions that require both image and text understanding is still a major challenge in healthcare AI. In this work, we propose Q-FSRU, a new model that combines Frequency Spectrum Representation and Fusion (FSRU) with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Rakesh Thakur , Yusra Tariq

Artificial intelligence (AI) systems hold great promise to improve healthcare over the next decades. Specifically, AI systems leveraging multiple data sources and input modalities are poised to become a viable method to deliver more…

A precise assessment of the risk of breast lesions can greatly lower it and assist physicians in choosing the best course of action. To categorise breast lesions, the majority of current computer-aided systems only use characteristics from…

Image and Video Processing · Electrical Eng. & Systems 2025-08-25 Muhaisin Tiyumba Nantogmah , Abdul-Barik Alhassan , Salamudeen Alhassan

The electrocardiogram (ECG) is a cost-effective, highly accessible and widely employed diagnostic tool. With the advent of Foundation Models (FMs), the field of AI-assisted ECG interpretation has begun to evolve, as they enable model reuse…

Artificial Intelligence · Computer Science 2026-01-30 Francesca Filice , Edoardo De Rose , Simone Bartucci , Francesco Calimeri , Simona Perri

Recent rapid progress in the field of computational pathology has been enabled by foundation models. These models are beginning to move beyond encoding image patches towards whole-slide understanding but their clinical utility remains…

Foundation models (FMs) are large-scale deep learning models trained on massive datasets, often using self-supervised learning techniques. These models serve as a versatile base for a wide range of downstream tasks, including those in…

Machine Learning · Computer Science 2025-01-17 Wasif Khan , Seowung Leem , Kyle B. See , Joshua K. Wong , Shaoting Zhang , Ruogu Fang

Musculoskeletal disorders represent a significant global health burden and are a leading cause of disability worldwide. While MRI is essential for accurate diagnosis, its interpretation remains exceptionally challenging. Radiologists must…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Tian Lan , Lei Xu , Zimu Yuan , Shanggui Liu , Jiajun Liu , Jiaxin Liu , Weilai Xiang , Hongyu Yang , Dong Jiang , Jianxin Yin , Dingyu Wang

Foundation models, often pre-trained with large-scale data, have achieved paramount success in jump-starting various vision and language applications. Recent advances further enable adapting foundation models in downstream tasks efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Dequan Wang , Xiaosong Wang , Lilong Wang , Mengzhang Li , Qian Da , Xiaoqiang Liu , Xiangyu Gao , Jun Shen , Junjun He , Tian Shen , Qi Duan , Jie Zhao , Kang Li , Yu Qiao , Shaoting Zhang

Importance: An artificial intelligence (AI)-based model to predict COVID-19 likelihood from chest x-ray (CXR) findings can serve as an important adjunct to accelerate immediate clinical decision making and improve clinical decision making.…

Recent advancements in deep learning have significantly revolutionized the field of clinical diagnosis and treatment, offering novel approaches to improve diagnostic precision and treatment efficacy across diverse clinical domains, thus…

Artificial Intelligence · Computer Science 2024-12-04 Kai Sun , Siyan Xue , Fuchun Sun , Haoran Sun , Yu Luo , Ling Wang , Siyuan Wang , Na Guo , Lei Liu , Tian Zhao , Xinzhou Wang , Lei Yang , Shuo Jin , Jun Yan , Jiahong Dong

Tumors can manifest in various forms and in different areas of the human body. Brain tumors are specifically hard to diagnose and treat because of the complexity of the organ in which they develop. Detecting them in time can lower the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Antonio Curci , Andrea Esposito

Surgical intelligence has the potential to improve the safety and consistency of surgical care, yet most existing surgical AI frameworks remain task-specific and struggle to generalize across procedures and institutions. Although multimodal…

Early detection and rapid intervention of lung cancer are crucial. Nonetheless, ensuring an accurate diagnosis is challenging, as physicians' ability to interpret chest X-rays varies significantly depending on their experience and degree of…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Hyeonjin Choi , Jinse Kim , Dong-yeon Yoo , Ju-sung Sun , Jung-won Lee

Deep learning has enabled great strides in abdominal multi-organ segmentation, even surpassing junior oncologists on common cases or organs. However, robustness on corner cases and complex organs remains a challenging open problem for…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Xiangde Luo , Zihan Li , Shaoting Zhang , Wenjun Liao , Guotai Wang

Foundation models (FMs) are catalyzing a transformative shift in materials science (MatSci) by enabling scalable, general-purpose, and multimodal AI systems for scientific discovery. Unlike traditional machine learning models, which are…

Machine Learning · Computer Science 2025-06-27 Minh-Hao Van , Prateek Verma , Chen Zhao , Xintao Wu

Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Continual learning offers…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Mohammad Areeb Qazi , Munachiso S Nwadike , Ibrahim Almakky , Mohammad Yaqub , Numan Saeed

With the advance of deep learning, much progress has been made in building powerful artificial intelligence (AI) systems for automatic Chest X-ray (CXR) analysis. Most existing AI models are trained to be a binary classifier with the aim of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Xiangyu Peng , Kai Wang , Jianfei Yang , Yingying Zhu , Yang You

Lung ultrasound is a growing modality in clinics for diagnosing and monitoring acute and chronic lung diseases due to its low cost and accessibility. Lung ultrasound works by emitting diagnostic pulses, receiving pressure waves and…

Image and Video Processing · Electrical Eng. & Systems 2025-01-03 Jiayun Wang , Oleksii Ostras , Masashi Sode , Bahareh Tolooshams , Zongyi Li , Kamyar Azizzadenesheli , Gianmarco Pinton , Anima Anandkumar