English
Related papers

Related papers: ivadomed: A Medical Imaging Deep Learning Toolbox

200 papers

Transport-Based Morphometry (TBM) has emerged as a new framework for 3D medical image analysis. By embedding images into a transport domain via invertible transformations, TBM facilitates effective classification, regression, and other…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Hongyu Kan , Kristofor Pas , Ivan Medri , Naqib Sad Pathan , Natasha Ironside , Shinjini Kundu , Jingjia He , Gustavo Kunde Rohde

mmid (Multi-Modal Integration and Downstream analyses for healthcare analytics) is a Python package that offers multi-modal fusion and imputation, classification, time-to-event prediction and clustering functionalities under a single…

AtomAI is an open-source software package bridging instrument-specific Python libraries, deep learning, and simulation tools into a single ecosystem. AtomAI allows direct applications of the deep convolutional neural networks for atomic and…

Data Analysis, Statistics and Probability · Physics 2022-12-29 Maxim Ziatdinov , Ayana Ghosh , Tommy Wong , Sergei V. Kalinin

The fine-tuning of large vision-language foundation models remains an underexplored area, particularly regarding its impact on learning gains and catastrophic forgetting. Inspired by the significance of modality gaps in contrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Laura Niss , Kevin Vogt-Lowell , Theodoros Tsiligkaridis

Clinicians usually combine information from multiple sources to achieve the most accurate diagnosis, and this has sparked increasing interest in leveraging multimodal deep learning for diagnosis. However, in real clinical scenarios, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Kai Han , Chongwen Lyu , Lele Ma , Chengxuan Qian , Siqi Ma , Zheng Pang , Jun Chen , Zhe Liu

Single-image depth estimation is essential for endoscopy tasks such as localization, reconstruction, and augmented reality. Most existing methods in surgical scenes focus on in-domain depth estimation, limiting their real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Qingyao Tian , Zhen Chen , Huai Liao , Xinyan Huang , Lujie Li , Sebastien Ourselin , Hongbin Liu

Medical image segmentation allows quantifying target structure size and shape, aiding in disease diagnosis, prognosis, surgery planning, and comprehension.Building upon recent advancements in foundation Vision-Language Models (VLMs) from…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Kanchan Poudel , Manish Dhakal , Prasiddha Bhandari , Rabin Adhikari , Safal Thapaliya , Bishesh Khanal

Medical image analysis frequently encounters data scarcity challenges. Transfer learning has been effective in addressing this issue while conserving computational resources. The recent advent of foundational models like the DINOv2, which…

Image and Video Processing · Electrical Eng. & Systems 2024-02-14 Yuning Huang , Jingchen Zou , Lanxi Meng , Xin Yue , Qing Zhao , Jianqiang Li , Changwei Song , Gabriel Jimenez , Shaowu Li , Guanghui Fu

This paper addresses the task of semantic segmentation of orthoimagery using multimodal data e.g. optical RGB, infrared and digital surface model. We propose a deep convolutional neural network architecture termed OrthoSeg for semantic…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Pankaj Bodani , Kumar Shreshtha , Shashikant Sharma

Medicine is inherently multimodal and multitask, with diverse data modalities spanning text, imaging. However, most models in medical field are unimodal single tasks and lack good generalizability and explainability. In this study, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Lijian Xu , Hao Sun , Ziyu Ni , Hongsheng Li , Shaoting Zhang

Medical image segmentation, the task of partitioning an image into meaningful parts, is an important step toward automating medical image analysis and is at the crux of a variety of medical imaging applications, such as computer aided…

Computer Vision and Pattern Recognition · Computer Science 2016-07-06 Masoud S. Nosrati , Ghassan Hamarneh

Medical image classification plays a crucial role in computer-aided clinical diagnosis. While deep learning techniques have significantly enhanced efficiency and reduced costs, the privacy-sensitive nature of medical imaging data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Sufen Ren , Yule Hu , Shengchao Chen , Guanjun Wang

Computer-Aided Diagnosis and Treatment of Tumors is a hot topic of deep learning in recent years, which constitutes a series of medical tasks, such as detection of tumor markers, the outline of tumor leisures, subtypes and stages of tumors,…

Image and Video Processing · Electrical Eng. & Systems 2020-11-03 Dan Zhao , Guizhi Xu , Zhenghua XU , Thomas Lukasiewicz , Minmin Xue , Zhigang Fu

Recent advancements in multimodal foundation models have showcased impressive capabilities in understanding and reasoning with visual and textual information. Adapting these foundation models trained for general usage to specialized domains…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Hejie Cui , Lingjun Mao , Xin Liang , Jieyu Zhang , Hui Ren , Quanzheng Li , Xiang Li , Carl Yang

Visual impairment represents a major global health challenge, with multimodal imaging providing complementary information that is essential for accurate ophthalmic diagnosis. This comprehensive survey systematically reviews the latest…

Image and Video Processing · Electrical Eng. & Systems 2025-08-07 Xiaoling Luo , Ruli Zheng , Qiaojian Zheng , Zibo Du , Shuo Yang , Meidan Ding , Qihao Xu , Chengliang Liu , Linlin Shen

Currently, medical vision language models are widely used in medical vision question answering tasks. However, existing models are confronted with two issues: for input, the model only relies on text instructions and lacks direct…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yanyuan Chen , Dexuan Xu , Yu Huang , Songkun Zhan , Hanpin Wang , Dongxue Chen , Xueping Wang , Meikang Qiu , Hang Li

Fueled by recent advances in machine learning, there has been tremendous progress in the field of semantic segmentation for the medical image computing community. However, developed algorithms are often optimized and validated by hand based…

Image and Video Processing · Electrical Eng. & Systems 2020-05-21 Oliver Rippel , Leon Weninger , Dorit Merhof

Accurate skin disease classification is a critical yet challenging task due to high inter-class similarity, intra-class variability, and complex lesion textures. While deep learning-based computer-aided diagnosis (CAD) systems have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Enam Ahmed Taufik , Abdullah Khondoker , Antara Firoz Parsa , Seraj Al Mahmud Mostafa

Melanoma detection is vital for early diagnosis and effective treatment. While deep learning models on dermoscopic images have shown promise, they require specialized equipment, limiting their use in broader clinical settings. This study…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Volodymyr Sydorskyi , Igor Krashenyi , Oleksii Yakubenko

We propose a deep clustering architecture alongside image segmentation for medical image analysis. The main idea is based on unsupervised learning to cluster images on severity of the disease in the subject's sample, and this image is then…

Image and Video Processing · Electrical Eng. & Systems 2020-05-28 Sharmin Pathan , Anant Tripathi