English
Related papers

Related papers: Multitask Multimodal Self-Supervised Learning for …

200 papers

We propose a selective learning method using meta-learning and deep reinforcement learning for medical image interpretation in the setting of limited labeling resources. Our method, MedSelect, consists of a trainable deep learning selector…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Akshay Smit , Damir Vrabac , Yujie He , Andrew Y. Ng , Andrew L. Beam , Pranav Rajpurkar

Accurate classification of medical device risk levels is essential for regulatory oversight and clinical safety. We present a Transformer-based multimodal framework that integrates textual descriptions and visual information to predict…

Machine Learning · Computer Science 2025-05-02 Yu Han , Aaron Ceross , Jeroen H. M. Bergmann

Recently, deep-learning-based approaches have been widely studied for deformable image registration task. However, most efforts directly map the composite image representation to spatial transformation through the convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Jiashun Chen , Donghuan Lu , Yu Zhang , Dong Wei , Munan Ning , Xinyu Shi , Zhe Xu , Yefeng Zheng

Despite the remarkable performance of deep learning methods on various tasks, most cutting-edge models rely heavily on large-scale annotated training examples, which are often unavailable for clinical and health care tasks. The labeling…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Jialin Peng , Ye Wang

Recent neuroimaging studies that focus on predicting brain disorders via modern machine learning approaches commonly include a single modality and rely on supervised over-parameterized models.However, a single modality provides only a…

The performance of supervised deep learning methods for medical image segmentation is often limited by the scarcity of labeled data. As a promising research direction, semi-supervised learning addresses this dilemma by leveraging unlabeled…

Image and Video Processing · Electrical Eng. & Systems 2024-05-13 Zihang Liu , Chunhui Zhao

Deep learning models trained on medical images from a source domain (e.g. imaging modality) often fail when deployed on images from a different target domain, despite imaging common anatomical structures. Deep unsupervised domain adaptation…

Image and Video Processing · Electrical Eng. & Systems 2019-08-14 Cheng Ouyang , Konstantinos Kamnitsas , Carlo Biffi , Jinming Duan , Daniel Rueckert

Medical image segmentation is a fundamental and critical step in many clinical approaches. Semi-supervised learning has been widely applied to medical image segmentation tasks since it alleviates the heavy burden of acquiring…

Image and Video Processing · Electrical Eng. & Systems 2022-08-29 Yichi Zhang , Rushi Jiao , Qingcheng Liao , Dongyang Li , Jicong Zhang

Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it combines information from various imaging modalities to provide a more comprehensive understanding of the underlying pathology. Recently, deep…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yihao Li , Mostafa El Habib Daho , Pierre-Henri Conze , Rachid Zeghlache , Hugo Le Boité , Ramin Tadayoni , Béatrice Cochener , Mathieu Lamard , Gwenolé Quellec

Recent approaches in literature have exploited the multi-modal information in documents (text, layout, image) to serve specific downstream document tasks. However, they are limited by their - (i) inability to learn cross-modal…

Computation and Language · Computer Science 2022-01-06 Subhojeet Pramanik , Shashank Mujumdar , Hima Patel

Healthcare applications are inherently multimodal, benefiting greatly from the integration of diverse data sources. However, the modalities available in clinical settings can vary across different locations and patients. A key area that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Mohammed Amer , Mohamed A. Suliman , Tu Bui , Nuria Garcia , Serban Georgescu

Deep learning has significantly advanced medical imaging analysis (MIA), achieving state-of-the-art performance across diverse clinical tasks. However, its success largely depends on large-scale, high-quality labeled datasets, which are…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Cheng Jin , Zhengrui Guo , Yi Lin , Luyang Luo , Hao Chen

Recent advances in deep learning have shown that learning robust feature representations is critical for the success of many computer vision tasks, including medical image segmentation. In particular, both transformer and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 David Li , Anvar Kurmukov , Mikhail Goncharov , Roman Sokolov , Mikhail Belyaev

Algorithmic image-based diagnosis and prognosis of neurodegenerative diseases on longitudinal data has drawn great interest from computer vision researchers. The current state-of-the-art models for many image classification tasks are based…

Computer Vision and Pattern Recognition · Computer Science 2017-09-04 Jie Zhang , Qingyang Li , Richard J. Caselli , Jieping Ye , Yalin Wang

Self-supervised learning (SSL) has emerged as a promising paradigm in medical imaging, addressing the chronic challenge of limited labeled data in healthcare settings. While SSL has shown impressive results, existing studies in the medical…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Valay Bundele , Karahan Sarıtaş , Bora Kargi , Oğuz Ata Çal , Kıvanç Tezören , Zohreh Ghaderi , Hendrik Lensch

The scarcity of annotated medical images is a major bottleneck in developing learning models for medical image analysis. Hence, recent studies have focused on pretrained models with fewer annotation requirements that can be fine-tuned for…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Jonghun Kim , Mansu Kim , Hyunjin Park

Semi-supervised learning has demonstrated great potential in medical image segmentation by utilizing knowledge from unlabeled data. However, most existing approaches do not explicitly capture high-level semantic relations between distant…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Qianying Liu , Xiao Gu , Paul Henderson , Fani Deligianni

In medical imaging, most of the image registration methods implicitly assume a one-to-one correspondence between the source and target images (i.e., diffeomorphism). However, this is not necessarily the case when dealing with pathological…

Image and Video Processing · Electrical Eng. & Systems 2022-02-03 Matthis Maillard , Anton François , Joan Glaunès , Isabelle Bloch , Pietro Gori

Segmentation is a crucial analysis task in biomedical imaging. Given the diverse experimental settings in this field, the lack of generalization limits the use of deep learning in practice. Domain adaptation is a promising remedy: it…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Anwai Archit , Constantin Pape

Multi-modal learning integrating medical images and tabular data has significantly advanced clinical decision-making in recent years. Self-Supervised Learning (SSL) has emerged as a powerful paradigm for pretraining these models on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Yibing Fu , Yunpeng Zhao , Zhitao Zeng , Cheng Chen , Yueming Jin