English
Related papers

Related papers: Self-Supervised Modality-Agnostic Pre-Training of …

200 papers

The use of diverse modalities, such as omics, medical images, and clinical data can not only improve the performance of prognostic models but also deepen an understanding of disease mechanisms and facilitate the development of novel…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Maria Boyko , Aleksandra Beliaeva , Dmitriy Kornilov , Alexander Bernstein , Maxim Sharaev

Self-supervised pretraining has been observed to be effective at improving feature representations for transfer learning, leveraging large amounts of unlabelled data. This review summarizes recent research into its usage in X-ray, computed…

Machine Learning · Computer Science 2023-09-07 Blake VanBerlo , Jesse Hoey , Alexander Wong

Recent advances in deep learning have shown that learning robust feature representations is critical for the success of many computer vision tasks, including medical image segmentation. In particular, both transformer and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 David Li , Anvar Kurmukov , Mikhail Goncharov , Roman Sokolov , Mikhail Belyaev

Limited transferability hinders the performance of deep learning models when applied to new application scenarios. Recently, Unsupervised Domain Adaptation (UDA) has achieved significant progress in addressing this issue via learning…

Machine Learning · Computer Science 2023-09-27 Yulong Zhang , Shuhao Chen , Weisen Jiang , Yu Zhang , Jiangang Lu , James T. Kwok

In recent years, weakly supervised semantic segmentation using image-level labels as supervision has received significant attention in the field of computer vision. Most existing methods have addressed the challenges arising from the lack…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Rozhan Ahmadi , Shohreh Kasaei

Recent advances in Vision Transformers (ViTs) have significantly enhanced medical image segmentation by facilitating the learning of global relationships. However, these methods face a notable challenge in capturing diverse local and global…

Image and Video Processing · Electrical Eng. & Systems 2024-07-11 Szymon Płotka , Maciej Chrabaszcz , Przemyslaw Biecek

Current multimodal medical image fusion typically assumes that source images are of high quality and perfectly aligned at the pixel level. Its effectiveness heavily relies on these conditions and often deteriorates when handling misaligned…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Dayong Su , Yafei Zhang , Huafeng Li , Jinxing Li , Yu Liu

Hyperspectral images (HSIs) capture rich spectral signatures that reveal vital material properties, offering broad applicability across various domains. However, the scarcity of labeled HSI data limits the full potential of deep learning,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Shaheer Mohamed , Tharindu Fernando , Sridha Sridharan , Peyman Moghadam , Clinton Fookes

Unsupervised pre-training and transfer learning are commonly used techniques to initialize training algorithms for neural networks, particularly in settings with limited labeled data. In this paper, we study the effects of unsupervised…

Machine Learning · Statistics 2025-06-12 Taj Jones-McCormick , Aukosh Jagannath , Subhabrata Sen

Neural networks have become the standard technique for medical diagnostics, especially in cancer detection and classification. This work evaluates the performance of Vision Transformers architectures, including Swin Transformer and MaxViT,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Óscar A. Martín , Javier Sánchez

Both limited annotation and domain shift are prevalent challenges in medical image segmentation. Traditional semi-supervised segmentation and unsupervised domain adaptation methods address one of these issues separately. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Qinghe Ma , Jian Zhang , Lei Qi , Qian Yu , Yinghuan Shi , Yang Gao

Multimodal medical image fusion plays an instrumental role in several areas of medical image processing, particularly in disease recognition and tumor detection. Traditional fusion methods tend to process each modality independently before…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Lin Liu , Xinxin Fan , Chulong Zhang , Jingjing Dai , Yaoqin Xie , Xiaokun Liang

Semantic segmentation suffers from significant performance degradation when the trained network is applied to a different domain. To address this issue, unsupervised domain adaptation (UDA) has been extensively studied. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Wangkai Li , Rui Sun , Huayu Mai , Tianzhu Zhang

Medical image segmentation is a crucial task in the field of medical image analysis. Harmonizing the convolution and multi-head self-attention mechanism is a recent research focus in this field, with various combination methods proposed.…

Image and Video Processing · Electrical Eng. & Systems 2023-09-28 Lichao Wang , Jiahao Huang , Xiaodan Xing , Guang Yang

Multimodal fusion leverages information across modalities to learn better feature representations with the goal of improving performance in fusion-based tasks. However, multimodal datasets, especially in medical settings, are typically…

Machine Learning · Computer Science 2025-02-05 Alejandro Guerra-Manzanares , Farah E. Shamout

Sparse vision transformers have gained popularity as efficient encoders for medical volumetric segmentation, with Swin emerging as a prominent choice. Swin uses local attention to reduce complexity and yields excellent performance for many…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 David Hagerman , Roman Naeem , Jakob Lindqvist , Carl Lindström , Fredrik Kahl , Lennart Svensson

Many problems in science and engineering require making predictions based on few observations. To build a robust predictive model, these sparse data may need to be augmented with simulated data, especially when the design space is…

Classification of gigapixel Whole Slide Images (WSIs) is an important prediction task in the emerging area of computational pathology. There has been a surge of research in deep learning models for WSI classification with clinical…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Sajid Javed , Arif Mahmood , Talha Qaiser , Naoufel Werghi , Nasir Rajpoot

Accurate segmentation is a crucial step in medical image analysis and applying supervised machine learning to segment the organs or lesions has been substantiated effective. However, it is costly to perform data annotation that provides…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Yunxiang Li , Jingxiong Li , Ruilong Dan , Shuai Wang , Kai Jin , Guodong Zeng , Jun Wang , Xiangji Pan , Qianni Zhang , Huiyu Zhou , Qun Jin , Li Wang , Yaqi Wang

Generalizing learned representations across significantly different visual domains is a fundamental yet crucial ability of the human visual system. While recent self-supervised learning methods have achieved good performances with…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Haiyang Yang , Meilin Chen , Yizhou Wang , Shixiang Tang , Feng Zhu , Lei Bai , Rui Zhao , Wanli Ouyang