English
Related papers

Related papers: Self-Supervised Learning for Medical Image Data wi…

200 papers

The development of mobile and on the edge applications that embed deep convolutional neural models has the potential to revolutionise biomedicine. However, most deep learning models require computational resources that are not available in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Adrián Inés , Andrés Díaz-Pinto , César Domínguez , Jónathan Heras , Eloy Mata , Vico Pascual

We propose a novel semi-supervised image segmentation method that simultaneously optimizes a supervised segmentation and an unsupervised reconstruction objectives. The reconstruction objective uses an attention mechanism that separates the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Shuai Chen , Gerda Bortsova , Antonio Garcia-Uceda Juarez , Gijs van Tulder , Marleen de Bruijne

Compared to supervised deep learning, self-supervision provides remote sensing a tool to reduce the amount of exact, human-crafted geospatial annotations. While image-level information for unsupervised pretraining efficiently works for…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Chenying Liu , Conrad M Albrecht , Yi Wang , Xiao Xiang Zhu

Medical images are naturally associated with rich semantics about the human anatomy, reflected in an abundance of recurring anatomical patterns, offering unique potential to foster deep semantic representation learning and yield…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Fatemeh Haghighi , Mohammad Reza Hosseinzadeh Taher , Zongwei Zhou , Michael B. Gotway , Jianming Liang

Early cancer detection is crucial for prognosis, but many cancer types lack large labelled datasets required for developing deep learning models. This paper investigates self-supervised learning (SSL) as an alternative to the standard…

Image and Video Processing · Electrical Eng. & Systems 2024-11-27 Hamish Haggerty , Rohitash Chandra

Deep neural networks for aerial image segmentation require large amounts of labeled data, but high-quality aerial datasets with precise annotations are scarce and costly to produce. To address this limitation, we propose a self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Rupert Polley , Sai Vignesh Abishek Deenadayalan , J. Marius Zöllner

The ability of deep networks to learn superior representations hinges on leveraging the proper inductive biases, considering the inherent properties of datasets. In tabular domains, it is critical to effectively handle heterogeneous…

Machine Learning · Computer Science 2024-05-15 Kyungeun Lee , Ye Seul Sim , Hye-Seung Cho , Moonjung Eo , Suhee Yoon , Sanghyu Yoon , Woohyung Lim

In this work, we explore the potential of self-supervised learning with Generative Adversarial Networks (GANs) for electron microscopy datasets. We show how self-supervised pretraining facilitates efficient fine-tuning for a spectrum of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Bashir Kazimi , Karina Ruzaeva , Stefan Sandfeld

Unsupervised learning has made substantial progress over the last few years, especially by means of contrastive self-supervised learning. The dominating dataset for benchmarking self-supervised learning has been ImageNet, for which recent…

Image and Video Processing · Electrical Eng. & Systems 2022-08-17 Karin Stacke , Jonas Unger , Claes Lundström , Gabriel Eilertsen

To improve performance in visual feature representation from photos or videos for practical applications, we generally require large-scale human-annotated labeled data while training deep neural networks. However, the cost of gathering and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Zhenyuan Lu

Many current deep learning approaches make extensive use of backbone networks pre-trained on large datasets like ImageNet, which are then fine-tuned to perform a certain task. In remote sensing, the lack of comparable large annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Konrad Heidler , Lichao Mou , Di Hu , Pu Jin , Guangyao Li , Chuang Gan , Ji-Rong Wen , Xiao Xiang Zhu

The computational drug repositioning aims to discover new uses for marketed drugs, which can accelerate the drug development process and play an important role in the existing drug discovery system. However, the number of validated…

Machine Learning · Computer Science 2022-06-02 Xinxing Yang , Genke Yang , Jian Chu

Self-supervised learning of convolutional neural networks can harness large amounts of cheap unlabeled data to train powerful feature representations. As surrogate task, we jointly address ordering of visual data in the spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Uta Büchler , Biagio Brattoli , Björn Ommer

Supervised deep learning usually faces more challenges in medical images than in natural images. Since annotations in medical images require the expertise of doctors and are more time-consuming and expensive. Thus, some researchers turn to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Tao Yang , Lisheng Wang

Self-supervised learning has gained prominence due to its efficacy at learning powerful representations from unlabelled data that achieve excellent performance on many challenging downstream tasks. However supervision-free pre-text tasks…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Ayan Kumar Bhunia , Pinaki Nath Chowdhury , Yongxin Yang , Timothy M. Hospedales , Tao Xiang , Yi-Zhe Song

Recent work has proven that training large language models with self-supervised tasks and fine-tuning these models to complete new tasks in a transfer learning setting is a powerful idea, enabling the creation of models with many…

Machine Learning · Computer Science 2024-11-25 Matthew Spellings , Maya Martirossyan , Julia Dshemuchadse

The significant achievements of pre-trained models leveraging large volumes of data in the field of NLP and 2D vision inspire us to explore the potential of extensive data pre-training for 3D perception in autonomous driving. Toward this…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Shumin Wang , Zhuoran Yang , Lidian Wang , Zhipeng Tang , Heng Li , Lehan Pan , Sha Zhang , Jie Peng , Jianmin Ji , Yanyong Zhang

In multi-organ segmentation of abdominal CT scans, most existing fully supervised deep learning algorithms require lots of voxel-wise annotations, which are usually difficult, expensive, and slow to obtain. In comparison, massive unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Yuyin Zhou , Yan Wang , Peng Tang , Song Bai , Wei Shen , Elliot K. Fishman , Alan L. Yuille

Background and objective: Employing deep learning models in critical domains such as medical imaging poses challenges associated with the limited availability of training data. We present a strategy for improving the performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Eva Pachetti , Sotirios A. Tsaftaris , Sara Colantonio

Unsupervised image translation aims to learn the transformation from a source domain to another target domain given unpaired training data. Several state-of-the-art works have yielded impressive results in the GANs-based unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Taewon Kang , Kwang Hee Lee