English
Related papers

Related papers: Revisiting Rubik's Cube: Self-supervised Learning …

200 papers

The resurgence of self-supervised learning, whereby a deep learning model generates its own supervisory signal from the data, promises a scalable way to tackle the dramatically increasing size of real-world data sets without human…

Quantum Physics · Physics 2022-04-05 Ben Jaderberg , Lewis W. Anderson , Weidi Xie , Samuel Albanie , Martin Kiffner , Dieter Jaksch

Resective surgery may be curative for drug-resistant focal epilepsy, but only 40% to 70% of patients achieve seizure freedom after surgery. Retrospective quantitative analysis could elucidate patterns in resected structures and patient…

Image and Video Processing · Electrical Eng. & Systems 2020-10-07 Fernando Pérez-García , Roman Rodionov , Ali Alim-Marvasti , Rachel Sparks , John S. Duncan , Sébastien Ourselin

Recent work has proven that training large language models with self-supervised tasks and fine-tuning these models to complete new tasks in a transfer learning setting is a powerful idea, enabling the creation of models with many…

Machine Learning · Computer Science 2024-11-25 Matthew Spellings , Maya Martirossyan , Julia Dshemuchadse

One of the largest problems in medical image processing is the lack of annotated data. Labeling medical images often requires highly trained experts and can be a time-consuming process. In this paper, we evaluate a method of reducing the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Marin Benčević , Marija Habijan , Irena Galić , Aleksandra Pizurica

The success of deep learning methods in medical image segmentation tasks usually requires a large amount of labeled data. However, obtaining reliable annotations is expensive and time-consuming. Semi-supervised learning has attracted much…

Image and Video Processing · Electrical Eng. & Systems 2021-07-13 Yichi Zhang , Jicong Zhang

State-of-the-art machine learning models, and especially deep learning ones, are significantly data-hungry; they require vast amounts of manually labeled samples to function correctly. However, in most medical imaging fields, obtaining said…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Guillem Pascual , Pablo Laiz , Albert García , Hagen Wenzek , Jordi Vitrià , Santi Seguí

Skull stripping is usually the first step for most brain analysisprocess in magnetic resonance images. A lot of deep learn-ing neural network based methods have been developed toachieve higher accuracy. Since the 3D deep learning…

Image and Video Processing · Electrical Eng. & Systems 2019-10-25 Zhen Liu , Borui Xiao , Yuemeng Li , Yong Fan

Traditional supervised medical image segmentation models require large amounts of labeled data for training; however, obtaining such large-scale labeled datasets in the real world is extremely challenging. Recent semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Yunyao Lu , Yihang Wu , Reem Kateb , Ahmad Chaddad

Current 3D semi-supervised segmentation methods face significant challenges such as limited consideration of contextual information and the inability to generate reliable pseudo-labels for effective unsupervised data use. To address these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Sanaz Karimijafarbigloo , Reza Azad , Yury Velichko , Ulas Bagci , Dorit Merhof

In the field of medical images, although various works find Swin Transformer has promising effectiveness on pixelwise dense prediction, whether pre-training these models without using extra dataset can further boost the performance for the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Xinrong Hu , Dewen Zeng , Yawen Wu , Xueyang Li , Yiyu Shi

Cross-modal retrieval methods have been significantly improved in last years with the use of deep neural networks and large-scale annotated datasets such as ImageNet and Places. However, collecting and annotating such datasets requires a…

Computer Vision and Pattern Recognition · Computer Science 2019-02-04 Yash Patel , Lluis Gomez , Marçal Rusiñol , Dimosthenis Karatzas , C. V. Jawahar

This paper presents a new regularization method to train a fully convolutional network for semantic tissue segmentation in histopathological images. This method relies on the benefit of unsupervised learning, in the form of image…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 C. T. Sari , C. Sokmensuer , C. Gunduz-Demir

Surgical data science is a new research field that aims to observe all aspects of the patient treatment process in order to provide the right assistance at the right time. Due to the breakthrough successes of deep learning-based solutions…

This paper presents a novel unsupervised segmentation method for 3D medical images. Convolutional neural networks (CNNs) have brought significant advances in image segmentation. However, most of the recent methods rely on supervised…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Takayasu Moriya , Holger R. Roth , Shota Nakamura , Hirohisa Oda , Kai Nagara , Masahiro Oda , Kensaku Mori

Reducing the quantity of annotations required for supervised training is vital when labels are scarce and costly. This reduction is especially important for semantic segmentation tasks involving 3D datasets that are often significantly…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Andrej Janda , Brandon Wagstaff , Edwin G. Ng , Jonathan Kelly

Hybrid volumetric medical image segmentation models, combining the advantages of local convolution and global attention, have recently received considerable attention. While mainly focusing on architectural modifications, most existing…

Image and Video Processing · Electrical Eng. & Systems 2024-04-04 Shahina Kunhimon , Abdelrahman Shaker , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan

Self-supervised learning is a powerful way to learn useful representations from natural data. It has also been suggested as one possible means of building visual representation in humans, but the specific objective and algorithm are…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Binxu Wang , David Mayo , Arturo Deza , Andrei Barbu , Colin Conwell

This paper presents a novel framework for processing volumetric medical information using Visual Transformers (ViTs). First, We extend the state-of-the-art Swin Transformer model to the 3D medical domain. Second, we propose a new approach…

Image and Video Processing · Electrical Eng. & Systems 2024-06-06 Cristhian Forigua , Maria Escobar , Pablo Arbelaez

Deep convolutional neural networks have driven substantial advancements in the automatic understanding of images. Requiring a large collection of images and their associated annotations is one of the main bottlenecks limiting the adoption…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 Zahra Mirikharaji , Yiqi Yan , Ghassan Hamarneh

With the advances of deep learning, many medical image segmentation studies achieve human-level performance when in fully supervised condition. However, it is extremely expensive to acquire annotation on every data in medical fields,…

Image and Video Processing · Electrical Eng. & Systems 2021-10-29 Hyungseob Shin , Hyeongyu Kim , Sewon Kim , Yohan Jun , Taejoon Eo , Dosik Hwang