English
Related papers

Related papers: Learning to segment with limited annotations: Self…

200 papers

Medical image segmentation of gadolinium enhancement magnetic resonance imaging (GE MRI) is an important task in clinical applications. However, manual annotation is time-consuming and requires specialized expertise. Semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Yunsung Chung , Chanho Lim , Chao Huang , Nassir Marrouche , Jihun Hamm

Self-supervised learning has emerged as a powerful way to pre-train generalizable machine learning models on large amounts of unlabeled data. It is particularly compelling in the music domain, where obtaining labeled data is time-consuming,…

Sound · Computer Science 2024-04-16 Gabriel Meseguer-Brocal , Dorian Desblancs , Romain Hennequin

Multi-label classification, which involves assigning multiple labels to a single input, has emerged as a key area in both research and industry due to its wide-ranging applications. Designing effective loss functions is crucial for…

Machine Learning · Computer Science 2025-01-06 Alexandre Audibert , Aurélien Gauffre , Massih-Reza Amini

There is an increasing number of medical use-cases where classification algorithms based on deep neural networks reach performance levels that are competitive with human medical experts. To alleviate the challenges of small dataset sizes,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Vignesh Srinivasan , Nils Strodthoff , Jackie Ma , Alexander Binder , Klaus-Robert Müller , Wojciech Samek

Current contrastive learning methods use random transformations sampled from a large list of transformations, with fixed hyperparameters, to learn invariance from an unannotated database. Following previous works that introduce a small…

Machine Learning · Computer Science 2023-08-21 Camille Ruppli , Pietro Gori , Roberto Ardon , Isabelle Bloch

The emergence of Large Language Models (LLMs) presents unprecedented opportunities to revolutionize medical contrastive vision-language pre-training. In this paper, we show how LLMs can facilitate large-scale supervised pre-training,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Yingtai Li , Haoran Lai , Xiaoqian Zhou , Shuai Ming , Wenxin Ma , Wei Wei , Shaohua Kevin Zhou

Supervised deep learning methods for segmentation require large amounts of labelled training data, without which they are prone to overfitting, not generalizing well to unseen images. In practice, obtaining a large number of annotations…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Krishna Chaitanya , Neerav Karani , Christian Baumgartner , Olivio Donati , Anton Becker , Ender Konukoglu

Purpose: Automating tasks such as lung tumor localization and segmentation in radiological images can free valuable time for radiologists and other clinical personnel. Convolutional neural networks may be suited for such tasks, but require…

Image and Video Processing · Electrical Eng. & Systems 2021-12-23 Vemund Fredriksen , Svein Ole M. Svele , André Pedersen , Thomas Langø , Gabriel Kiss , Frank Lindseth

This work presents a novel label-efficient selfsupervised representation learning-based approach for classifying diabetic retinopathy (DR) images in cross-domain settings. Most of the existing DR image classification methods are based on…

Image and Video Processing · Electrical Eng. & Systems 2023-04-25 Ekta Gupta , Varun Gupta , Muskaan Chopra , Prakash Chandra Chhipa , Marcus Liwicki

Scarcity of high quality annotated images remains a limiting factor for training accurate image segmentation models. While more and more annotated datasets become publicly available, the number of samples in each individual database is…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Gregory Filbrandt , Konstantinos Kamnitsas , David Bernstein , Alexandra Taylor , Ben Glocker

Deep learning has achieved unprecedented success in various object detection tasks with huge amounts of labeled data. However, obtaining large-scale annotations for medical images is extremely challenging due to the high demand of labour…

Image and Video Processing · Electrical Eng. & Systems 2022-03-21 Zhizhong Chai , Luyang Luo , Huangjing Lin , Hao Chen , Anjia Han , Pheng-Ann Heng

Pre-trained Large Language Models (LLMs) often struggle on out-of-domain datasets like healthcare focused text. We explore specialized pre-training to adapt smaller LLMs to different healthcare datasets. Three methods are assessed:…

Computation and Language · Computer Science 2024-04-01 Niall Taylor , Dan Schofield , Andrey Kormilitzin , Dan W Joyce , Alejo Nevado-Holgado

Self-supervised pretraining in remote sensing is mostly done using mid-spatial resolution (MR) image datasets due to their high availability. Given the release of high-resolution (HR) datasets, we ask how HR datasets can be included in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 John Waithaka , Gustave Bwirayesu , Moise Busogi

The need for labour intensive pixel-wise annotation is a major limitation of many fully supervised learning methods for segmenting bioimages that can contain numerous object instances with thin separations. In this paper, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Rihuan Ke , Aurélie Bugeau , Nicolas Papadakis , Peter Schuetz , Carola-Bibiane Schönlieb

With the increasing availability of data for Prognostics and Health Management (PHM), Deep Learning (DL) techniques are now the subject of considerable attention for this application, often achieving more accurate Remaining Useful Life…

Machine Learning · Statistics 2023-01-25 Anass Akrim , Christian Gogu , Rob Vingerhoeds , Michel Salaün

Self-supervised learning has emerged as a powerful tool for pretraining deep networks on unlabeled data, prior to transfer learning of target tasks with limited annotation. The relevance between the pretraining pretext and target tasks is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Tianwei Zhang , Dong Wei , Mengmeng Zhu , Shi Gu , Yefeng Zheng

Traditional supervised learning with deep neural networks requires a tremendous amount of labelled data to converge to a good solution. For 3D medical images, it is often impractical to build a large homogeneous annotated dataset for a…

A significant proportion of patients scanned in a clinical setting have follow-up scans. We show in this work that such longitudinal scans alone can be used as a form of 'free' self-supervision for training a deep network. We demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Amir Jamaludin , Timor Kadir , Andrew Zisserman

Estimating a depth map from a single RGB image has been investigated widely for localization, mapping, and 3-dimensional object detection. Recent studies on a single-view depth estimation are mostly based on deep Convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Dongseok Shim , H. Jin Kim

A common problem with segmentation of medical images using neural networks is the difficulty to obtain a significant number of pixel-level annotated data for training. To address this issue, we proposed a semi-supervised segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Ange Lou , Kareem Tawfik , Xing Yao , Ziteng Liu , Jack Noble