English
Related papers

Related papers: How does self-supervised pretraining improve robus…

200 papers

Deep neural networks have shown impressive performance in supervised learning, enabled by their ability to fit well to the provided training data. However, their performance is largely dependent on the quality of the training data and often…

Machine Learning · Computer Science 2021-11-11 Abhishek Kumar , Ehsan Amid

Current state-of-the-art deep learning systems for visual object recognition and detection use purely supervised training with regularization such as dropout to avoid overfitting. The performance depends critically on the amount of labeled…

Computer Vision and Pattern Recognition · Computer Science 2015-04-16 Scott Reed , Honglak Lee , Dragomir Anguelov , Christian Szegedy , Dumitru Erhan , Andrew Rabinovich

Unsupervised image clustering methods often introduce alternative objectives to indirectly train the model and are subject to faulty predictions and overconfident results. To overcome these challenges, the current research proposes an…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sungwon Park , Sungwon Han , Sundong Kim , Danu Kim , Sungkyu Park , Seunghoon Hong , Meeyoung Cha

Self-supervised pretraining has been observed to be effective at improving feature representations for transfer learning, leveraging large amounts of unlabelled data. This review summarizes recent research into its usage in X-ray, computed…

Machine Learning · Computer Science 2023-09-07 Blake VanBerlo , Jesse Hoey , Alexander Wong

With the proliferation of algorithmic decision-making, increased scrutiny has been placed on these systems. This paper explores the relationship between the quality of the training data and the overall fairness of the models trained with…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Aki Barry , Lei Han , Gianluca Demartini

Label-noise learning (LNL) aims to increase the model's generalization given training data with noisy labels. To facilitate practical LNL algorithms, researchers have proposed different label noise types, ranging from class-conditional to…

Machine Learning · Computer Science 2024-02-13 Jingfeng Zhang , Bo Song , Haohan Wang , Bo Han , Tongliang Liu , Lei Liu , Masashi Sugiyama

Learning with Noisy Labels (LNL) has attracted significant attention from the research community. Many recent LNL methods rely on the assumption that clean samples tend to have "small loss". However, this assumption always fails to…

Machine Learning · Computer Science 2022-11-17 MingCai Chen , Yu Zhao , Bing He , Zongbo Han , Bingzhe Wu , Jianhua Yao

Deep neural networks have been shown to be very powerful methods for many supervised learning tasks. However, they can also easily overfit to training set biases, i.e., label noise and class imbalance. While both learning with noisy labels…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Tong Wei , Jiang-Xin Shi , Yu-Feng Li , Min-Ling Zhang

Is self-supervised deep learning (DL) for medical image analysis already a serious alternative to the de facto standard of end-to-end trained supervised DL? We tackle this question for medical image classification, with a particular focus…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Maximilian Nielsen , Laura Wenderoth , Thilo Sentker , René Werner

Deep neural networks trained on large supervised datasets have led to impressive results in image classification and other tasks. However, well-annotated datasets can be time-consuming and expensive to collect, lending increased interest to…

Machine Learning · Computer Science 2018-02-27 David Rolnick , Andreas Veit , Serge Belongie , Nir Shavit

Recent advances in deep learning algorithms have led to significant benefits for solving many medical image analysis problems. Training deep learning models commonly requires large datasets with expert-labeled annotations. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Banafshe Felfeliyan , Abhilash Hareendranathan , Gregor Kuntze , Stephanie Wichuk , Nils D. Forkert , Jacob L. Jaremko , Janet L. Ronsky

In this work, we used a semi-supervised learning method to train deep learning model that can segment the brain MRI images. The semi-supervised model uses less labeled data, and the performance is competitive with the supervised model with…

Image and Video Processing · Electrical Eng. & Systems 2022-12-07 Hedong Zhang , Anand A. Joshi

Severity level estimation is a crucial task in medical image diagnosis. However, accurately assigning severity class labels to individual images is very costly and challenging. Consequently, the attached labels tend to be noisy. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Shumpei Takezaki , Kiyohito Tanaka , Seiichi Uchida

Detecting clouds and snow in remote sensing images is an essential preprocessing task for remote sensing imagery. Previous works draw inspiration from semantic segmentation models in computer vision, with most research focusing on improving…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Zili Liu , Hao Chen , Wenyuan Li , Keyan Chen , Zipeng Qi , Chenyang Liu , Zhengxia Zou , Zhenwei Shi

Leveraging weak or noisy supervision for building effective machine learning models has long been an important research problem. Its importance has further increased recently due to the growing need for large-scale datasets to train deep…

Machine Learning · Computer Science 2021-08-09 Guoqing Zheng , Ahmed Hassan Awadallah , Susan Dumais

Learning from noisy labels is a critical challenge in machine learning, with vast implications for numerous real-world scenarios. While supervised contrastive learning has recently emerged as a powerful tool for navigating label noise, many…

Machine Learning · Computer Science 2025-01-03 Jingyi Cui , Yi-Ge Zhang , Hengyu Liu , Yisen Wang

Labels are costly and sometimes unreliable. Noisy label learning, semi-supervised learning, and contrastive learning are three different strategies for designing learning processes requiring less annotation cost. Semi-supervised learning…

Machine Learning · Computer Science 2021-11-24 Xin Zhang , Zixuan Liu , Kaiwen Xiao , Tian Shen , Junzhou Huang , Wei Yang , Dimitris Samaras , Xiao Han

The success of current deep saliency detection methods heavily depends on the availability of large-scale supervision in the form of per-pixel labeling. Such supervision, while labor-intensive and not always possible, tends to hinder the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Jing Zhang , Tong Zhang , Yuchao Dai , Mehrtash Harandi , Richard Hartley

Deep Learning systems have shown tremendous accuracy in image classification, at the cost of big image datasets. Collecting such amounts of data can lead to labelling errors in the training set. Indexing multimedia content for retrieval,…

Machine Learning · Computer Science 2024-09-13 Guillaume Sanchez , Vincente Guis , Ricard Marxer , Frédéric Bouchara

Recently, over-parameterized deep networks, with increasingly more network parameters than training samples, have dominated the performances of modern machine learning. However, when the training data is corrupted, it has been well-known…

Machine Learning · Computer Science 2022-08-04 Sheng Liu , Zhihui Zhu , Qing Qu , Chong You