English
Related papers

Related papers: Choice of training label matters: how to best use …

200 papers

Unsupervised learning has recently significantly gained in popularity, especially with deep learning-based approaches. Despite numerous successes and approaching supervised-level performance on a variety of academic benchmarks, it is still…

Machine Learning · Computer Science 2023-07-19 Anton Tsitsulin , Marina Munkhoeva , Bryan Perozzi

Data labeling in supervised learning is considered an expensive and infeasible tool in some conditions. The self-supervised learning method is proposed to tackle the learning effectiveness with fewer labeled data, however, there is a lack…

Machine Learning · Computer Science 2021-08-18 Hilal AlQuabeh , Ameera Bawazeer , Abdulateef Alhashmi

Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance. However, the process of collecting and labeling such data can be expensive and time-consuming. Self-supervised…

Machine Learning · Computer Science 2024-07-16 Jie Gui , Tuo Chen , Jing Zhang , Qiong Cao , Zhenan Sun , Hao Luo , Dacheng Tao

Effective convolutional neural networks are trained on large sets of labeled data. However, creating large labeled datasets is a very costly and time-consuming task. Semi-supervised learning uses unlabeled data to train a model with higher…

Computer Vision and Pattern Recognition · Computer Science 2016-06-16 Mehdi Sajjadi , Mehran Javanmardi , Tolga Tasdizen

Self-training (ST) is a simple yet effective semi-supervised learning method. However, why and how ST improves generalization performance by using potentially erroneous pseudo-labels is still not well understood. To deepen the understanding…

Machine Learning · Statistics 2024-05-08 Takashi Takahashi

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino

In semi-supervised learning, the paradigm of self-training refers to the idea of learning from pseudo-labels suggested by the learner itself. Across various domains, corresponding methods have proven effective and achieve state-of-the-art…

Machine Learning · Statistics 2023-06-12 Julian Lienen , Caglar Demir , Eyke Hüllermeier

Deep learning architectures have achieved promising results in different areas (e.g., medicine, agriculture, and security). However, using those powerful techniques in many real applications becomes challenging due to the large labeled…

Machine Learning · Computer Science 2022-08-30 Luiz H. Buris , Daniel C. G. Pedronette , Joao P. Papa , Jurandy Almeida , Gustavo Carneiro , Fabio A. Faria

One paradigm for learning from few labeled examples while making best use of a large amount of unlabeled data is unsupervised pretraining followed by supervised fine-tuning. Although this paradigm uses unlabeled data in a task-agnostic way,…

Machine Learning · Computer Science 2020-10-27 Ting Chen , Simon Kornblith , Kevin Swersky , Mohammad Norouzi , Geoffrey Hinton

In recent years, deep learning (DL) has emerged as a promising alternative approach for various seismic processing tasks, including primary estimation (or multiple elimination), a crucial step for accurate subsurface imaging. In geophysics,…

Geophysics · Physics 2025-02-11 Jing Sun , Tiexing Wang , Eric Verschuur , Ivan Vasconcelos

Physics-guided deep learning (PG-DL) via algorithm unrolling has received significant interest for improved image reconstruction, including MRI applications. These methods unroll an iterative optimization algorithm into a series of…

Image and Video Processing · Electrical Eng. & Systems 2021-05-17 Burhaneddin Yaman , Seyed Amir Hossein Hosseini , Steen Moeller , Mehmet Akçakaya

Background and objective: Employing deep learning models in critical domains such as medical imaging poses challenges associated with the limited availability of training data. We present a strategy for improving the performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Eva Pachetti , Sotirios A. Tsaftaris , Sara Colantonio

Self-training algorithms, which train a model to fit pseudolabels predicted by another previously-learned model, have been very successful for learning with unlabeled data using neural networks. However, the current theoretical…

Machine Learning · Computer Science 2022-04-22 Colin Wei , Kendrick Shen , Yining Chen , Tengyu Ma

Self-Supervised Learning (SSL) is a valuable and robust training methodology for contemporary Deep Neural Networks (DNNs), enabling unsupervised pretraining on a 'pretext task' that does not require ground-truth labels/annotation. This…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sotirios Konstantakos , Jorgen Cani , Ioannis Mademlis , Despina Ioanna Chalkiadaki , Yuki M. Asano , Efstratios Gavves , Georgios Th. Papadopoulos

Noisy labels can significantly impact medical image classification, particularly in deep learning, by corrupting learned features. Self-supervised pretraining, which doesn't rely on labeled data, can enhance robustness against noisy labels.…

Image and Video Processing · Electrical Eng. & Systems 2024-01-17 Bidur Khanal , Binod Bhattarai , Bishesh Khanal , Cristian Linte

In recent years, semi-supervised learning (SSL) has shown tremendous success in leveraging unlabeled data to improve the performance of deep learning models, which significantly reduces the demand for large amounts of labeled data. Many SSL…

Machine Learning · Computer Science 2020-06-02 Song-Bo Yang , Tian-li Yu

While success of Deep Learning (DL) in automated diagnosis can be transformative to the medicinal practice especially for people with little or no access to doctors, its widespread acceptability is severely limited by inherent black-box…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Mehak Aggarwal , Nishanth Arun , Sharut Gupta , Ashwin Vaswani , Bryan Chen , Matthew Li , Ken Chang , Jay Patel , Katherine Hoebel , Mishka Gidwani , Jayashree Kalpathy-Cramer , Praveer Singh

Semisupervised learning is a learning standard which deals with the study of how computers and natural systems such as human beings acquire knowledge in the presence of both labeled and unlabeled data. Semisupervised learning based methods…

Machine Learning · Computer Science 2014-02-20 V. Jothi Prakash , Dr. L. M. Nithya

In many real-world scenarios, labeled data for a specific machine learning task is costly to obtain. Semi-supervised training methods make use of abundantly available unlabeled data and a smaller number of labeled examples. We propose a new…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Philip Häusser , Alexander Mordvintsev , Daniel Cremers

Deep metric learning (DML) is a cornerstone of many computer vision applications. It aims at learning a mapping from the input domain to an embedding space, where semantically similar objects are located nearby and dissimilar objects far…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Artsiom Sanakoyeu , Pingchuan Ma , Vadim Tschernezki , Björn Ommer