English
Related papers

Related papers: Uncertainty-aware Self-supervised Learning for Cro…

200 papers

Recently, Semi-Supervised Learning (SSL) has shown much promise in leveraging unlabeled data while being provided with very few labels. In this paper, we show that ignoring the labels altogether for whole epochs intermittently during…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Boaz Lerner , Guy Shiran , Daphna Weinshall

Automating the monitoring of industrial processes has the potential to enhance efficiency and optimize quality by promptly detecting abnormal events and thus facilitating timely interventions. Deep learning, with its capacity to discern…

We propose a semi-supervised text classifier based on self-training using one positive and one negative property of neural networks. One of the weaknesses of self-training is the semantic drift problem, where noisy pseudo-labels accumulate…

Computation and Language · Computer Science 2024-01-02 Payam Karisani

Unsupervised pre-training was a critical technique for training deep neural networks years ago. With sufficient labeled data and modern training techniques, it is possible to train very deep neural networks from scratch in a purely…

Computer Vision and Pattern Recognition · Computer Science 2017-03-29 Jianfeng Dong , Xiao-Jiao Mao , Chunhua Shen , Yu-Bin Yang

Robot-assisted catheterization has garnered a good attention for its potentials in treating cardiovascular diseases. However, advancing surgeon-robot collaboration still requires further research, particularly on task-specific automation.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Olatunji Mumini Omisore , Toluwanimi Akinyemi , Anh Nguyen , Lei Wang

Current reinforcement learning (RL) in robotics often experiences difficulty in generalizing to new downstream tasks due to the innate task-specific training paradigm. To alleviate it, unsupervised RL, a framework that pre-trains the agent…

Robotics · Computer Science 2022-10-13 Daesol Cho , Jigang Kim , H. Jin Kim

We consider the problem of unsupervised domain adaptation for image classification. To learn target-domain-aware features from the unlabeled data, we create a self-supervised pretext task by augmenting the unlabeled data with a certain type…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 L. Xiao , J. Xu , D. Zhao , Z. Wang , L. Wang , Y. Nie , B. Dai

In multi-task learning, a learner is given a collection of prediction tasks and needs to solve all of them. In contrast to previous work, which required that annotated training data is available for all tasks, we consider a new setting, in…

Machine Learning · Statistics 2017-06-09 Anastasia Pentina , Christoph H. Lampert

Semi-supervised learning (SSL) is a class of supervised learning tasks and techniques that also exploits the unlabeled data for training. SSL significantly reduces labeling related costs and is able to handle large data sets. The primary…

Machine Learning · Computer Science 2016-06-30 Eftychios Protopapadakis

Many successful methods developed for medical image analysis that are based on machine learning use supervised learning approaches, which often require large datasets annotated by experts to achieve high accuracy. However, medical data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Banafshe Felfeliyan , Abhilash Hareendranathan , Gregor Kuntze , David Cornell , Nils D. Forkert , Jacob L. Jaremko , Janet L. Ronsky

The performance of supervised deep learning methods for medical image segmentation is often limited by the scarcity of labeled data. As a promising research direction, semi-supervised learning addresses this dilemma by leveraging unlabeled…

Image and Video Processing · Electrical Eng. & Systems 2024-05-13 Zihang Liu , Chunhui Zhao

Self-training algorithms, which train a model to fit pseudolabels predicted by another previously-learned model, have been very successful for learning with unlabeled data using neural networks. However, the current theoretical…

Machine Learning · Computer Science 2022-04-22 Colin Wei , Kendrick Shen , Yining Chen , Tengyu Ma

Semi-Supervised Learning (SSL) has been proved to be an effective way to leverage both labeled and unlabeled data at the same time. Recent semi-supervised approaches focus on deep neural networks and have achieved promising results on…

Computer Vision and Pattern Recognition · Computer Science 2018-12-14 Hong-Yu Zhou , Avital Oliver , Jianxin Wu , Yefeng Zheng

Stream-based active learning (AL) is an efficient training data collection method, and it is used to reduce human annotation cost required in machine learning. However, it is difficult to say that the human cost is low enough because most…

Robotics · Computer Science 2023-10-04 Kanata Suzuki , Taro Sunagawa , Tomotake Sasaki , Takashi Katoh

Training language models to learn from human instructions for zero-shot cross-task generalization has attracted much attention in NLP communities. Recently, instruction tuning (IT), which fine-tunes a pre-trained language model on a massive…

Computation and Language · Computer Science 2022-10-18 Yuxian Gu , Pei Ke , Xiaoyan Zhu , Minlie Huang

Decision making algorithms, in practice, are often trained on data that exhibits a variety of biases. Decision-makers often aim to take decisions based on some ground-truth target that is assumed or expected to be unbiased, i.e., equally…

Machine Learning · Statistics 2022-07-05 Miriam Rateike , Ayan Majumdar , Olga Mineeva , Krishna P. Gummadi , Isabel Valera

Recent deep networks achieved state of the art performance on a variety of semantic segmentation tasks. Despite such progress, these models often face challenges in real world `wild tasks' where large difference between labeled…

Computer Vision and Pattern Recognition · Computer Science 2018-10-26 Yang Zou , Zhiding Yu , B. V. K. Vijaya Kumar , Jinsong Wang

State-of-the-art deep learning-based registration methods employ three different learning strategies: supervised learning, which requires costly manual annotations, unsupervised learning, which heavily relies on hand-crafted similarity…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Alexander Bigalke , Lasse Hansen , Tony C. W. Mok , Mattias P. Heinrich

While semi-supervised learning (SSL) has received tremendous attentions in many machine learning tasks due to its successful use of unlabeled data, existing SSL algorithms use either all unlabeled examples or the unlabeled examples with a…

Machine Learning · Computer Science 2021-09-03 Yi Xu , Lei Shang , Jinxing Ye , Qi Qian , Yu-Feng Li , Baigui Sun , Hao Li , Rong Jin

In medical imaging, inter-observer variability among radiologists often introduces label uncertainty, particularly in modalities where visual interpretation is subjective. Lung ultrasound (LUS) is a prime example-it frequently presents a…