English
Related papers

Related papers: SelfAugment: Automatic Augmentation Policies for S…

200 papers

Semi-supervised learning, i.e. jointly learning from labeled and unlabeled samples, is an active research topic due to its key role on relaxing human supervision. In the context of image classification, recent advances to learn from…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Eric Arazo , Diego Ortego , Paul Albert , Noel E. O'Connor , Kevin McGuinness

We explore the problem of learning under selective labels in the context of algorithm-assisted decision making. Selective labels is a pervasive selection bias problem that arises when historical decision making blinds us to the true outcome…

Machine Learning · Computer Science 2018-07-06 Maria De-Arteaga , Artur Dubrawski , Alexandra Chouldechova

Due to the semantic complexity of the Relation extraction (RE) task, obtaining high-quality human labelled data is an expensive and noisy process. To improve the sample efficiency of the models, semi-supervised learning (SSL) methods aim to…

Computation and Language · Computer Science 2023-06-21 Komal K. Teru

Augmentation-based self-supervised learning methods have shown remarkable success in self-supervised visual representation learning, excelling in learning invariant features but often neglecting equivariant ones. This limitation reduces the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Qin Wang , Kai Krajsek , Hanno Scharr

Learning robust and effective representations of visual data is a fundamental task in computer vision. Traditionally, this is achieved by training models with labeled data which can be expensive to obtain. Self-supervised learning attempts…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Mehmet Aygün , Prithviraj Dhar , Zhicheng Yan , Oisin Mac Aodha , Rakesh Ranjan

Supervised deep learning methods for segmentation require large amounts of labelled training data, without which they are prone to overfitting, not generalizing well to unseen images. In practice, obtaining a large number of annotations…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Krishna Chaitanya , Neerav Karani , Christian Baumgartner , Olivio Donati , Anton Becker , Ender Konukoglu

The brain performs unsupervised learning and (perhaps) simultaneous supervised learning. This raises the question as to whether a hybrid of supervised and unsupervised methods will produce better learning. Inspired by the rich space of…

Machine Learning · Computer Science 2021-03-19 Jeffrey Cheng , Ari Benjamin , Benjamin Lansdell , Konrad Paul Kordin

Reward models (RM) capture the values and preferences of humans and play a central role in Reinforcement Learning with Human Feedback (RLHF) to align pretrained large language models (LLMs). Traditionally, training these models relies on…

Machine Learning · Computer Science 2024-09-12 Yifei He , Haoxiang Wang , Ziyan Jiang , Alexandros Papangelis , Han Zhao

Supervised learning-based segmentation methods typically require a large number of annotated training data to generalize well at test time. In medical applications, curating such datasets is not a favourable option because acquiring a large…

Image and Video Processing · Electrical Eng. & Systems 2020-11-20 Krishna Chaitanya , Neerav Karani , Christian F. Baumgartner , Ertunc Erdil , Anton Becker , Olivio Donati , Ender Konukoglu

Learning algorithms normally assume that there is at most one annotation or label per data point. However, in some scenarios, such as medical diagnosis and on-line collaboration,multiple annotations may be available. In either case,…

Machine Learning · Computer Science 2012-03-19 Yan Yan , Romer Rosales , Glenn Fung , Jennifer Dy

Image recognition techniques heavily rely on abundant labeled data, particularly in medical contexts. Addressing the challenges associated with obtaining labeled data has led to the prominence of self-supervised learning and semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Hao Feng , Yuanzhe Jia , Ruijia Xu , Mukesh Prasad , Ali Anaissi , Ali Braytee

Supervised learning is based on the assumption that the ground truth in the training data is accurate. However, this may not be guaranteed in real-world settings. Inaccurate training data will result in some unexpected predictions. In image…

Computer Vision and Pattern Recognition · Computer Science 2022-01-06 Yunhao Yang , Andrew Whinston

We tackle the problem of discovering novel classes in an image collection given labelled examples of other classes. This setting is similar to semi-supervised learning, but significantly harder because there are no labelled examples for the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Kai Han , Sylvestre-Alvise Rebuffi , Sebastien Ehrhardt , Andrea Vedaldi , Andrew Zisserman

Text classification is a widely studied problem and has broad applications. In many real-world problems, the number of texts for training classification models is limited, which renders these models prone to overfitting. To address this…

Computation and Language · Computer Science 2021-03-25 Meng Zhou , Zechen Li , Pengtao Xie

In past research on self-supervised learning for image classification, the use of rotation as an augmentation has been common. However, relying solely on rotation as a self-supervised transformation can limit the ability of the model to…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Erland Hilman Fuadi , Aristo Renaldo Ruslim , Putu Wahyu Kusuma Wardhana , Novanto Yudistira

Soft augmentation regularizes the supervised learning process of image classifiers by reducing label confidence of a training sample based on the magnitude of random-crop augmentation applied to it. This paper extends this adaptive label…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Georg Siedel , Ekagra Gupta , Weijia Shao , Silvia Vock , Andrey Morozov

Reinforcement learning optimizes policies for expected cumulative reward. Need the supervision be so narrow? Reward is delayed and sparse for many tasks, making it a difficult and impoverished signal for end-to-end optimization. To augment…

Machine Learning · Computer Science 2017-03-10 Evan Shelhamer , Parsa Mahmoudieh , Max Argus , Trevor Darrell

The state of the art in semantic segmentation is steadily increasing in performance, resulting in more precise and reliable segmentations in many different applications. However, progress is limited by the cost of generating labels for…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Viktor Olsson , Wilhelm Tranheden , Juliano Pinto , Lennart Svensson

We present semi-supervised models with data augmentation (SMDA), a semi-supervised text classification system to classify interactive affective responses. SMDA utilizes recent transformer-based models to encode each sentence and employs…

Computation and Language · Computer Science 2020-04-24 Jiaao Chen , Yuwei Wu , Diyi Yang

In this paper, we study statistical properties of semi-supervised learning, which is considered as an important problem in the community of machine learning. In the standard supervised learning, only the labeled data is observed. The…

Machine Learning · Statistics 2012-04-19 Masanori Kawakita , Takafumi Kanamori