English
Related papers

Related papers: Lower-Bounded Proper Losses for Weakly Supervised …

200 papers

The classic teacher-student model in machine learning posits that a strong teacher supervises a weak student to improve the student's capabilities. We instead consider the inverted situation, where a weak teacher supervises a strong student…

Machine Learning · Computer Science 2025-02-03 David X. Wu , Anant Sahai

We present a probabilistic modeling and inference framework for discriminative analysis dictionary learning under a weak supervision setting. Dictionary learning approaches have been widely used for tasks such as low-level signal denoising…

Signal Processing · Electrical Eng. & Systems 2018-05-09 Zeyu You , Raviv Raich , Xiaoli Z. Fern , Jinsub Kim

Many datasets and approaches in ambient sound analysis use weakly labeled data.Weak labels are employed because annotating every data sample with a strong label is too expensive.Yet, their impact on the performance in comparison to strong…

Sound · Computer Science 2020-12-08 Nicolas Turpault , Romain Serizel , Emmanuel Vincent

Partial label learning deals with the problem where each training instance is assigned a set of candidate labels, only one of which is correct. This paper provides the first attempt to leverage the idea of self-training for dealing with…

Machine Learning · Computer Science 2019-02-11 Lei Feng , Bo An

We solve a weakly supervised regression problem. Under "weakly" we understand that for some training points the labels are known, for some unknown, and for others uncertain due to the presence of random noise or other reasons such as lack…

Machine Learning · Computer Science 2021-04-15 Vladimir Berikov , Alexander Litvinenko

Semi-supervised learning, i.e. jointly learning from labeled and unlabeled samples, is an active research topic due to its key role on relaxing human supervision. In the context of image classification, recent advances to learn from…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Eric Arazo , Diego Ortego , Paul Albert , Noel E. O'Connor , Kevin McGuinness

We study losses for binary classification and class probability estimation and extend the understanding of them from margin losses to general composite losses which are the composition of a proper loss with a link function. We characterise…

Machine Learning · Statistics 2009-12-18 Mark D. Reid , Robert C. Williamson

The field of Weakly Supervised Learning (WSL) has recently seen a surge of popularity, with numerous papers addressing different types of "supervision deficiencies", namely: poor quality, non adaptability, and insufficient quantity of…

Machine Learning · Computer Science 2021-09-28 Pierre Nodet , Vincent Lemaire , Alexis Bondu , Antoine Cornuéjols

We study binary classification in the setting where the learner is presented with multiple corrupted training samples, with possibly different sample sizes and degrees of corruption, and introduce an approach based on minimizing a weighted…

Machine Learning · Statistics 2019-10-11 Clayton Scott , Jianxin Zhang

In this paper, we study the problem of learning from weakly labeled data, where labels of the training examples are incomplete. This includes, for example, (i) semi-supervised learning where labels are partially known; (ii) multi-instance…

Machine Learning · Computer Science 2020-07-07 Yu-Feng Li , Ivor W. Tsang , James T. Kwok , Zhi-Hua Zhou

In Multiple Instance learning (MIL), weak labels are provided at the bag level with only presence/absence information known. However, there is a considerable gap in performance in comparison to a fully supervised model, limiting the…

Machine Learning · Computer Science 2021-03-22 Anxiang Zhang , Ankit Shah , Bhiksha Raj

This paper introduces a general multi-class approach to weakly supervised classification. Inferring the labels and learning the parameters of the model is usually done jointly through a block-coordinate descent algorithm such as…

Machine Learning · Computer Science 2012-07-03 Armand Joulin , Francis Bach

Obtaining accurate class labels is often costly or unreliable, and may also be limited by privacy or other practical conditions. Compared with asking an annotator to provide the exact class, it is often easier to ask whether the true label…

Machine Learning · Computer Science 2026-05-11 Jiaxu Su , Junpeng Li , Changchun Hua , Yana Yang

Understanding sleep and activity patterns plays a crucial role in physical and mental health. This study introduces a novel approach for sleep detection using weakly supervised learning for scenarios where reliable ground truth labels are…

Machine Learning · Computer Science 2024-07-09 Matthias Boeker , Vajira Thambawita , Michael Riegler , Pål Halvorsen , Hugo L. Hammer

Strong student models can learn from weaker teachers: when trained on the predictions of a weaker model, a strong pretrained student can learn to correct the weak model's errors and generalize to examples where the teacher is not confident,…

Machine Learning · Computer Science 2024-05-28 Hunter Lang , David Sontag , Aravindan Vijayaraghavan

In many applications of classifier learning, training data suffers from label noise. Deep networks are learned using huge training data where the problem of noisy labels is particularly relevant. The current techniques proposed for learning…

Machine Learning · Statistics 2017-12-29 Aritra Ghosh , Himanshu Kumar , P. S. Sastry

Collecting large-scale medical datasets with fine-grained annotations is time-consuming and requires experts. For this reason, weakly supervised learning aims at optimising machine learning models using weaker forms of annotations, such as…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Gabriele Valvano , Andrea Leo , Sotirios A. Tsaftaris

As machine learning algorithms become increasingly sophisticated to exploit subtle features of the data, they often become more dependent on simulations. This paper presents a new approach called weakly supervised classification in which…

High Energy Physics - Phenomenology · Physics 2017-07-04 Lucio Mwinmaarong Dery , Benjamin Nachman , Francesco Rubbo , Ariel Schwartzman

The standard approach to supervised classification involves the minimization of a log-loss as an upper bound to the classification error. While this is a tight bound early on in the optimization, it overemphasizes the influence of…

Machine Learning · Computer Science 2016-12-30 Nicolas Le Roux

We describe a novel weakly labeled Audio Event Classification approach based on a self-supervised attention model. The weakly labeled framework is used to eliminate the need for expensive data labeling procedure and self-supervised…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-09 Bongjun Kim , Shabnam Ghaffarzadegan