English
Related papers

Related papers: Fidelity-Weighted Learning

200 papers

Deep neural networks produce state-of-the-art results when trained on a large number of labeled examples but tend to overfit when small amounts of labeled examples are used for training. Creating a large number of labeled examples requires…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Attaullah Sahito , Eibe Frank , Bernhard Pfahringer

Distillation with unlabeled examples is a popular and powerful method for training deep neural networks in settings where the amount of labeled data is limited: A large ''teacher'' neural network is trained on the labeled data available,…

Machine Learning · Computer Science 2022-10-14 Fotis Iliopoulos , Vasilis Kontonis , Cenk Baykal , Gaurav Menghani , Khoa Trinh , Erik Vee

Federated Learning allows the training of machine learning models by using the computation and private data resources of many distributed clients. Most existing results on Federated Learning (FL) assume the clients have ground-truth labels.…

Machine Learning · Computer Science 2022-10-12 Enmao Diao , Jie Ding , Vahid Tarokh

As an important branch of weakly supervised learning, partial label learning deals with data where each instance is assigned with a set of candidate labels, whereas only one of them is true. Despite many methodology studies on learning from…

Machine Learning · Computer Science 2021-06-11 Hongwei Wen , Jingyi Cui , Hanyuan Hang , Jiabin Liu , Yisen Wang , Zhouchen Lin

Recent advancements in semi-supervised deep learning have introduced effective strategies for leveraging both labeled and unlabeled data to improve classification performance. This work proposes a semi-supervised framework that utilizes a…

Machine Learning · Computer Science 2025-05-21 Aydin Abedinia , Shima Tabakhi , Vahid Seydi

In the weakly supervised learning paradigm, labeling functions automatically assign heuristic, often noisy, labels to data samples. In this work, we provide a method for learning from weak labels by separating two types of complementary…

Machine Learning · Computer Science 2022-10-26 Andreas Stephan , Vasiliki Kougia , Benjamin Roth

Modern deep neural networks can easily overfit to biased training data containing corrupted labels or class imbalance. Sample re-weighting methods are popularly used to alleviate this data bias issue. Most current methods, however, require…

Machine Learning · Computer Science 2023-05-02 Jun Shu , Xiang Yuan , Deyu Meng , Zongben Xu

With the increasing computing power of edge devices, Federated Learning (FL) emerges to enable model training without privacy concerns. The majority of existing studies assume the data are fully labeled on the client side. In practice,…

Machine Learning · Computer Science 2022-05-31 Woojung Kim , Keondo Park , Kihyuk Sohn , Raphael Shu , Hyung-Sin Kim

Name tagging in low-resource languages or domains suffers from inadequate training data. Existing work heavily relies on additional information, while leaving those noisy annotations unexplored that extensively exist on the web. In this…

Computation and Language · Computer Science 2019-08-27 Yixin Cao , Zikun Hu , Tat-Seng Chua , Zhiyuan Liu , Heng Ji

We motivate weakly supervised learning as an effective learning paradigm for problems where curating perfectly annotated datasets is expensive and may require domain expertise such as fine-grained classification. We focus on Partial Label…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Darshana Saravanan , Naresh Manwani , Vineet Gandhi

In the context of supervised learning of a function by a neural network, we claim and empirically verify that the neural network yields better results when the distribution of the data set focuses on regions where the function to learn is…

Machine Learning · Statistics 2022-09-28 Paul Novello , Gaël Poëtte , David Lugato , Pietro Congedo

In domains such as health care and finance, shortage of labeled data and computational resources is a critical issue while developing machine learning algorithms. To address the issue of labeled data scarcity in training and deployment of…

Machine Learning · Computer Science 2018-10-16 Otkrist Gupta , Ramesh Raskar

Deep learning usually requires large amounts of labeled training data, but annotating data is costly and tedious. The framework of semi-supervised learning provides the means to use both labeled data and arbitrary amounts of unlabeled data…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Christoph Baur , Shadi Albarqouni , Nassir Navab

In supervised machine learning, models are typically trained using data with hard labels, i.e., definite assignments of class membership. This traditional approach, however, does not take the inherent uncertainty in these labels into…

Machine Learning · Computer Science 2024-09-25 Sjoerd de Vries , Dirk Thierens

Deep Neural Networks (DNNs) provide state-of-the-art solutions in several difficult machine perceptual tasks. However, their performance relies on the availability of a large set of labeled training data, which limits the breadth of their…

Machine Learning · Computer Science 2018-03-01 Randall Balestriero , Herve Glotin , Richard Baraniuk

Partial-label learning (PLL) generally focuses on inducing a noise-tolerant multi-class classifier by training on overly-annotated samples, each of which is annotated with a set of labels, but only one is the valid label. A basic promise of…

Computation and Language · Computer Science 2021-06-03 Yunfeng Zhao , Guoxian Yu , Lei Liu , Zhongmin Yan , Lizhen Cui , Carlotta Domeniconi

Complementary-label learning (CLL) is widely used in weakly supervised classification, but it faces a significant challenge in real-world datasets when confronted with class-imbalanced training samples. In such scenarios, the number of…

Machine Learning · Computer Science 2024-03-21 Meng Wei , Yong Zhou , Zhongnian Li , Xinzheng Xu

In many applications, training machine learning models involves using large amounts of human-annotated data. Obtaining precise labels for the data is expensive. Instead, training with weak supervision provides a low-cost alternative. We…

Machine Learning · Computer Science 2022-02-09 Chidubem Arachie , Bert Huang

In practical machine learning applications, it is often challenging to assign accurate labels to data, and increasing the number of labeled instances is often limited. In such cases, Weakly Supervised Learning (WSL), which enables training…

Machine Learning · Computer Science 2026-03-24 Tomoya Tate , Kosuke Sugiyama , Masato Uchida

With the development of computational power and techniques for data collection, deep learning demonstrates a superior performance over most existing algorithms on visual benchmark data sets. Many efforts have been devoted to studying the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Yuanhong Xu , Qi Qian , Hao Li , Rong Jin , Juhua Hu