English
Related papers

Related papers: Latent Distribution Assumption for Unbiased and Co…

200 papers

Federated learning is a paradigm that enables local devices to jointly train a server model while keeping the data decentralized and private. In federated learning, since local data are collected by clients, it is hardly guaranteed that the…

Machine Learning · Computer Science 2022-03-01 Seunghan Yang , Hyoungseob Park , Junyoung Byun , Changick Kim

Deep learning has made many remarkable achievements in many fields but suffers from noisy labels in datasets. The state-of-the-art learning with noisy label method Co-teaching and Co-teaching+ confronts the noisy label by mutual-information…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Jiarun Liu , Daguang Jiang , Yukun Yang , Ruirui Li

Annotating data for sensitive labels (e.g., disease, smoking) poses a potential threats to individual privacy in many real-world scenarios. To cope with this problem, we propose a novel setting to protect privacy of each instance, namely…

Machine Learning · Computer Science 2024-12-04 Zhongnian Li , Meng Wei , Peng Ying , Tongfeng Sun , Xinzheng Xu

Learning with noisy labels aims to ensure model generalization given a label-corrupted training set. The sample selection strategy achieves promising performance by selecting a label-reliable subset for model training. In this paper, we…

Machine Learning · Computer Science 2025-04-11 Qi Wei , Lei Feng , Haobo Wang , Bo An

Although noisy-label learning is often approached with discriminative methods for simplicity and speed, generative modeling offers a principled alternative by capturing the joint mechanism that produces features, clean labels, and corrupted…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Fengbei Liu , Chong Wang , Yuanhong Chen , Yuyuan Liu , Gustavo Carneiro

In this paper, we answer the question of when inserting label noise (less informative labels) can instead return us more accurate and fair models. We are primarily inspired by three observations: 1) In contrast to reducing label noise…

Machine Learning · Computer Science 2021-11-09 Yang Liu , Jialu Wang

Deep latent variable models learn condensed representations of data that, hopefully, reflect the inner workings of the studied phenomena. Unfortunately, these latent representations are not statistically identifiable, meaning they cannot be…

Machine Learning · Statistics 2025-06-02 Stas Syrota , Yevgen Zainchkovskyy , Johnny Xi , Benjamin Bloem-Reddy , Søren Hauberg

We consider the problem of learning classifiers for labeled data that has been distributed across several nodes. Our goal is to find a single classifier, with small approximation error, across all datasets while minimizing the communication…

Machine Learning · Statistics 2012-03-06 Hal Daume , Jeff M. Phillips , Avishek Saha , Suresh Venkatasubramanian

Noisy labels are inevitable yet problematic in machine learning society. It ruins the generalization of a classifier by making the classifier over-fitted to noisy labels. Existing methods on noisy label have focused on modifying the…

Machine Learning · Computer Science 2022-05-27 HeeSun Bae , Seungjae Shin , Byeonghu Na , JoonHo Jang , Kyungwoo Song , Il-Chul Moon

Existing research on learning with noisy labels mainly focuses on synthetic label noise. Synthetic noise, though has clean structures which greatly enabled statistical analyses, often fails to model real-world noise patterns. The recent…

Machine Learning · Computer Science 2022-03-29 Jiaheng Wei , Zhaowei Zhu , Hao Cheng , Tongliang Liu , Gang Niu , Yang Liu

Accurate noise modelling is important for training of deep learning reconstruction algorithms. While noise models are well known for traditional imaging techniques, the noise distribution of a novel sensor may be difficult to determine a…

Machine Learning · Computer Science 2018-07-11 Felix Horger , Tobias Würfl , Vincent Christlein , Andreas Maier

In real-world applications, perfect labels are rarely available, making it challenging to develop robust machine learning algorithms that can handle noisy labels. Recent methods have focused on filtering noise based on the discrepancy…

Machine Learning · Computer Science 2023-08-01 Mingcai Chen , Yuntao Du , Wei Tang , Baoming Zhang , Hao Cheng , Shuwei Qian , Chongjun Wang

Labelling of data for supervised learning can be costly and time-consuming and the risk of incorporating label noise in large data sets is imminent. When training a flexible discriminative model using a strictly proper loss, such noise will…

Machine Learning · Statistics 2022-05-13 Amanda Olmin , Fredrik Lindsten

There is growing evidence that converting targets to soft targets in supervised learning can provide considerable gains in performance. Much of this work has considered classification, converting hard zero-one values to soft labels---such…

Machine Learning · Statistics 2018-06-13 Ehsan Imani , Martha White

Noisy multi-label learning has garnered increasing attention due to the challenges posed by collecting large-scale accurate labels, making noisy labels a more practical alternative. Motivated by noisy multi-class learning, the introduction…

Machine Learning · Computer Science 2023-09-25 Shikun Li , Xiaobo Xia , Hansong Zhang , Shiming Ge , Tongliang Liu

Estimation of a deterministic quantity observed in non-Gaussian additive noise is explored via order statistics approach. More specifically, we study the estimation problem when measurement noises either have positive supports or follow a…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Kamiar Radnosrati , Gustaf Hendeby , Fredrik Gustafsson

This paper considers hidden Markov models where the observations are given as the sum of a latent state which lies in a general state space and some independent noise with unknown distribution. It is shown that these fully nonparametric…

Statistics Theory · Mathematics 2020-01-30 Elisabeth Gassiat , Sylvain Le Corff , Luc Lehéricy

Graph Neural Networks (GNNs) have achieved promising results for semi-supervised learning tasks on graphs such as node classification. Despite the great success of GNNs, many real-world graphs are often sparsely and noisily labeled, which…

Machine Learning · Computer Science 2021-06-10 Enyan Dai , Charu Aggarwal , Suhang Wang

Often, the data used to train ranking models is subject to label noise. For example, in web-search, labels created from clickstream data are noisy due to issues such as insufficient information in item descriptions on the SERP, query…

Information Retrieval · Computer Science 2022-08-18 Dany Haddad

This work initiates the systematic study of explicit distributions that are indistinguishable from a single exponential-size combinatorial object. In this we extend the work of Goldreich, Goldwasser and Nussboim (SICOMP 2010) that focused…

Computational Complexity · Computer Science 2023-02-27 Lunjia Hu , Inbal Livni-Navon , Omer Reingold