English
Related papers

Related papers: A Gradient-based Approach for Online Robust Deep N…

200 papers

The existence of noisy data is prevalent in both the training and testing phases of machine learning systems, which inevitably leads to the degradation of model performance. There have been plenty of works concentrated on learning with…

Machine Learning · Computer Science 2021-08-26 Zhi-Fan Wu , Tong Wei , Jianwen Jiang , Chaojie Mao , Mingqian Tang , Yu-Feng Li

Neural networks trained with stochastic gradient descent exhibit an inductive bias towards simpler decision boundaries, typically converging to a narrow family of functions, and often fail to capture more complex features. This phenomenon…

Machine Learning · Computer Science 2024-11-08 Rahul Vashisht , P. Krishna Kumar , Harsha Vardhan Govind , Harish G. Ramaswamy

In many domains, collecting sufficient labeled training data for supervised machine learning requires easily accessible but noisy sources, such as crowdsourcing services or tagged Web data. Noisy labels occur frequently in data sets…

Machine Learning · Computer Science 2018-11-16 Matthew Klawonn , Eric Heim , James Hendler

Deep learning has gained broad interest in remote sensing image scene classification thanks to the effectiveness of deep neural networks in extracting the semantics from complex data. However, deep networks require large amounts of training…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Gianmarco Perantoni , Lorenzo Bruzzone

SGD does not produce robust results on datasets with label noise. Because the gradients calculated according to the losses of the noisy samples cause the optimization process to go in the wrong direction. In this paper, as an alternative to…

Machine Learning · Computer Science 2022-03-29 Enes Dedeoglu , Himmet Toprak Kesgin , Mehmet Fatih Amasyali

Noisy training set usually leads to the degradation of generalization and robustness of neural networks. In this paper, we propose using a theoretically guaranteed noisy label detection framework to detect and remove noisy data for Learning…

Machine Learning · Computer Science 2022-03-22 Yikai Wang , Xinwei Sun , Yanwei Fu

Several works in computer vision have demonstrated the effectiveness of active learning for adapting the recognition model when new unlabeled data becomes available. Most of these works consider that labels obtained from the annotator are…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Sudipta Paul , Shivkumar Chandrasekaran , B. S. Manjunath , Amit K. Roy-Chowdhury

Learning with curriculum has shown great effectiveness in tasks where the data contains noisy (corrupted) labels, since the curriculum can be used to re-weight or filter out noisy samples via proper design. However, obtaining curriculum…

Machine Learning · Computer Science 2020-12-29 Mengying Sun , Jing Xing , Bin Chen , Jiayu Zhou

Deep neural networks are susceptible to label noise. Existing methods to improve robustness, such as meta-learning and regularization, usually require significant change to the network architecture or careful tuning of the optimization…

Machine Learning · Computer Science 2022-05-31 Li Chen , Ningyuan Huang , Cong Mu , Hayden S. Helm , Kate Lytvynets , Weiwei Yang , Carey E. Priebe

Image classification problems are typically addressed by first collecting examples with candidate labels, second cleaning the candidate labels manually, and third training a deep neural network on the clean examples. The manual labeling…

Machine Learning · Computer Science 2020-02-27 Fatih Furkan Yilmaz , Reinhard Heckel

Real-world datasets commonly have noisy labels, which negatively affects the performance of deep neural networks (DNNs). In order to address this problem, we propose a label noise robust learning algorithm, in which the base classifier is…

Machine Learning · Computer Science 2022-07-13 Görkem Algan , Ilkay Ulusoy

Multi-label data stream usually contains noisy labels in the real-world applications, namely occuring in both relevant and irrelevant labels. However, existing online multi-label classification methods are mostly limited in terms of label…

Machine Learning · Computer Science 2024-10-04 Yizhang Zou , Xuegang Hu , Peipei Li , Jun Hu , You Wu

In this paper, we introduced the novel concept of advisor network to address the problem of noisy labels in image classification. Deep neural networks (DNN) are prone to performance reduction and overfitting problems on training data with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Simone Ricci , Tiberio Uricchio , Alberto Del Bimbo

Today's available datasets in the wild, e.g., from social media and open platforms, present tremendous opportunities and challenges for deep learning, as there is a significant portion of tagged images, but often with noisy, i.e. erroneous,…

Machine Learning · Computer Science 2020-07-14 Amirmasoud Ghiassi , Robert Birke , Rui Han , Lydia Y. Chen

We propose an online learning algorithm for a class of machine learning models under a separable stochastic approximation framework. The essence of our idea lies in the observation that certain parameters in the models are easier to…

Machine Learning · Computer Science 2023-05-23 Min Gan , Xiang-xiang Su , Guang-yong Chen , Jing Chen

Labeling objects at a subordinate level typically requires expert knowledge, which is not always available when using random annotators. As such, learning directly from web images for fine-grained recognition has attracted broad attention.…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Huafeng Liu , Chuanyi Zhang , Yazhou Yao , Xiushen Wei , Fumin Shen , Jian Zhang , Zhenmin Tang

Imperfect labels are ubiquitous in real-world datasets. Several recent successful methods for training deep neural networks (DNNs) robust to label noise have used two primary techniques: filtering samples based on loss during a warm-up…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Kento Nishi , Yi Ding , Alex Rich , Tobias Höllerer

Point cloud segmentation is a fundamental task in 3D. Despite recent progress on point cloud segmentation with the power of deep networks, current learning methods based on the clean label assumptions may fail with noisy labels. Yet, class…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Shuquan Ye , Dongdong Chen , Songfang Han , Jing Liao

Label noise is common in large real-world datasets, and its presence harms the training process of deep neural networks. Although several works have focused on the training strategies to address this problem, there are few studies that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Emeson Santana , Gustavo Carneiro , Filipe R. Cordeiro

In learning with noisy labels, the sample selection approach is very popular, which regards small-loss data as correctly labeled during training. However, losses are generated on-the-fly based on the model being trained with noisy labels,…

Machine Learning · Computer Science 2021-06-02 Xiaobo Xia , Tongliang Liu , Bo Han , Mingming Gong , Jun Yu , Gang Niu , Masashi Sugiyama