English
Related papers

Related papers: No Subclass Left Behind: Fine-Grained Robustness i…

200 papers

Novel category discovery aims at adapting models trained on known categories to novel categories. Previous works only focus on the scenario where known and novel categories are of the same granularity. In this paper, we investigate a new…

Computation and Language · Computer Science 2022-10-17 Wenbin An , Feng Tian , Ping Chen , Siliang Tang , Qinghua Zheng , QianYing Wang

Label smoothing is widely used in deep neural networks for multi-class classification. While it enhances model generalization and reduces overconfidence by aiming to lower the probability for the predicted class, it distorts the predicted…

Machine Learning · Computer Science 2021-10-12 Mohamed Maher , Meelis Kull

Graph Neural Networks (GNNs) have gained considerable prominence in semi-supervised learning tasks in processing graph-structured data, primarily owing to their message-passing mechanism, which largely relies on the availability of clean…

Machine Learning · Computer Science 2024-11-07 Shuangjie Li , Baoming Zhang , Jianqing Song , Gaoli Ruan , Chongjun Wang , Junyuan Xie

We demonstrate that learning procedures that rely on aggregated labels, e.g., label information distilled from noisy responses, enjoy robustness properties impossible without data cleaning. This robustness appears in several ways. In the…

Machine Learning · Statistics 2026-05-26 Chen Cheng , John Duchi

Training deep neural network (DNN) with noisy labels is practically challenging since inaccurate labels severely degrade the generalization ability of DNN. Previous efforts tend to handle part or full data in a unified denoising flow via…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Boshen Zhang , Yuxi Li , Yuanpeng Tu , Jinlong Peng , Yabiao Wang , Cunlin Wu , Yang Xiao , Cairong Zhao

Most existing deep learning models are trained based on the closed-world assumption, where the test data is assumed to be drawn i.i.d. from the same distribution as the training data, known as in-distribution (ID). However, when models are…

Machine Learning · Computer Science 2022-11-09 Yixin Liu , Kaize Ding , Huan Liu , Shirui Pan

We focus on the real-world problem of training accurate deep models for image classification of a small number of rare categories. In these scenarios, almost all images belong to the background category in the dataset (>95% of the dataset…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Ravi Teja Mullapudi , Fait Poms , William R. Mark , Deva Ramanan , Kayvon Fatahalian

Fine-grained image classification, which aims to distinguish images with subtle distinctions, is a challenging task due to two main issues: lack of sufficient training data for every class and difficulty in learning discriminative features…

Computer Vision and Pattern Recognition · Computer Science 2017-07-05 Aoxue Li , Zhiwu Lu , Liwei Wang , Tao Xiang , Xinqi Li , Ji-Rong Wen

Federated Graph Learning (FGL) is a distributed machine learning paradigm based on graph neural networks, enabling secure and collaborative modeling of local graph data among clients. However, label noise can degrade the global model's…

Machine Learning · Computer Science 2024-12-02 De Li , Haodong Qian , Qiyu Li , Zhou Tan , Zemin Gan , Jinyan Wang , Xianxian Li

Graphs are growing rapidly, along with the number of distinct label categories associated with them. Applications like e-commerce, healthcare, recommendation systems, and various social media platforms are rapidly moving towards graph…

Artificial Intelligence · Computer Science 2025-04-08 Aditya Hemant Shahane , Prathosh A. P , Sandeep Kumar

Training an accurate object detector is expensive and time-consuming. One main reason lies in the laborious labeling process, i.e., annotating category and bounding box information for all instances in every image. In this paper, we examine…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Qing Tian , Sampath Chanda , K C Amit Kumar , Douglas Gray

Deep neural networks are often ignorant about what they do not know and overconfident when they make uninformed predictions. Some recent approaches quantify classification uncertainty directly by training the model to output high…

Machine Learning · Computer Science 2020-06-09 Murat Sensoy , Lance Kaplan , Federico Cerutti , Maryam Saleki

Fine-grained classification involves dealing with datasets with larger number of classes with subtle differences between them. Guiding the model to focus on differentiating dimensions between these commonly confusable classes is key to…

Computation and Language · Computer Science 2021-09-14 Varsha Suresh , Desmond C. Ong

Deep generative models trained with large amounts of unlabelled data have proven to be powerful within the domain of unsupervised learning. Many real life data sets contain a small amount of labelled data points, that are typically…

Machine Learning · Statistics 2017-04-04 Lars Maaløe , Marco Fraccaro , Ole Winther

While neural networks have shown remarkable success on classification tasks in terms of average-case performance, they often fail to perform well on certain groups of the data. Such group information may be expensive to obtain; thus, recent…

Machine Learning · Computer Science 2022-04-12 Nimit S. Sohoni , Maziar Sanjabi , Nicolas Ballas , Aditya Grover , Shaoliang Nie , Hamed Firooz , Christopher Ré

In this paper, we study how the granularity of pretraining labels affects the generalization of deep neural networks in image classification tasks. We focus on the "fine-to-coarse" transfer learning setting, where the pretraining label…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Guan Zhe Hong , Yin Cui , Ariel Fuxman , Stanley H. Chan , Enming Luo

Matching the performance of conditional Generative Adversarial Networks with little supervision is an important task, especially in venturing into new domains. We design a new training algorithm, which is robust to missing or ambiguous…

Machine Learning · Statistics 2019-06-11 Kiran Koshy Thekumparampil , Sewoong Oh , Ashish Khetan

Graph-based semi-supervised learning has been shown to be one of the most effective approaches for classification tasks from a wide range of domains, such as image classification and text classification, as they can exploit the connectivity…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Wanyu Lin , Zhaolin Gao , Baochun Li

Deep models trained with noisy labels are prone to over-fitting and struggle in generalization. Most existing solutions are based on an ideal assumption that the label noise is class-conditional, i.e., instances of the same class share the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Ganlong Zhao , Guanbin Li , Yipeng Qin , Feng Liu , Yizhou Yu

The amount of manually labeled data is limited in medical applications, so semi-supervised learning and automatic labeling strategies can be an asset for training deep neural networks. However, the quality of the automatically generated…

Machine Learning · Computer Science 2022-03-04 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy