English
Related papers

Related papers: ACD-U: Asymmetric co-teaching with machine unlearn…

200 papers

We propose self-adaptive training -- a unified training algorithm that dynamically calibrates and enhances training processes by model predictions without incurring an extra computational cost -- to advance both supervised and…

Machine Learning · Computer Science 2022-10-17 Lang Huang , Chao Zhang , Hongyang Zhang

Joint clustering and feature learning methods have shown remarkable performance in unsupervised representation learning. However, the training schedule alternating between feature clustering and network parameters update leads to unstable…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Xiaohang Zhan , Jiahao Xie , Ziwei Liu , Yew Soon Ong , Chen Change Loy

Image classification datasets exhibit a non-negligible fraction of mislabeled examples, often due to human error when one class superficially resembles another. This issue poses challenges in supervised contrastive learning (SCL), where the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zijun Long , George Killick , Lipeng Zhuang , Richard McCreadie , Gerardo Aragon Camarasa , Paul Henderson

Deep Metric Learning (DML) plays a critical role in various machine learning tasks. However, most existing deep metric learning methods with binary similarity are sensitive to noisy labels, which are widely present in real-world data. Since…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Jiexi Yan , Lei Luo , Cheng Deng , Heng Huang

Since convolutional neural networks (CNNs) can easily overfit noisy labels, which are ubiquitous in visual classification tasks, it has been a great challenge to train CNNs against them robustly. Various methods have been proposed for this…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Yongqi Zhang , Hui Zhang , Quanming Yao , Jun Wan

Falsely annotated samples, also known as noisy labels, can significantly harm the performance of deep learning models. Two main approaches for learning with noisy labels are global noise estimation and data filtering. Global noise…

Machine Learning · Computer Science 2025-07-31 Yuval Grinberg , Nimrod Harel , Jacob Goldberger , Ofir Lindenbaum

Noisy labels are an unavoidable consequence of labeling processes and detecting them is an important step towards preventing performance degradations in Convolutional Neural Networks. Discarding noisy labels avoids a harmful memorization,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Diego Ortego , Eric Arazo , Paul Albert , Noel E. O'Connor , Kevin McGuinness

Due to the lack of labels and the domain diversities, it is a challenge to study person re-identification in the cross-domain setting. An admirable method is to optimize the target model by assigning pseudo-labels for unlabeled samples…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Hongliang Zhang , Shoudong Han , Xiaofeng Pan , Jun Zhao

Deep neural networks have demonstrated remarkable advancements in various fields using large, well-annotated datasets. However, real-world data often exhibit long-tailed distributions and label noise, significantly degrading generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Jae Soon Baik , In Young Yoon , Kun Hoon Kim , Jun Won Choi

Deep neural networks (DNNs) have been shown to over-fit a dataset when being trained with noisy labels for a long enough time. To overcome this problem, we present a simple and effective method self-ensemble label filtering (SELF) to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Duc Tam Nguyen , Chaithanya Kumar Mummadi , Thi Phuong Nhung Ngo , Thi Hoai Phuong Nguyen , Laura Beggel , Thomas Brox

Learning with noisy labels is one of the hottest problems in weakly-supervised learning. Based on memorization effects of deep neural networks, training on small-loss instances becomes very promising for handling noisy labels. This fosters…

Machine Learning · Computer Science 2019-05-14 Xingrui Yu , Bo Han , Jiangchao Yao , Gang Niu , Ivor W. Tsang , Masashi Sugiyama

Forgetting presents a significant challenge during incremental training, making it particularly demanding for contemporary AI systems to assimilate new knowledge in streaming data environments. To address this issue, most approaches in…

Machine Learning · Computer Science 2024-08-27 Monica Millunzi , Lorenzo Bonicelli , Angelo Porrello , Jacopo Credi , Petter N. Kolm , Simone Calderara

In the tasks of image aesthetic quality evaluation, it is difficult to reach both the high score area and low score area due to the normal distribution of aesthetic datasets. To reduce the error in labeling and solve the problem of normal…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Xin Jin , Hao Lou , Huang Heng , Xiaodong Li , Shuai Cui , Xiaokun Zhang , Xiqiao Li

In recent years, knowledge distillation methods based on contrastive learning have achieved promising results on image classification and object detection tasks. However, in this line of research, we note that less attention is paid to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Jiawei Fan , Chao Li , Xiaolong Liu , Meina Song , Anbang Yao

Deep neural networks often rely on spurious correlations in training data, leading to biased or unfair predictions in safety-critical domains such as medicine and autonomous driving. While conventional bias mitigation typically requires…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Sai Siddhartha Chary Aylapuram , Veeraraju Elluru , Shivang Agarwal

Model quantization enables efficient deployment of deep neural networks on edge devices through low-bit parameter representation, yet raises critical challenges for implementing machine unlearning (MU) under data privacy regulations.…

Machine Learning · Computer Science 2025-03-19 Yujia Tong , Yuze Wang , Jingling Yuan , Chuang Hu

Machine unlearning aims to remove specific information, e.g. sensitive or undesirable content, from large language models (LLMs) while preserving overall performance. We propose an inference-time unlearning algorithm that uses contrastive…

Computation and Language · Computer Science 2025-06-17 Vinith M. Suriyakumar , Ayush Sekhari , Ashia Wilson

Generic Image recognition is a fundamental and fairly important visual problem in computer vision. One of the major challenges of this task lies in the fact that single image usually has multiple objects inside while the labels are still…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Zhiqiang Shen , Zhankui He , Wanyun Cui , Jiahui Yu , Yutong Zheng , Chenchen Zhu , Marios Savvides

Unsupervised Re-ID methods aim at learning robust and discriminative features from unlabeled data. However, existing methods often ignore the relationship between module parameters of Re-ID framework and feature distributions, which may…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Ziqi He , Mengjia Xue , Yunhao Du , Zhicheng Zhao , Fei Su

We introduce a novel method to combat label noise when training deep neural networks for classification. We propose a loss function that permits abstention during training thereby allowing the DNN to abstain on confusing samples while…

Machine Learning · Statistics 2019-08-05 Sunil Thulasidasan , Tanmoy Bhattacharya , Jeff Bilmes , Gopinath Chennupati , Jamal Mohd-Yusof