English
Related papers

Related papers: Bias Redistribution in Visual Machine Unlearning: …

200 papers

Machine unlearning aims to remove targeted knowledge from a trained model without the cost of retraining from scratch. In class unlearning, however, reducing accuracy on forget classes does not necessarily imply true forgetting: forgotten…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Arman Hatami , Romina Aalishah , Ilya E. Monosov

Many machine learning algorithms are trained and evaluated by splitting data from a single source into training and test sets. While such focus on in-distribution learning scenarios has led to interesting advancement, it has not been able…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Hyojin Bahng , Sanghyuk Chun , Sangdoo Yun , Jaegul Choo , Seong Joon Oh

While numerous machine unlearning (MU) methods have recently been developed with promising results in erasing the influence of forgotten data, classes, or concepts, they are also highly vulnerable-for example, simple fine-tuning can…

Machine Learning · Computer Science 2026-04-10 Yichen Gao , Altay Unal , Akshay Rangamani , Zhihui Zhu

Facial analysis models are increasingly applied in real-world applications that have significant impact on peoples' lives. However, as literature has shown, models that automatically classify facial attributes might exhibit algorithmic…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Camila Kolling , Victor Araujo , Adriano Veloso , Soraia Raupp Musse

Machine unlearning algorithms, designed for selective removal of training data from models, have emerged as a promising approach to growing privacy concerns. In this work, we expose a critical yet underexplored vulnerability in the…

Cryptography and Security · Computer Science 2024-10-15 Yangsibo Huang , Daogao Liu , Lynn Chua , Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Milad Nasr , Amer Sinha , Chiyuan Zhang

A key element in transfer learning is representation learning; if representations can be developed that expose the relevant factors underlying the data, then new tasks and domains can be learned readily based on mappings of these salient…

Machine Learning · Computer Science 2014-12-18 Yujia Li , Kevin Swersky , Richard Zemel

Machine unlearning is the problem of removing the effect of a subset of training data (the ''forget set'') from a trained model without damaging the model's utility e.g. to comply with users' requests to delete their data, or remove…

Machine Learning · Computer Science 2024-11-01 Kairan Zhao , Meghdad Kurmanji , George-Octavian Bărbulescu , Eleni Triantafillou , Peter Triantafillou

Machine Learning (ML) models trained on data from multiple demographic groups can inherit representation disparity (Hashimoto et al., 2018) that may exist in the data: the model may be less favorable to groups contributing less to the…

Machine Learning · Computer Science 2019-11-05 Xueru Zhang , Mohammad Mahdi Khalili , Cem Tekin , Mingyan Liu

We tackle the problem of feature unlearning from a pre-trained image generative model: GANs and VAEs. Unlike a common unlearning task where an unlearning target is a subset of the training set, we aim to unlearn a specific feature, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Saemi Moon , Seunghyuk Cho , Dongwoo Kim

We investigate how independent demographic bias mechanisms are from general demographic recognition in language models. Using a multi-task evaluation setup where demographics are associated with names, professions, and education levels, we…

Computation and Language · Computer Science 2025-12-25 Zhengyang Shan , Aaron Mueller

Machine unlearning (MU) aims to eliminate information that has been learned from specific training data, namely forgetting data, from a pre-trained model. Currently, the mainstream of existing MU methods involves modifying the forgetting…

Machine Learning · Computer Science 2025-10-13 Zhengbao He , Tao Li , Xinwen Cheng , Zhehao Huang , Xiaolin Huang

We show that participating in federated learning can be detrimental to group fairness. In fact, the bias of a few parties against under-represented groups (identified by sensitive attributes such as gender or race) can propagate through the…

Machine Learning · Computer Science 2023-09-06 Hongyan Chang , Reza Shokri

Contrastive learning (CL) has emerged as a powerful technique for representation learning, with or without label supervision. However, supervised CL is prone to collapsing representations of subclasses within a class by not capturing all…

Machine Learning · Computer Science 2023-05-30 Yihao Xue , Siddharth Joshi , Eric Gan , Pin-Yu Chen , Baharan Mirzasoleiman

The embedding spaces of image models have been shown to encode a range of social biases such as racism and sexism. Here, we investigate specific factors that contribute to the emergence of these biases in Vision Transformers (ViT).…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Jannik Brinkmann , Paul Swoboda , Christian Bartelt

The rapid progress of AI, combined with its unprecedented public adoption and the propensity of large neural networks to memorize training data, has given rise to significant data privacy concerns. To address these concerns, machine…

Machine Learning · Computer Science 2023-11-23 Ali Abbasi , Chayne Thrash , Elaheh Akbari , Daniel Zhang , Soheil Kolouri

Current unlearning methods for LLMs optimize on the private information they seek to remove by incorporating it into their fine-tuning data. We argue this not only risks reinforcing exposure to sensitive data, but also fundamentally…

Machine Learning · Computer Science 2026-03-03 Yan Scholten , Sophie Xhonneux , Leo Schwinn , Stephan Günnemann

An emerging definition of fairness in machine learning requires that models are oblivious to demographic user information, e.g., a user's gender or age should not influence the model. Personalized recommender systems are particularly prone…

Information Retrieval · Computer Science 2023-08-30 Bjørnar Vassøy , Helge Langseth , Benjamin Kille

Machine unlearning (MU) aims to remove the influence of specific training samples from a well-trained model, a task of growing importance due to the ``right to be forgotten.'' The unlearned model should approach the retrained model, where…

Machine Learning · Computer Science 2026-03-10 Xinwen Cheng , Zhehao Huang , Wenxin Zhou , Zhengbao He , Ruikai Yang , Yingwen Wu , Xiaolin Huang

With significant advances in deep learning, many computer vision applications have reached the inflection point. However, these deep learning models need large amount of labeled data for model training and optimum parameter estimation.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Aakash Varma Nadimpalli , Narsi Reddy , Sreeraj Ramachandran , Ajita Rattani

As Vision Language Models (VLMs) gain widespread use, their fairness remains under-explored. In this paper, we analyze demographic biases across five models and six datasets. We find that portrait datasets like UTKFace and CelebA are the…

Computation and Language · Computer Science 2025-04-01 Kuleen Sasse , Shan Chen , Jackson Pond , Danielle Bitterman , John Osborne