中文

面向模型实用性与遗忘性之间更好平衡的分布级特征距离机器遗忘

光学 2024-09-24 v1 图像与视频处理

摘要

随着深度学习应用的 explosive growth and increasing privacy concerns, the right to be forgotten has become a critical requirement in various AI industries. For example, given a facial识别系统, some individuals may wish to remove their personal data that might have been used in the training phase. Unfortunately, deep neural networks sometimes unexpectedly leak personal identities, making this removal challenging. While recent machine unlearning algorithms aim to enable models to forget specific data, we identify an unintended utility drop-correlation collapse-in which the essential correlations between image features and true labels weaken during the forgetting process. To address this challenge, we propose Distribution-Level Feature Distancing (DLFD), a novel method that efficiently forgets instances while preserving task-relevant feature correlations. Our method synthesizes data samples by optimizing the feature distribution to be distinctly different from that of forget samples, achieving effective results within a single training epoch. Through extensive experiments on facial recognition datasets, we demonstrate that our approach significantly outperforms state-of-the-art machine unlearning methods in both forgetting performance and model utility preservation.

关键词

引用

@article{arxiv.2409.14746,
  title  = {Hybrid iterating-averaging low photon budget Gabor holographic microscopy},
  author = {Mikołaj Rogalski and Piotr Arcab and Emilia Wdowiak and José Ángel Picazo-Bueno and Vicente Micó and Michał Józwik and Maciej Trusiak},
  journal= {arXiv preprint arXiv:2409.14746},
  year   = {2024}
}