English

Unlink to Unlearn: Simplifying Edge Unlearning in GNNs

Machine Learning 2024-03-12 v2 Artificial Intelligence Cryptography and Security

Abstract

As concerns over data privacy intensify, unlearning in Graph Neural Networks (GNNs) has emerged as a prominent research frontier in academia. This concept is pivotal in enforcing the \textit{right to be forgotten}, which entails the selective removal of specific data from trained GNNs upon user request. Our research focuses on edge unlearning, a process of particular relevance to real-world applications. Current state-of-the-art approaches like GNNDelete can eliminate the influence of specific edges yet suffer from \textit{over-forgetting}, which means the unlearning process inadvertently removes excessive information beyond needed, leading to a significant performance decline for remaining edges. Our analysis identifies the loss functions of GNNDelete as the primary source of over-forgetting and also suggests that loss functions may be redundant for effective edge unlearning. Building on these insights, we simplify GNNDelete to develop \textbf{Unlink to Unlearn} (UtU), a novel method that facilitates unlearning exclusively through unlinking the forget edges from graph structure. Our extensive experiments demonstrate that UtU delivers privacy protection on par with that of a retrained model while preserving high accuracy in downstream tasks, by upholding over 97.3\% of the retrained model's privacy protection capabilities and 99.8\% of its link prediction accuracy. Meanwhile, UtU requires only constant computational demands, underscoring its advantage as a highly lightweight and practical edge unlearning solution.

Keywords

Cite

@article{arxiv.2402.10695,
  title  = {Unlink to Unlearn: Simplifying Edge Unlearning in GNNs},
  author = {Jiajun Tan and Fei Sun and Ruichen Qiu and Du Su and Huawei Shen},
  journal= {arXiv preprint arXiv:2402.10695},
  year   = {2024}
}

Comments

Accepted by WWW 2024 as a Short Research Paper

R2 v1 2026-06-28T14:50:43.985Z