English
Related papers

Related papers: Distill to Delete: Unlearning in Graph Networks wi…

200 papers

Graph Neural Networks (GNNs) have demonstrated strong performance in graph representation learning across various real-world applications. However, they often produce biased predictions caused by sensitive attributes, such as religion or…

Machine Learning · Computer Science 2025-10-28 Chengyu Li , Debo Cheng , Guixian Zhang , Yi Li , Shichao Zhang

Knowledge distillation (KD) has shown to be effective to boost the performance of graph neural networks (GNNs), where the typical objective is to distill knowledge from a deeper teacher GNN into a shallower student GNN. However, it is often…

Machine Learning · Computer Science 2023-11-17 Kaituo Feng , Yikun Miao , Changsheng Li , Ye Yuan , Guoren Wang

Graph Neural Networks (GNNs) have revolutionized graph-based machine learning, but their heavy computational demands pose challenges for latency-sensitive edge devices in practical industrial applications. In response, a new wave of…

Machine Learning · Computer Science 2024-05-24 Weigang Lu , Ziyu Guan , Wei Zhao , Yaming Yang

Graph Neural Networks (GNNs) have been a prevailing technique for tackling various analysis tasks on graph data. A key premise for the remarkable performance of GNNs relies on complete and trustworthy initial graph descriptions (i.e., node…

Machine Learning · Computer Science 2022-12-27 Cuiying Huo , Di Jin , Yawen Li , Dongxiao He , Yu-Bin Yang , Lingfei Wu

Deep graph neural networks (GNNs) have been shown to be expressive for modeling graph-structured data. Nevertheless, the over-stacked architecture of deep graph models makes it difficult to deploy and rapidly test on mobile or embedded…

Machine Learning · Computer Science 2022-05-25 Huarui He , Jie Wang , Zhanqiu Zhang , Feng Wu

As the demand for user privacy grows, controlled data removal (machine unlearning) is becoming an important feature of machine learning models for data-sensitive Web applications such as social networks and recommender systems.…

Machine Learning · Computer Science 2023-07-04 Chao Pan , Eli Chien , Olgica Milenkovic

Knowledge distillation (KD) has shown great potential for transferring knowledge from a complex teacher model to a simple student model in which the heavy learning task can be accomplished efficiently and without losing too much prediction…

Machine Learning · Computer Science 2023-07-14 Dai Shi , Zhiqi Shao , Yi Guo , Junbin Gao

With increasing concerns about privacy attacks and potential sensitive information leakage, researchers have actively explored methods to efficiently remove sensitive training data and reduce privacy risks in graph neural network (GNN)…

Machine Learning · Computer Science 2025-09-08 Faqian Guan , Tianqing Zhu , Zhoutian Wang , Wei Ren , Wanlei Zhou

Although the convolutional neural network (CNN) has achieved excellent performance in vision tasks by extracting the intra-sample representation, it will take a higher training expense because of stacking numerous convolutional layers.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Ziheng Jiao , Hongyuan Zhang , Xuelong Li

Graph Neural Networks (GNNs) have achieved remarkable success in various real-world applications. However, GNNs may be trained on undesirable graph data, which can degrade their performance and reliability. To enable trained GNNs to…

Machine Learning · Computer Science 2024-03-14 Jiahao Zhang , Lin Wang , Shijie Wang , Wenqi Fan

Graph-structured data is ubiquitous in practice and often processed using graph neural networks (GNNs). With the adoption of recent laws ensuring the ``right to be forgotten'', the problem of graph data removal has become of significant…

Machine Learning · Computer Science 2022-11-01 Eli Chien , Chao Pan , Olgica Milenkovic

Graph Neural Networks (GNNs) achieve high performance but can be opaque to humans, making it difficult to understand and compare the many proposed architectures. While existing explainability methods attribute individual predictions to…

Machine Learning · Computer Science 2026-05-11 Debolina Halder Lina , Arlei Silva

Graph Neural Networks (GNNs) are popular for graph machine learning and have shown great results on wide node classification tasks. Yet, they are less popular for practical deployments in the industry owing to their scalability challenges…

Machine Learning · Computer Science 2022-03-24 Shichang Zhang , Yozen Liu , Yizhou Sun , Neil Shah

Despite plentiful successes achieved by graph representation learning in various domains, the training of graph neural networks (GNNs) still remains tenaciously challenging due to the tremendous computational overhead needed for sizable…

Machine Learning · Computer Science 2025-05-28 Yurui Lai , Taiyan Zhang , Renchi Yang

Graph neural networks (GNNs) are the dominant paradigm for classifying nodes in a graph, but they have several undesirable attributes stemming from their message passing architecture. Recently, distillation methods succeeded in eliminating…

Machine Learning · Computer Science 2024-02-09 Daniel Winter , Niv Cohen , Yedid Hoshen

Graph Neural Networks (GNNs) have shown satisfying performance on various graph learning tasks. To achieve better fitting capability, most GNNs are with a large number of parameters, which makes these GNNs computationally expensive.…

Machine Learning · Computer Science 2023-01-05 Yushun Dong , Binchi Zhang , Yiling Yuan , Na Zou , Qi Wang , Jundong Li

The recent rapid growth of visual generative models trained on vast web-scale datasets has created significant tension with data privacy regulations and copyright laws, such as GDPR's ``Right to be Forgotten.'' This necessitates machine…

Machine Learning · Computer Science 2025-12-03 Naveen George , Naoki Murata , Yuhta Takida , Konda Reddy Mopuri , Yuki Mitsufuji

Dynamic graph representation learning strategies are based on different neural architectures to capture the graph evolution over time. However, the underlying neural architectures require a large amount of parameters to train and suffer…

Machine Learning · Computer Science 2020-11-12 Stefanos Antaris , Dimitrios Rafailidis

Graph neural networks (GNNs) are increasingly used to model complex patterns in graph-structured data. However, enabling them to "forget" designated information remains challenging, especially under privacy regulations such as the GDPR.…

Machine Learning · Computer Science 2025-12-09 Imran Ahsan , Hyunwook Yu , Jinsung Kim , Mucheol Kim

Knowledge distillation is a learning paradigm for boosting resource-efficient graph neural networks (GNNs) using more expressive yet cumbersome teacher models. Past work on distillation for GNNs proposed the Local Structure Preserving loss…

Machine Learning · Computer Science 2023-02-07 Chaitanya K. Joshi , Fayao Liu , Xu Xun , Jie Lin , Chuan-Sheng Foo