English
Related papers

Related papers: Random Erasing vs. Model Inversion: A Promising De…

200 papers

Machine unlearning has become a promising solution for fulfilling the "right to be forgotten", under which individuals can request the deletion of their data from machine learning models. However, existing studies of machine unlearning…

Cryptography and Security · Computer Science 2024-04-05 Hongsheng Hu , Shuo Wang , Tian Dong , Minhui Xue

Machine learning poses severe privacy concerns as it has been shown that the learned models can reveal sensitive information about their training data. Many works have investigated the effect of widely adopted data augmentation and…

Machine Learning · Computer Science 2024-03-26 Xiao Li , Qiongxiu Li , Zhanhao Hu , Xiaolin Hu

Model inversion attacks pose a significant privacy threat to machine learning models by reconstructing sensitive data from their outputs. While various defenses have been proposed to counteract these attacks, they often come at the cost of…

Cryptography and Security · Computer Science 2024-12-11 Shuai Zhou , Dayong Ye , Tianqing Zhu , Wanlei Zhou

Reconstruction attacks and defenses are essential in understanding the data leakage problem in machine learning. However, prior work has centered around empirical observations of gradient inversion attacks, lacks theoretical grounding, and…

Cryptography and Security · Computer Science 2025-03-25 Sheng Liu , Zihan Wang , Yuxiao Chen , Qi Lei

Despite the broad application of Machine Learning models as a Service (MLaaS), they are vulnerable to model stealing attacks. These attacks can replicate the model functionality by using the black-box query process without any prior…

Cryptography and Security · Computer Science 2023-08-04 Jun Guo , Aishan Liu , Xingyu Zheng , Siyuan Liang , Yisong Xiao , Yichao Wu , Xianglong Liu

As a privacy-preserving method for implementing Vertical Federated Learning, Split Learning has been extensively researched. However, numerous studies have indicated that the privacy-preserving capability of Split Learning is insufficient.…

Machine Learning · Computer Science 2023-08-21 Haoze Qiu , Fei Zheng , Chaochao Chen , Xiaolin Zheng

Machine learning systems can produce personalized outputs that allow an adversary to infer sensitive input attributes at inference time. We introduce Robust Privacy (RP), an inference-time privacy notion inspired by certified robustness: if…

Machine Learning · Computer Science 2026-01-27 Jiankai Jin , Xiangzheng Zhang , Zhao Liu , Deyue Zhang , Quanchen Zou

Model Inversion (MI) attacks, which reconstruct the training dataset of neural networks, pose significant privacy concerns in machine learning. Recent MI attacks have managed to reconstruct realistic label-level private data, such as the…

Machine Learning · Computer Science 2025-02-27 Haoyang Li , Li Bai , Qingqing Ye , Haibo Hu , Yaxin Xiao , Huadi Zheng , Jianliang Xu

With the increasing adoption of AI, inherent security and privacy vulnerabilities formachine learning systems are being discovered. One such vulnerability makes itpossible for an adversary to obtain private information about the types of…

Machine Learning · Computer Science 2019-10-11 Samyadeep Basu , Rauf Izmailov , Chris Mesterharm

The proliferation of text-to-image diffusion models has raised significant privacy and security concerns, particularly regarding the generation of copyrighted or harmful images. In response, concept erasure (defense) methods have been…

Machine Learning · Computer Science 2025-10-06 Alex D. Richardson , Kaicheng Zhang , Lucas Beerens , Dongdong Chen

By locally encoding raw data into intermediate features, collaborative inference enables end users to leverage powerful deep learning models without exposure of sensitive raw data to cloud servers. However, recent studies have revealed that…

Machine Learning · Computer Science 2025-04-04 Song Xia , Yi Yu , Wenhan Yang , Meiwen Ding , Zhuo Chen , Ling-Yu Duan , Alex C. Kot , Xudong Jiang

Model inversion attacks involve reconstructing the training data of a target model, which raises serious privacy concerns for machine learning models. However, these attacks, especially learning-based methods, are likely to suffer from low…

Cryptography and Security · Computer Science 2023-06-27 Shuai Zhou , Tianqing Zhu , Dayong Ye , Xin Yu , Wanlei Zhou

Adversarial attacks on deep-learning models pose a serious threat to their reliability and security. Existing defense mechanisms are narrow addressing a specific type of attack or being vulnerable to sophisticated attacks. We propose a new…

Machine Learning · Computer Science 2023-06-22 Mouna Rabhi , Roberto Di Pietro

The memorization of training data by neural networks raises pressing concerns for privacy and security. Recent work has shown that, under certain conditions, portions of the training set can be reconstructed directly from model parameters.…

Machine Learning · Computer Science 2025-09-26 Yehonatan Refael , Guy Smorodinsky , Ofir Lindenbaum , Itay Safran

In this study, we propose a new methodology to control how user's data is recognized and used by AI via exploiting the properties of adversarial examples. For this purpose, we propose reversible adversarial example (RAE), a new type of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Jiayang Liu , Weiming Zhang , Kazuto Fukuchi , Youhei Akimoto , Jun Sakuma

Given access to a machine learning model, can an adversary reconstruct the model's training data? This work studies this question from the lens of a powerful informed adversary who knows all the training data points except one. By…

Cryptography and Security · Computer Science 2022-04-26 Borja Balle , Giovanni Cherubin , Jamie Hayes

Machine learning models often pose a threat to the privacy of individuals whose data is part of the training set. Several recent attacks have been able to infer sensitive information from trained models, including model inversion or…

Machine Learning · Computer Science 2020-06-30 Abigail Goldsteen , Gilad Ezov , Ariel Farkash

Deep learning has achieved enormous success in various industrial applications. Companies do not want their valuable data to be stolen by malicious employees to train pirated models. Nor do they wish the data analyzed by the competitors…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Kejiang Chen , Xianhan Zeng , Qichao Ying , Sheng Li , Zhenxing Qian , Xinpeng Zhang

Due to the proliferation of malware, defenders are increasingly turning to automation and machine learning as part of the malware detection tool-chain. However, machine learning models are susceptible to adversarial attacks, requiring the…

Cryptography and Security · Computer Science 2024-01-17 Maria Rigaki , Sebastian Garcia

The privacy of machine learning models has become a significant concern in many emerging Machine-Learning-as-a-Service applications, where prediction services based on well-trained models are offered to users via pay-per-query. The lack of…

Machine Learning · Computer Science 2022-06-24 Xun Xian , Mingyi Hong , Jie Ding