English
Related papers

Related papers: Rethinking Model Inversion Attacks With Patch-Wise…

200 papers

Recently, diffusion models have become popular tools for image synthesis because of their high-quality outputs. However, like other large-scale models, they may leak private information about their training data. Here, we demonstrate a…

Machine Learning · Computer Science 2023-12-11 Shuai Tang , Zhiwei Steven Wu , Sergul Aydore , Michael Kearns , Aaron Roth

Model Inversion attacks aim to reconstruct information from private training data by exploiting access to a target model. Nearly all recent MI studies evaluate attack success using a standard framework that computes attack accuracy through…

Machine Learning · Computer Science 2026-05-15 Sy-Tuyen Ho , Koh Jun Hao , Ngoc-Bao Nguyen , Alexander Binder , Ngai-Man Cheung

A large body of research has shown that machine learning models are vulnerable to membership inference (MI) attacks that violate the privacy of the participants in the training data. Most MI research focuses on the case of a single…

Machine Learning · Computer Science 2022-05-16 Matthew Jagielski , Stanley Wu , Alina Oprea , Jonathan Ullman , Roxana Geambasu

With the increasing adoption of AI, inherent security and privacy vulnerabilities formachine learning systems are being discovered. One such vulnerability makes itpossible for an adversary to obtain private information about the types of…

Machine Learning · Computer Science 2019-10-11 Samyadeep Basu , Rauf Izmailov , Chris Mesterharm

Generative models are popular tools with a wide range of applications. Nevertheless, it is as vulnerable to adversarial samples as classifiers. The existing attack methods mainly focus on generating adversarial examples by adding…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Chengjin Sun , Sizhe Chen , Jia Cai , Xiaolin Huang

Collaborative machine learning settings like federated learning can be susceptible to adversarial interference and attacks. One class of such attacks is termed model inversion attacks, characterised by the adversary reverse-engineering the…

Machine Learning · Computer Science 2022-03-02 Dmitrii Usynin , Daniel Rueckert , Georgios Kaissis

Recent works have demonstrated that machine learning models are vulnerable to model inversion attacks, which lead to the exposure of sensitive information contained in their training dataset. While some model inversion attacks have been…

Machine Learning · Computer Science 2019-09-27 Ulrich Aïvodji , Sébastien Gambs , Timon Ther

This paper studies defense mechanisms against model inversion (MI) attacks -- a type of privacy attacks aimed at inferring information about the training data distribution given the access to a target machine learning model. Existing…

Cryptography and Security · Computer Science 2020-09-23 Tianhao Wang , Yuheng Zhang , Ruoxi Jia

Deep learning models are known to be vulnerable to adversarial examples. A practical adversarial attack should require as little as possible knowledge of attacked models. Current substitute attacks need pre-trained models to generate…

Cryptography and Security · Computer Science 2020-04-01 Mingyi Zhou , Jing Wu , Yipeng Liu , Xiaolin Huang , Shuaicheng Liu , Xiang Zhang , Ce Zhu

Model inversion attacks are a type of privacy attack that reconstructs private data used to train a machine learning model, solely by accessing the model. Recently, white-box model inversion attacks leveraging Generative Adversarial…

Machine Learning · Computer Science 2023-04-11 Gyojin Han , Jaehyun Choi , Haeil Lee , Junmo Kim

Generative AI technology has become increasingly integrated into our daily lives, offering powerful capabilities to enhance productivity. However, these same capabilities can be exploited by adversaries for malicious purposes. While…

Cryptography and Security · Computer Science 2025-07-17 Dayong Ye , Tianqing Zhu , Shang Wang , Bo Liu , Leo Yu Zhang , Wanlei Zhou , Yang Zhang

Model inversion (MI) attacks allow to reconstruct average per-class representations of a machine learning (ML) model's training data. It has been shown that in scenarios where each class corresponds to a different individual, such as face…

Sound · Computer Science 2023-01-10 Karla Pizzi , Franziska Boenisch , Ugur Sahin , Konstantin Böttinger

Recent works have demonstrated the feasibility of inverting face recognition systems, enabling to recover convincing face images using only their embeddings. We leverage such template inversion models to develop a novel type ofdeep morphing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Laurent Colbois , Hatef Otroshi Shahreza , Sébastien Marcel

Patch-based attacks introduce a perceptible but localized change to the input that induces misclassification. A limitation of current patch-based black-box attacks is that they perform poorly for targeted attacks, and even for the less…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Chenglin Yang , Adam Kortylewski , Cihang Xie , Yinzhi Cao , Alan Yuille

Diffusion models have achieved excellent success in solving inverse problems due to their ability to learn strong image priors, but existing approaches require a large training dataset of images that should come from the same distribution…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Jason Hu , Bowen Song , Jeffrey A. Fessler , Liyue Shen

Model Inversion (MI) attacks pose a significant privacy threat by reconstructing private training data from machine learning models. While existing defenses primarily concentrate on model-centric approaches, the impact of data on MI…

Machine Learning · Computer Science 2025-08-07 Viet-Hung Tran , Ngoc-Bao Nguyen , Son T. Mai , Hans Vandierendonck , Ira Assent , Alex Kot , Ngai-Man Cheung

By adding human-imperceptible noise to clean images, the resultant adversarial examples can fool other unknown models. Features of a pixel extracted by deep neural networks (DNNs) are influenced by its surrounding regions, and different…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Lianli Gao , Qilong Zhang , Jingkuan Song , Xianglong Liu , Heng Tao Shen

We study the membership inference (MI) attack against classifiers, where the attacker's goal is to determine whether a data instance was used for training the classifier. Through systematic cataloging of existing MI attacks and extensive…

Cryptography and Security · Computer Science 2021-02-04 Jiacheng Li , Ninghui Li , Bruno Ribeiro

Recent studies show that the state-of-the-art deep neural networks are vulnerable to model inversion attacks, in which access to a model is abused to reconstruct private training data of any given target class. Existing attacks rely on…

Machine Learning · Computer Science 2022-03-04 Mostafa Kahla , Si Chen , Hoang Anh Just , Ruoxi Jia

Skip connections are fundamental architecture designs for modern deep neural networks (DNNs) such as CNNs and ViTs. While they help improve model performance significantly, we identify a vulnerability associated with skip connections to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Jun Hao Koh , Sy-Tuyen Ho , Ngoc-Bao Nguyen , Ngai-man Cheung