中文
相关论文

相关论文: Label-only Model Inversion Attack: The Attack that…

200 篇论文

A distribution inference attack aims to infer statistical properties of data used to train machine learning models. These attacks are sometimes surprisingly potent, but the factors that impact distribution inference risk are not well…

机器学习 · 计算机科学 2024-04-09 Anshuman Suri , Yifu Lu , Yanjin Chen , David Evans

Machine learning models have been shown to leak information violating the privacy of their training set. We focus on membership inference attacks on machine learning models which aim to determine whether a data point was used to train the…

密码学与安全 · 计算机科学 2020-09-02 Shadi Rahimian , Tribhuvanesh Orekondy , Mario Fritz

Machine learning based data-driven technologies have shown impressive performances in a variety of application domains. Most enterprises use data from multiple sources to provide quality applications. The reliability of the external data…

机器学习 · 计算机科学 2021-06-01 Rosni K Vasu , Sanjay Seetharaman , Shubham Malaviya , Manish Shukla , Sachin Lodha

Collaborative machine learning settings like federated learning can be susceptible to adversarial interference and attacks. One class of such attacks is termed model inversion attacks, characterised by the adversary reverse-engineering the…

机器学习 · 计算机科学 2022-03-02 Dmitrii Usynin , Daniel Rueckert , Georgios Kaissis

Deep learning has attracted broad interest in healthcare and medical communities. However, there has been little research into the privacy issues created by deep networks trained for medical applications. Recently developed inference attack…

机器学习 · 计算机科学 2020-11-03 Maoqiang Wu , Xinyue Zhang , Jiahao Ding , Hien Nguyen , Rong Yu , Miao Pan , Stephen T. Wong

Given access to a machine learning model, can an adversary reconstruct the model's training data? This work studies this question from the lens of a powerful informed adversary who knows all the training data points except one. By…

密码学与安全 · 计算机科学 2022-04-26 Borja Balle , Giovanni Cherubin , Jamie Hayes

Membership inference attack is one of the most popular privacy attacks in machine learning, which aims to predict whether a given sample was contained in the target model's training set. Label-only membership inference attack is a variant…

机器学习 · 计算机科学 2023-06-08 JiaCheng Xu , ChengXiang Tan

Model extraction attacks are designed to steal trained models with only query access, as is often provided through APIs that ML-as-a-Service providers offer. Machine Learning (ML) models are expensive to train, in part because data is hard…

机器学习 · 计算机科学 2024-06-14 Avital Shafran , Ilia Shumailov , Murat A. Erdogdu , Nicolas Papernot

Clean-label (CL) attack is a form of data poisoning attack where an adversary modifies only the textual input of the training data, without requiring access to the labeling function. CL attacks are relatively unexplored in NLP, as compared…

计算与语言 · 计算机科学 2023-06-01 Ashim Gupta , Amrith Krishna

Machine learning models often pose a threat to the privacy of individuals whose data is part of the training set. Several recent attacks have been able to infer sensitive information from trained models, including model inversion or…

机器学习 · 计算机科学 2020-06-30 Abigail Goldsteen , Gilad Ezov , Ariel Farkash

Many backdoor removal techniques in machine learning models require clean in-distribution data, which may not always be available due to proprietary datasets. Model inversion techniques, often considered privacy threats, can reconstruct…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Si Chen , Yi Zeng , Jiachen T. Wang , Won Park , Xun Chen , Lingjuan Lyu , Zhuoqing Mao , Ruoxi Jia

With the increasing adoption of AI, inherent security and privacy vulnerabilities formachine learning systems are being discovered. One such vulnerability makes itpossible for an adversary to obtain private information about the types of…

机器学习 · 计算机科学 2019-10-11 Samyadeep Basu , Rauf Izmailov , Chris Mesterharm

Recent works have demonstrated that machine learning models are vulnerable to model inversion attacks, which lead to the exposure of sensitive information contained in their training dataset. While some model inversion attacks have been…

机器学习 · 计算机科学 2019-09-27 Ulrich Aïvodji , Sébastien Gambs , Timon Ther

Model Inversion (MI) attacks aim to reconstruct private training data by abusing access to machine learning models. Contemporary MI attacks have achieved impressive attack performance, posing serious threats to privacy. Meanwhile, all…

机器学习 · 计算机科学 2024-05-10 Sy-Tuyen Ho , Koh Jun Hao , Keshigeyan Chandrasegaran , Ngoc-Bao Nguyen , Ngai-Man Cheung

Machine learning systems deployed in distributed or federated environments are highly susceptible to adversarial manipulations, particularly availability attacks -adding imperceptible perturbations to training data, thereby rendering the…

密码学与安全 · 计算机科学 2025-06-02 Abdessamad El-Kabid , El-Mahdi El-Mhamdi

Deep neural networks have been demonstrated to be vulnerable to backdoor attacks. Specifically, by injecting a small number of maliciously constructed inputs into the training set, an adversary is able to plant a backdoor into the trained…

机器学习 · 统计学 2019-12-10 Alexander Turner , Dimitris Tsipras , Aleksander Madry

Model inversion (MI) attacks have raised increasing concerns about privacy, which can reconstruct training data from public models. Indeed, MI attacks can be formalized as an optimization problem that seeks private data in a certain space.…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Xiaojian Yuan , Kejiang Chen , Jie Zhang , Weiming Zhang , Nenghai Yu , Yang Zhang

With the widespread application of artificial intelligence technologies in face recognition and other fields, data privacy security issues have received extensive attention, especially the \textit{right to be forgotten} emphasized by…

密码学与安全 · 计算机科学 2026-04-10 Weidong Zheng , Kongyang Chen , Yao Huang , Yuanwei Guo , Yatie Xiao

To gather a significant quantity of annotated training data for high-performance image classification models, numerous companies opt to enlist third-party providers to label their unlabeled data. This practice is widely regarded as secure,…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Dazhong Rong , Guoyao Yu , Shuheng Shen , Xinyi Fu , Peng Qian , Jianhai Chen , Qinming He , Xing Fu , Weiqiang Wang

Authentication systems are vulnerable to model inversion attacks where an adversary is able to approximate the inverse of a target machine learning model. Biometric models are a prime candidate for this type of attack. This is because…

计算机视觉与模式识别 · 计算机科学 2022-09-23 Sohaib Ahmad , Benjamin Fuller , Kaleel Mahmood