English
Related papers

Related papers: Vicious Classifiers: Assessing Inference-time Data…

200 papers

Federated learning allows multiple users to collaboratively train a shared classification model while preserving data privacy. This approach, where model updates are aggregated by a central server, was shown to be vulnerable to poisoning…

Machine Learning · Computer Science 2020-12-17 Chien-Lun Chen , Leana Golubchik , Marco Paolieri

We present a practical method for protecting data during the inference phase of deep learning based on bipartite topology threat modeling and an interactive adversarial deep network construction. We term this approach \emph{Privacy…

Cryptography and Security · Computer Science 2018-12-10 Jianfeng Chi , Emmanuel Owusu , Xuwang Yin , Tong Yu , William Chan , Patrick Tague , Yuan Tian

Leakage of data from publicly available Machine Learning (ML) models is an area of growing significance as commercial and government applications of ML can draw on multiple sources of data, potentially including users' and clients'…

Neural networks are susceptible to data inference attacks such as the membership inference attack, the adversarial model inversion attack and the attribute inference attack, where the attacker could infer useful information such as the…

Machine Learning · Computer Science 2022-12-02 Ziqi Yang , Lijin Wang , Da Yang , Jie Wan , Ziming Zhao , Ee-Chien Chang , Fan Zhang , Kui Ren

The huge computation demand of deep learning models and limited computation resources on the edge devices calls for the cooperation between edge device and cloud service by splitting the deep models into two halves. However, transferring…

Cryptography and Security · Computer Science 2020-01-03 Ruiyuan Gao , Ming Dun , Hailong Yang , Zhongzhi Luan , Depei Qian

Ensuring privacy during inference stage is crucial to prevent malicious third parties from reconstructing users' private inputs from outputs of public models. Despite a large body of literature on privacy preserving learning (which ensures…

Cryptography and Security · Computer Science 2024-12-02 Fengwei Tian , Ravi Tandon

As machine learning (ML) becomes more and more powerful and easily accessible, attackers increasingly leverage ML to perform automated large-scale inference attacks in various domains. In such an ML-equipped inference attack, an attacker…

Cryptography and Security · Computer Science 2019-09-20 Jinyuan Jia , Neil Zhenqiang Gong

Deep neural networks are increasingly being used in a variety of machine learning applications applied to rich user data on the cloud. However, this approach introduces a number of privacy and efficiency challenges, as the cloud operator…

Computer Vision and Pattern Recognition · Computer Science 2017-10-13 Seyed Ali Osia , Ali Shahin Shamsabadi , Ali Taheri , Kleomenis Katevas , Hamid R. Rabiee , Nicholas D. Lane , Hamed Haddadi

Scientific collaborations benefit from collaborative learning of distributed sources, but remain difficult to achieve when data are sensitive. In recent years, privacy preserving techniques have been widely studied to analyze distributed…

Cryptography and Security · Computer Science 2022-06-30 Guanhong Miao , A. Adam Ding , Samuel S. Wu

With the increasing adoption of AI, inherent security and privacy vulnerabilities formachine learning systems are being discovered. One such vulnerability makes itpossible for an adversary to obtain private information about the types of…

Machine Learning · Computer Science 2019-10-11 Samyadeep Basu , Rauf Izmailov , Chris Mesterharm

Neural networks are often trained on proprietary datasets, making them attractive attack targets. We present a novel dataset extraction method leveraging an innovative training time backdoor attack, allowing a malicious federated learning…

Cryptography and Security · Computer Science 2025-12-19 Eden Luzon , Guy Amit , Roy Weiss , Torsten Kraub , Alexandra Dmitrienko , Yisroel Mirsky

Federated learning is a decentralized machine learning approach where clients train models locally and share model updates to develop a global model. This enables low-resource devices to collaboratively build a high-quality model without…

Cryptography and Security · Computer Science 2024-12-10 Li Bai , Haibo Hu , Qingqing Ye , Haoyang Li , Leixia Wang , Jianliang Xu

Training reliable deep learning models which avoid making overconfident but incorrect predictions is a longstanding challenge. This challenge is further exacerbated when learning has to be differentially private: protection provided to…

Machine Learning · Computer Science 2023-05-31 Stephan Rabanser , Anvith Thudi , Abhradeep Thakurta , Krishnamurthy Dvijotham , Nicolas Papernot

Federated learning (FL) is a privacy-preserving machine learning framework that enables multiple nodes to train models on their local data and periodically average weight updates to benefit from other nodes' training. Each node's goal is to…

Machine Learning · Computer Science 2025-06-16 Ethan Wilson , Kai Yue , Chau-Wai Wong , Huaiyu Dai

Artificial intelligence systems are prevalent in everyday life, with use cases in retail, manufacturing, health, and many other fields. With the rise in AI adoption, associated risks have been identified, including privacy risks to the…

Machine Learning · Computer Science 2024-07-19 Shlomit Shachor , Natalia Razinkov , Abigail Goldsteen

Model Inversion (MI) attacks, which reconstruct the training dataset of neural networks, pose significant privacy concerns in machine learning. Recent MI attacks have managed to reconstruct realistic label-level private data, such as the…

Machine Learning · Computer Science 2025-02-27 Haoyang Li , Li Bai , Qingqing Ye , Haibo Hu , Yaxin Xiao , Huadi Zheng , Jianliang Xu

Model inversion attacks involve reconstructing the training data of a target model, which raises serious privacy concerns for machine learning models. However, these attacks, especially learning-based methods, are likely to suffer from low…

Cryptography and Security · Computer Science 2023-06-27 Shuai Zhou , Tianqing Zhu , Dayong Ye , Xin Yu , Wanlei Zhou

Backdoor attacks represent a subtle yet effective class of cyberattacks targeting AI models, primarily due to their stealthy nature. The model behaves normally on clean data but exhibits malicious behavior only when the attacker embeds a…

Machine Learning · Computer Science 2025-09-29 Sujeevan Aseervatham , Achraf Kerzazi , Younès Bennani

Model Inversion attacks aim to reconstruct information from private training data by exploiting access to a target model. Nearly all recent MI studies evaluate attack success using a standard framework that computes attack accuracy through…

Machine Learning · Computer Science 2026-05-15 Sy-Tuyen Ho , Koh Jun Hao , Ngoc-Bao Nguyen , Alexander Binder , Ngai-Man Cheung

Federated learning has been proposed as a privacy-preserving machine learning framework that enables multiple clients to collaborate without sharing raw data. However, client privacy protection is not guaranteed by design in this framework.…

Cryptography and Security · Computer Science 2022-10-17 Kai Yue , Richeng Jin , Chau-Wai Wong , Dror Baron , Huaiyu Dai