English
Related papers

Related papers: Provable Privacy Attacks on Trained Shallow Neural…

200 papers

We present a practical method for protecting data during the inference phase of deep learning based on bipartite topology threat modeling and an interactive adversarial deep network construction. We term this approach \emph{Privacy…

Cryptography and Security · Computer Science 2018-12-10 Jianfeng Chi , Emmanuel Owusu , Xuwang Yin , Tong Yu , William Chan , Patrick Tague , Yuan Tian

Ensuring the privacy of research participants is vital, even more so in healthcare environments. Deep learning approaches to neuroimaging require large datasets, and this often necessitates sharing data between multiple sites, which is…

Quantitative Methods · Quantitative Biology 2021-06-04 Umang Gupta , Dimitris Stripelis , Pradeep K. Lam , Paul M. Thompson , José Luis Ambite , Greg Ver Steeg

Membership Inference Attacks have emerged as a dominant method for empirically measuring privacy leakage from machine learning models. Here, privacy is measured by the {\em{advantage}} or gap between a score or a function computed on the…

Machine Learning · Computer Science 2024-05-27 Ruihan Wu , Pengrun Huang , Kamalika Chaudhuri

We investigate the convergence guarantee of two-layer neural network training with Gaussian randomly masked inputs. This scenario corresponds to Gaussian dropout at the input level, or noisy input training common in sensor networks,…

Machine Learning · Computer Science 2026-02-20 Afroditi Kolomvaki , Fangshuo Liao , Evan Dramko , Ziyun Guang , Anastasios Kyrillidis

With the success of deep learning algorithms in various domains, studying adversarial attacks to secure deep models in real world applications has become an important research topic. Backdoor attacks are a form of adversarial attacks on…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Aniruddha Saha , Akshayvarun Subramanya , Hamed Pirsiavash

Prior approaches for membership privacy preservation usually update or retrain all weights in neural networks, which is costly and can lead to unnecessary utility loss or even more serious misalignment in predictions between training data…

Machine Learning · Computer Science 2026-03-16 Xingli Fang , Jung-Eun Kim

Reconstruction attacks and defenses are essential in understanding the data leakage problem in machine learning. However, prior work has centered around empirical observations of gradient inversion attacks, lacks theoretical grounding, and…

Cryptography and Security · Computer Science 2025-03-25 Sheng Liu , Zihan Wang , Yuxiao Chen , Qi Lei

Deep neural networks are learning models having achieved state of the art performance in many fields like prediction, computer vision, language processing and so on. However, it has been shown that certain inputs exist which would not trick…

Machine Learning · Computer Science 2020-06-03 Jay N. Paranjape , Rahul Kumar Dubey , Vijendran V Gopalan

With the increasing adoption of AI, inherent security and privacy vulnerabilities formachine learning systems are being discovered. One such vulnerability makes itpossible for an adversary to obtain private information about the types of…

Machine Learning · Computer Science 2019-10-11 Samyadeep Basu , Rauf Izmailov , Chris Mesterharm

Vision classifiers are often trained on proprietary datasets containing sensitive information, yet the models themselves are frequently shared openly under the privacy-preserving assumption. Although these models are assumed to protect…

Machine Learning · Computer Science 2025-02-04 Pirzada Suhail , Amit Sethi

Deep neural networks have been demonstrated to be vulnerable to backdoor attacks. Specifically, by injecting a small number of maliciously constructed inputs into the training set, an adversary is able to plant a backdoor into the trained…

Machine Learning · Statistics 2019-12-10 Alexander Turner , Dimitris Tsipras , Aleksander Madry

Machine learning algorithms, when applied to sensitive data, pose a distinct threat to privacy. A growing body of prior work demonstrates that models produced by these algorithms may leak specific private information in the training data to…

Cryptography and Security · Computer Science 2018-05-08 Samuel Yeom , Irene Giacomelli , Matt Fredrikson , Somesh Jha

In an era of widespread web scraping, unlearnable dataset methods have the potential to protect data privacy by preventing deep neural networks from generalizing. But in addition to a number of practical limitations that make their use…

Machine Learning · Computer Science 2023-11-09 Pedro Sandoval-Segura , Vasu Singla , Jonas Geiping , Micah Goldblum , Tom Goldstein

Statistical methods protecting sensitive information or the identity of the data owner have become critical to ensure privacy of individuals as well as of organizations. This paper investigates anonymization methods based on representation…

Machine Learning · Statistics 2018-02-27 Clément Feutry , Pablo Piantanida , Yoshua Bengio , Pierre Duhamel

Graph Prompt Learning (GPL) represents an innovative approach in graph representation learning, enabling task-specific adaptations by fine-tuning prompts without altering the underlying pre-trained model. Despite its growing prominence, the…

Cryptography and Security · Computer Science 2024-11-25 Jiani Zhu , Xi Lin , Yuxin Qi , Qinghua Mao

Federated learning (FL) allows the collaborative training of AI models without needing to share raw data. This capability makes it especially interesting for healthcare applications where patient and data privacy is of utmost concern.…

The idea of federated learning is to collaboratively train a neural network on a server. Each user receives the current weights of the network and in turns sends parameter updates (gradients) based on local data. This protocol has been…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Jonas Geiping , Hartmut Bauermeister , Hannah Dröge , Michael Moeller

Federated learning (FL) is a privacy-preserving machine learning framework that enables multiple nodes to train models on their local data and periodically average weight updates to benefit from other nodes' training. Each node's goal is to…

Machine Learning · Computer Science 2025-06-16 Ethan Wilson , Kai Yue , Chau-Wai Wong , Huaiyu Dai

Neural networks are often trained on proprietary datasets, making them attractive attack targets. We present a novel dataset extraction method leveraging an innovative training time backdoor attack, allowing a malicious federated learning…

Cryptography and Security · Computer Science 2025-12-19 Eden Luzon , Guy Amit , Roy Weiss , Torsten Kraub , Alexandra Dmitrienko , Yisroel Mirsky

With the mainstream integration of machine learning into security-sensitive domains such as healthcare and finance, concerns about data privacy have intensified. Conventional artificial neural networks (ANNs) have been found vulnerable to…

Cryptography and Security · Computer Science 2025-03-11 Hamed Poursiami , Ihsen Alouani , Maryam Parsa