English
Related papers

Related papers: Scalable Membership Inference Attacks via Quantile…

200 papers

Machine learning (ML) models have been shown to be vulnerable to Membership Inference Attacks (MIA), which infer the membership of a given data point in the target dataset by observing the prediction output of the ML model. While the key…

Machine Learning · Computer Science 2020-07-28 Shakila Mahjabin Tonni , Dinusha Vatsalan , Farhad Farokhi , Dali Kaafar , Zhigang Lu , Gioacchino Tangari

Federated Learning enables collaborative training of a global model across multiple geographically dispersed clients without the need for data sharing. However, it is susceptible to inference attacks, particularly label inference attacks.…

Machine Learning · Computer Science 2025-05-01 Zhixuan Ma , Haichang Gao , Junxiang Huang , Ping Wang

Machine learning has seen tremendous advances in the past few years, which has lead to deep learning models being deployed in varied applications of day-to-day life. Attacks on such models using perturbations, particularly in real-life…

Machine Learning · Computer Science 2020-02-10 Siddhant Bhambri , Sumanyu Muku , Avinash Tulasi , Arun Balaji Buduru

Multitask learning (MTL) has emerged as a powerful paradigm that leverages similarities among multiple learning tasks, each with insufficient samples to train a standalone model, to solve them simultaneously while minimizing data sharing…

Machine Learning · Computer Science 2025-06-23 John Abascal , Nicolás Berrios , Alina Oprea , Jonathan Ullman , Adam Smith , Matthew Jagielski

Black-box adversarial attack has attracted a lot of research interests for its practical use in AI safety. Compared with the white-box attack, a black-box setting is more difficult for less available information related to the attacked…

Machine Learning · Computer Science 2020-09-02 Linjun Zhou , Peng Cui , Yinan Jiang , Shiqiang Yang

Deep Neural Network (DNN) models have been shown to have high empirical privacy leakages. Clinical language models (CLMs) trained on clinical data have been used to improve performance in biomedical natural language processing tasks. In…

Computation and Language · Computer Science 2021-04-20 Abhyuday Jagannatha , Bhanu Pratap Singh Rawat , Hong Yu

Despite our best efforts, deep learning models remain highly vulnerable to even tiny adversarial perturbations applied to the inputs. The ability to extract information from solely the output of a machine learning model to craft adversarial…

Machine Learning · Computer Science 2023-03-27 Viet Quoc Vo , Ehsan Abbasnejad , Damith C. Ranasinghe

The increasing reliance on diffusion models for generating synthetic images has amplified concerns about the unauthorized use of personal data, particularly facial images, in model training. In this paper, we introduce a novel identity…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jayneel Vora , Aditya Krishnan , Nader Bouacida , Prabhu RV Shankar , Prasant Mohapatra

Graph Neural Networks (GNNs), which generalize traditional deep neural networks on graph data, have achieved state-of-the-art performance on several graph analytical tasks. We focus on how trained GNN models could leak information about the…

Machine Learning · Computer Science 2021-12-21 Iyiola E. Olatunji , Wolfgang Nejdl , Megha Khosla

In Member Inference (MI) attacks, the adversary try to determine whether an instance is used to train a machine learning (ML) model. MI attacks are a major privacy concern when using private data to train ML models. Most MI attacks in the…

Cryptography and Security · Computer Science 2024-05-30 Jiacheng Li , Ninghui Li , Bruno Ribeiro

Membership inference attacks (MIAs) are used to test practical privacy of machine learning models. MIAs complement formal guarantees from differential privacy (DP) under a more realistic adversary model. We analyse MIA vulnerability of…

Cryptography and Security · Computer Science 2026-02-03 Marlon Tobaben , Hibiki Ito , Joonas Jälkö , Yuan He , Antti Honkela

Neural networks are susceptible to data inference attacks such as the model inversion attack and the membership inference attack, where the attacker could infer the reconstruction and the membership of a data sample from the confidence…

Cryptography and Security · Computer Science 2020-08-21 Ziqi Yang , Bin Shao , Bohan Xuan , Ee-Chien Chang , Fan Zhang

Diffusion models have achieved remarkable progress in image generation, but their increasing deployment raises serious concerns about privacy. In particular, fine-tuned models are highly vulnerable, as they are often fine-tuned on small and…

Cryptography and Security · Computer Science 2026-01-30 Puwei Lian , Yujun Cai , Songze Li , Bingkun Bao

Diffusion models have begun to overshadow GANs and other generative models in industrial applications due to their superior image generation performance. The complex architecture of these models furnishes an extensive array of attack…

Cryptography and Security · Computer Science 2025-07-08 Yan Pang , Tianhao Wang , Xuhui Kang , Mengdi Huai , Yang Zhang

As real-world images come in varying sizes, the machine learning model is part of a larger system that includes an upstream image scaling algorithm. In this paper, we investigate the interplay between vulnerabilities of the image scaling…

Machine Learning · Computer Science 2022-06-22 Yue Gao , Ilia Shumailov , Kassem Fawaz

In the scenario of black-box adversarial attack, the target model's parameters are unknown, and the attacker aims to find a successful adversarial perturbation based on query feedback under a query budget. Due to the limited feedback…

Machine Learning · Computer Science 2023-01-03 Fei Yin , Yong Zhang , Baoyuan Wu , Yan Feng , Jingyi Zhang , Yanbo Fan , Yujiu Yang

Data-trained predictive models see widespread use, but for the most part they are used as black boxes which output a prediction or score. It is therefore hard to acquire a deeper understanding of model behavior, and in particular how…

In this paper, we present a generic, query-efficient black-box attack against API call-based machine learning malware classifiers. We generate adversarial examples by modifying the malware's API call sequences and non-sequential features…

Cryptography and Security · Computer Science 2020-10-06 Ishai Rosenberg , Asaf Shabtai , Yuval Elovici , Lior Rokach

The high cost of model training makes it increasingly desirable to develop techniques for unlearning. These techniques seek to remove the influence of a training example without having to retrain the model from scratch. Intuitively, once a…

Machine Learning · Computer Science 2024-05-22 Jamie Hayes , Ilia Shumailov , Eleni Triantafillou , Amr Khalifa , Nicolas Papernot

Property inference attacks consider an adversary who has access to the trained model and tries to extract some global statistics of the training data. In this work, we study property inference in scenarios where the adversary can…

Machine Learning · Computer Science 2021-01-28 Melissa Chase , Esha Ghosh , Saeed Mahloujifar