English
Related papers

Related papers: Property Inference From Poisoning

200 papers

Deep neural networks are vulnerable to backdoor attacks, a type of adversarial attack that poisons the training data to manipulate the behavior of models trained on such data. Clean-label attacks are a more stealthy form of backdoor attacks…

Machine Learning · Computer Science 2024-07-17 Quang H. Nguyen , Nguyen Ngoc-Hieu , The-Anh Ta , Thanh Nguyen-Tang , Kok-Seng Wong , Hoang Thanh-Tung , Khoa D. Doan

Deep learning models for time series imputation are now essential in fields such as healthcare, the Internet of Things (IoT), and finance. However, their deployment raises critical privacy concerns. Beyond the well-known issue of unintended…

Machine Learning · Computer Science 2026-03-26 Faiz Taleb , Ivan Gazeau , Maryline Laurent

The right to erasure requires removal of a user's information from data held by organizations, with rigorous interpretations extending to downstream products such as learned models. Retraining from scratch with the particular user's data…

Machine Learning · Computer Science 2022-02-11 Neil G. Marchant , Benjamin I. P. Rubinstein , Scott Alfeld

The growing reliance of intelligent systems on data makes the systems vulnerable to data poisoning attacks. Such attacks could compromise machine learning or deep learning models by disrupting the input data. Previous studies on data…

Optimization and Control · Mathematics 2025-05-19 Xin Wang , Feilong Wang , Yuan Hong , R. Tyrrell Rockafellar , Xuegang , Ban

Machine learning (ML) models are proving to be vulnerable to a variety of attacks that allow the adversary to learn sensitive information, cause mispredictions, and more. While these attacks have been extensively studied, current research…

Cryptography and Security · Computer Science 2025-06-24 Yugeng Liu , Zheng Li , Hai Huang , Michael Backes , Yang Zhang

Imperceptible poisoning attacks on entire datasets have recently been touted as methods for protecting data privacy. However, among a number of defenses preventing the practical use of these techniques, early-stopping stands out as a…

Machine Learning · Computer Science 2022-04-20 Pedro Sandoval-Segura , Vasu Singla , Liam Fowl , Jonas Geiping , Micah Goldblum , David Jacobs , Tom Goldstein

Data poisoning considers cases when an adversary manipulates the behavior of machine learning algorithms through malicious training data. Existing threat models of data poisoning center around a single metric, the number of poisoned…

Machine Learning · Computer Science 2023-12-08 Wenxiao Wang , Soheil Feizi

Data poisoning for reinforcement learning has historically focused on general performance degradation, and targeted attacks have been successful via perturbations that involve control of the victim's policy and rewards. We introduce an…

Machine Learning · Computer Science 2022-07-29 Harrison Foley , Liam Fowl , Tom Goldstein , Gavin Taylor

Recent studies have revealed a security threat to natural language processing (NLP) models, called the Backdoor Attack. Victim models can maintain competitive performance on clean samples while behaving abnormally on samples with a specific…

Computation and Language · Computer Science 2021-03-30 Wenkai Yang , Lei Li , Zhiyuan Zhang , Xuancheng Ren , Xu Sun , Bin He

Adversarial attacks such as poisoning attacks have attracted the attention of many machine learning researchers. Traditionally, poisoning attacks attempt to inject adversarial training data in order to manipulate the trained model. In…

Machine Learning · Computer Science 2025-03-26 Ali Raza , Shujun Li , Kim-Phuc Tran , Ludovic Koehl , Kim Duc Tran

Adversarial poisoning attacks pose huge threats to various machine learning applications. Especially, the recent accumulative poisoning attacks show that it is possible to achieve irreparable harm on models via a sequence of imperceptible…

Machine Learning · Computer Science 2023-06-07 Jianing Zhu , Xiawei Guo , Jiangchao Yao , Chao Du , Li He , Shuo Yuan , Tongliang Liu , Liang Wang , Bo Han

With an increase in low-cost machine learning APIs, advanced machine learning models may be trained on private datasets and monetized by providing them as a service. However, privacy researchers have demonstrated that these models may leak…

Neural networks are susceptible to data inference attacks such as the model inversion attack and the membership inference attack, where the attacker could infer the reconstruction and the membership of a data sample from the confidence…

Cryptography and Security · Computer Science 2020-08-21 Ziqi Yang , Bin Shao , Bohan Xuan , Ee-Chien Chang , Fan Zhang

Collaborative machine learning and related techniques such as federated learning allow multiple participants, each with his own training dataset, to build a joint model by training locally and periodically exchanging model updates. We…

Cryptography and Security · Computer Science 2018-11-02 Luca Melis , Congzheng Song , Emiliano De Cristofaro , Vitaly Shmatikov

This paper examines the robustness of deployed few-shot meta-learning systems when they are fed an imperceptibly perturbed few-shot dataset. We attack amortized meta-learners, which allows us to craft colluding sets of inputs that are…

Machine Learning · Computer Science 2022-11-24 Elre T. Oldewage , John Bronskill , Richard E. Turner

The growing dependence on machine learning in real-world applications emphasizes the importance of understanding and ensuring its safety. Backdoor attacks pose a significant security risk due to their stealthy nature and potentially serious…

Cryptography and Security · Computer Science 2023-10-19 Ganghua Wang , Xun Xian , Jayanth Srinivasa , Ashish Kundu , Xuan Bi , Mingyi Hong , Jie Ding

Fair machine learning seeks to mitigate model prediction bias against certain demographic subgroups such as elder and female. Recently, fair representation learning (FRL) trained by deep neural networks has demonstrated superior…

Machine Learning · Computer Science 2024-03-06 Tianci Liu , Haoyu Wang , Feijie Wu , Hengtong Zhang , Pan Li , Lu Su , Jing Gao

Recently, diffusion models have become popular tools for image synthesis because of their high-quality outputs. However, like other large-scale models, they may leak private information about their training data. Here, we demonstrate a…

Machine Learning · Computer Science 2023-12-11 Shuai Tang , Zhiwei Steven Wu , Sergul Aydore , Michael Kearns , Aaron Roth

In this work, we demonstrate universal multi-party poisoning attacks that adapt and apply to any multi-party learning process with arbitrary interaction pattern between the parties. More generally, we introduce and study $(k,p)$-poisoning…

Machine Learning · Computer Science 2021-11-11 Saeed Mahloujifar , Mohammad Mahmoody , Ameer Mohammed

Deep learning has become a cornerstone of modern artificial intelligence, enabling transformative applications across a wide range of domains. As the core element of deep learning, the quality and security of training data critically…

Cryptography and Security · Computer Science 2025-04-01 Pinlong Zhao , Weiyao Zhu , Pengfei Jiao , Di Gao , Ou Wu