English
Related papers

Related papers: Associative Poisoning to Generative Machine Learni…

200 papers

While recent works have indicated that federated learning (FL) may be vulnerable to poisoning attacks by compromised clients, their real impact on production FL systems is not fully understood. In this work, we aim to develop a…

Machine Learning · Computer Science 2021-12-14 Virat Shejwalkar , Amir Houmansadr , Peter Kairouz , Daniel Ramage

Federated Learning (FL) is a distributed learning paradigm designed to address privacy concerns. However, FL is vulnerable to poisoning attacks, where Byzantine clients compromise the integrity of the global model by submitting malicious…

Cryptography and Security · Computer Science 2025-09-11 Ryan McGaughey , Jesus Martinez del Rincon , Ihsen Alouani

Sequential Recommenders, which exploit dynamic user intents through interaction sequences, is vulnerable to adversarial attacks. While existing attacks primarily rely on data poisoning, they require large-scale user access or fake profiles…

Machine Learning · Computer Science 2025-12-23 Jiajie Su , Zihan Nan , Yunshan Ma , Xiaobo Xia , Xiaohua Feng , Weiming Liu , Xiang Chen , Xiaolin Zheng , Chaochao Chen

A number of online services nowadays rely upon machine learning to extract valuable information from data collected in the wild. This exposes learning algorithms to the threat of data poisoning, i.e., a coordinate attack in which a fraction…

Generative artificial intelligence models show an amazing performance creating unique content automatically just by being given a prompt by the user, which is revolutionizing several fields such as marketing and design. Not only are there…

Computers and Society · Computer Science 2024-07-03 Adriana Fernández de Caleya Vázquez , Eduardo C. Garrido-Merchán

Diffusion models build a new milestone for image generation yet raising public concerns, for they can be fine-tuned on unauthorized images for customization. Protection based on adversarial attacks rises to encounter this unauthorized…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Boyang Zheng , Chumeng Liang , Xiaoyu Wu

Data poisoning attacks aim at manipulating model behaviors through distorting training data. Previously, an aggregation-based certified defense, Deep Partition Aggregation (DPA), was proposed to mitigate this threat. DPA predicts through an…

Machine Learning · Computer Science 2022-07-15 Wenxiao Wang , Alexander Levine , Soheil Feizi

The rapid advancement of generative AI highlights the importance of text-to-image (T2I) security, particularly with the threat of backdoor poisoning. Timely disclosure and mitigation of security vulnerabilities in T2I models are crucial for…

Cryptography and Security · Computer Science 2025-04-22 Chongye Guo , Jinhu Fu , Junfeng Fang , Kun Wang , Guorui Feng

Modern machine learning pipelines leverage large amounts of public data, making it infeasible to guarantee data quality and leaving models open to poisoning and backdoor attacks. Provably bounding model behavior under such attacks remains…

Machine Learning · Computer Science 2024-10-31 Philip Sosnin , Mark N. Müller , Maximilian Baader , Calvin Tsay , Matthew Wicker

Recent studies have revealed a security threat to natural language processing (NLP) models, called the Backdoor Attack. Victim models can maintain competitive performance on clean samples while behaving abnormally on samples with a specific…

Computation and Language · Computer Science 2021-03-30 Wenkai Yang , Lei Li , Zhiyuan Zhang , Xuancheng Ren , Xu Sun , Bin He

Diffusion-based text-to-image models have shown immense potential for various image-related tasks. However, despite their prominence and popularity, customizing these models using unauthorized data also brings serious privacy and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sen Peng , Jijia Yang , Mingyue Wang , Jianfei He , Xiaohua Jia

Generative models such as Large Language Models, Diffusion Models, and generative adversarial networks have recently revolutionized the creation of synthetic data, offering scalable solutions to data scarcity, privacy, and annotation…

Machine Learning · Computer Science 2025-08-28 Dawei Li , Yue Huang , Ming Li , Tianyi Zhou , Xiangliang Zhang , Huan Liu

We revisit the efficacy of several practical methods for approximate machine unlearning developed for large-scale deep learning. In addition to complying with data deletion requests, one often-cited potential application for unlearning…

Machine Learning · Computer Science 2026-01-16 Martin Pawelczyk , Jimmy Z. Di , Yiwei Lu , Gautam Kamath , Ayush Sekhari , Seth Neel

The rapid progress in generative models has resulted in impressive leaps in generation quality, blurring the lines between synthetic and real data. Web-scale datasets are now prone to the inevitable contamination by synthetic data, directly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Damien Ferbach , Quentin Bertrand , Avishek Joey Bose , Gauthier Gidel

Targeted data poisoning (TDP) aims to compromise the model's prediction on a specific (test) target by perturbing a small subset of training data. Existing work on TDP has focused on an overly ideal threat model in which the same image…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Zhizhen Chen , Zhengyu Zhao , Subrat Kishore Dutta , Chenhao Lin , Chao Shen , Xiao Zhang

Federated learning security research has predominantly focused on backdoor threats from a minority of malicious clients that intentionally corrupt model updates. This paper challenges this paradigm by investigating a more pervasive and…

Cryptography and Security · Computer Science 2026-02-18 Haodong Zhao , Jinming Hu , Gongshen Liu

We present a data poisoning attack -- Phantom Transfer -- with the property that, even if you know precisely how the poison was placed into an otherwise benign dataset, you cannot filter it out. We achieve this by modifying subliminal…

Cryptography and Security · Computer Science 2026-02-06 Andrew Draganov , Tolga H. Dur , Anandmayi Bhongade , Mary Phuong

Emerging technologies drive the ongoing transformation of Intelligent Transportation Systems (ITS). This transformation has given rise to cybersecurity concerns, among which data poisoning attack emerges as a new threat as ITS increasingly…

Cryptography and Security · Computer Science 2024-07-24 Feilong Wang , Xin Wang , Xuegang Ban

Due to respectively limited training data, different entities addressing the same vision task based on certain sensitive images may not train a robust deep network. This paper introduces a new vision task where various entities share…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Hao Guo , Brian Dolhansky , Eric Hsin , Phong Dinh , Cristian Canton Ferrer , Song Wang

What happens when generative machine learning models are pretrained on web-scale datasets containing data generated by earlier models? Some prior work warns of "model collapse" as the web is overwhelmed by synthetic data; other work…

Machine Learning · Computer Science 2025-03-19 Joshua Kazdan , Rylan Schaeffer , Apratim Dey , Matthias Gerstgrasser , Rafael Rafailov , David L. Donoho , Sanmi Koyejo