English
Related papers

Related papers: From Trojan Horses to Castle Walls: Unveiling Bila…

200 papers

There is growing concern over the safety of powerful diffusion models (DMs), as they are often misused to produce inappropriate, not-safe-for-work (NSFW) content or generate copyrighted material or data of individuals who wish to be…

Artificial Intelligence · Computer Science 2026-02-24 Mingyu Kim , Dongjun Kim , Amman Yusuf , Stefano Ermon , Mijung Park

Today's text-to-image generative models are trained on millions of images sourced from the Internet, each paired with a detailed caption produced by Vision-Language Models (VLMs). This part of the training pipeline is critical for supplying…

Cryptography and Security · Computer Science 2025-06-30 Stanley Wu , Ronik Bhaskar , Anna Yoo Jeong Ha , Shawn Shan , Haitao Zheng , Ben Y. Zhao

Poisoning attacks can compromise the safety of large language models (LLMs) by injecting malicious documents into their training data. Existing work has studied pretraining poisoning assuming adversaries control a percentage of the training…

Counterfactual explanations are a widely used approach for examining the predictions of black-box systems. They can offer the opportunity for computational recourse by suggesting actionable changes on how to alter the input to obtain a…

Machine Learning · Computer Science 2025-07-29 André Artelt , Shubham Sharma , Freddy Lecué , Barbara Hammer

Recent studies have proven that deep neural networks are vulnerable to backdoor attacks. Specifically, by mixing a small number of poisoned samples into the training set, the behavior of the trained model can be maliciously controlled.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Pengfei Xia , Ziqiang Li , Wei Zhang , Bin Li

Dataset distillation offers a potential means to enhance data efficiency in deep learning. Recent studies have shown its ability to counteract backdoor risks present in original training samples. In this study, we delve into the theoretical…

Machine Learning · Computer Science 2025-06-03 Ming-Yu Chung , Sheng-Yen Chou , Chia-Mu Yu , Pin-Yu Chen , Sy-Yen Kuo , Tsung-Yi Ho

The growing reliance of intelligent systems on data makes the systems vulnerable to data poisoning attacks. Such attacks could compromise machine learning or deep learning models by disrupting the input data. Previous studies on data…

Optimization and Control · Mathematics 2025-05-19 Xin Wang , Feilong Wang , Yuan Hong , R. Tyrrell Rockafellar , Xuegang , Ban

Deep learning has become a cornerstone of modern artificial intelligence, enabling transformative applications across a wide range of domains. As the core element of deep learning, the quality and security of training data critically…

Cryptography and Security · Computer Science 2025-04-01 Pinlong Zhao , Weiyao Zhu , Pengfei Jiao , Di Gao , Ou Wu

Machine learning systems are deployed in critical settings, but they might fail in unexpected ways, impacting the accuracy of their predictions. Poisoning attacks against machine learning induce adversarial modification of data used by a…

Machine Learning · Computer Science 2021-05-13 Matthew Jagielski , Giorgio Severi , Niklas Pousette Harger , Alina Oprea

Deep learning models have recently shown to be vulnerable to backdoor poisoning, an insidious attack where the victim model predicts clean images correctly but classifies the same images as the target class when a trigger poison pattern is…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Alvin Chan , Yew-Soon Ong

As in-the-wild data are increasingly involved in the training stage, machine learning applications become more susceptible to data poisoning attacks. Such attacks typically lead to test-time accuracy degradation or controlled misprediction.…

Cryptography and Security · Computer Science 2022-11-02 Yufei Chen , Chao Shen , Yun Shen , Cong Wang , Yang Zhang

Two widely used techniques for training supervised machine learning models on small datasets are Active Learning and Transfer Learning. The former helps to optimally use a limited budget to label new data. The latter uses large pre-trained…

Machine Learning · Computer Science 2021-01-28 Nicolas M. Müller , Konstantin Böttinger

Federated Learning systems are increasingly subjected to a multitude of model poisoning attacks from clients. Among these, edge-case attacks that target a small fraction of the input space are nearly impossible to detect using existing…

Machine Learning · Computer Science 2024-08-15 Kiran Purohit , Soumi Das , Sourangshu Bhattacharya , Santu Rana

This demo paper examines the susceptibility of Federated Learning (FL) systems to targeted data poisoning attacks, presenting a novel system for visualizing and mitigating such threats. We simulate targeted data poisoning attacks via label…

Cryptography and Security · Computer Science 2024-05-28 Xueqing Zhang , Junkai Zhang , Ka-Ho Chow , Juntao Chen , Ying Mao , Mohamed Rahouti , Xiang Li , Yuchen Liu , Wenqi Wei

Dataset bias is a problem in adversarial machine learning, especially in the evaluation of defenses. An adversarial attack or defense algorithm may show better results on the reported dataset than can be replicated on other datasets. Even…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Camilo Pestana , Wei Liu , David Glance , Ajmal Mian

In a federated learning (FL) system, distributed clients upload their local models to a central server to aggregate into a global model. Malicious clients may plant backdoors into the global model through uploading poisoned local models,…

Machine Learning · Computer Science 2023-05-26 Yanbo Dai , Songze Li

Fair machine learning seeks to mitigate model prediction bias against certain demographic subgroups such as elder and female. Recently, fair representation learning (FRL) trained by deep neural networks has demonstrated superior…

Machine Learning · Computer Science 2024-03-06 Tianci Liu , Haoyu Wang , Feijie Wu , Hengtong Zhang , Pan Li , Lu Su , Jing Gao

Model inversion attacks pose a significant privacy threat to machine learning models by reconstructing sensitive data from their outputs. While various defenses have been proposed to counteract these attacks, they often come at the cost of…

Cryptography and Security · Computer Science 2024-12-11 Shuai Zhou , Dayong Ye , Tianqing Zhu , Wanlei Zhou

Text-to-image (T2I) diffusion models (DMs) have shown promise in generating high-quality images from textual descriptions. The real-world applications of these models require particular attention to their safety and fidelity, but this has…

Cryptography and Security · Computer Science 2023-06-26 Hongcheng Gao , Hao Zhang , Yinpeng Dong , Zhijie Deng

Deep neural networks (DNNs) have achieved tremendous success in many tasks of machine learning, such as the image classification. Unfortunately, researchers have shown that DNNs are easily attacked by adversarial examples, slightly…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Yujia Liu , Weiming Zhang , Shaohua Li , Nenghai Yu