English
Related papers

Related papers: Sharpness-Aware Poisoning: Enhancing Transferabili…

200 papers

Adversarial examples generated from surrogate models often possess the ability to deceive other black-box models, a property known as transferability. Recent research has focused on enhancing adversarial transferability, with input…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Tao Wang , Zijian Ying , Qianmu Li , zhichao Lian

Poisoning attacks are a primary threat to machine learning models, aiming to compromise their performance and reliability by manipulating training datasets. This paper introduces a novel attack - Outlier-Oriented Poisoning (OOP) attack,…

Machine Learning · Computer Science 2024-11-04 Anum Paracha , Junaid Arshad , Mohamed Ben Farah , Khalid Ismail

Predictions of certifiably robust classifiers remain constant in a neighborhood of a point, making them resilient to test-time attacks with a guarantee. In this work, we present a previously unrecognized threat to robust machine learning…

Machine Learning · Computer Science 2021-03-31 Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Jihun Hamm

Both fair machine learning and adversarial learning have been extensively studied. However, attacking fair machine learning models has received less attention. In this paper, we present a framework that seeks to effectively generate…

Machine Learning · Computer Science 2021-10-19 Minh-Hao Van , Wei Du , Xintao Wu , Aidong Lu

This study investigates the privacy risks associated with text embeddings, focusing on the scenario where attackers cannot access the original embedding model. Contrary to previous research requiring direct model access, we explore a more…

Cryptography and Security · Computer Science 2025-01-15 Yu-Hsiang Huang , Yuche Tsai , Hsiang Hsiao , Hong-Yi Lin , Shou-De Lin

The black-box adversarial attack has attracted impressive attention for its practical use in the field of deep learning security. Meanwhile, it is very challenging as there is no access to the network architecture or internal weights of the…

Machine Learning · Computer Science 2022-04-26 Yifeng Xiong , Jiadong Lin , Min Zhang , John E. Hopcroft , Kun He

Federated learning is vulnerable to poisoning attacks in which malicious clients poison the global model via sending malicious model updates to the server. Existing defenses focus on preventing a small number of malicious clients from…

Cryptography and Security · Computer Science 2022-10-21 Xiaoyu Cao , Jinyuan Jia , Zaixi Zhang , Neil Zhenqiang Gong

Surrogate-based black-box attacks have exposed the heightened vulnerability of DNNs. These attacks are designed to craft adversarial examples for any samples with black-box target feedback for only a given set of samples. State-of-the-art…

Machine Learning · Computer Science 2024-02-07 Raha Moraffah , Huan Liu

Reinforcement learning agents are susceptible to evasion attacks during deployment. In single-agent environments, these attacks can occur through imperceptible perturbations injected into the inputs of the victim policy network. In…

Machine Learning · Computer Science 2024-04-29 Xiang Zheng , Xingjun Ma , Shengjie Wang , Xinyu Wang , Chao Shen , Cong Wang

Backdoor attacks have been shown to impose severe threats to real security-critical scenarios. Although previous works can achieve high attack success rates, they either require access to victim models which may significantly reduce their…

Cryptography and Security · Computer Science 2024-03-21 Jingke Zhao , Zan Wang , Yongwei Wang , Lanjun Wang

Deep learning-based person re-identification (Re-ID) has made great progress and achieved high performance recently. In this paper, we make the first attempt to examine the vulnerability of current person Re-ID models against a dangerous…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Wenjie Ding , Xing Wei , Rongrong Ji , Xiaopeng Hong , Qi Tian , Yihong Gong

Recently, backdoor attacks have posed a serious security threat to the training process of deep neural networks (DNNs). The attacked model behaves normally on benign samples but outputs a specific result when the trigger is present.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Zixuan Zhu , Rui Wang , Cong Zou , Lihua Jing

Memory-augmented large language model (LLM) agents use iterative reflection and self-evolution to solve complex tasks, but these mechanisms introduce security risks. Existing agentic memory attacks require privileged access or explicit…

Cryptography and Security · Computer Science 2026-05-20 Kaixiang Wang , Jiong Lou , Zhaojiacheng Zhou , Jie Li

Online recommendation systems make use of a variety of information sources to provide users the items that users are potentially interested in. However, due to the openness of the online platform, recommendation systems are vulnerable to…

Cryptography and Security · Computer Science 2020-04-09 Hengtong Zhang , Yaliang Li , Bolin Ding , Jing Gao

By injecting a small number of poisoned samples into the training set, backdoor attacks aim to make the victim model produce designed outputs on any input injected with pre-designed backdoors. In order to achieve a high attack success rate…

Cryptography and Security · Computer Science 2024-07-23 Minlong Peng , Zidi Xiong , Quang H. Nguyen , Mingming Sun , Khoa D. Doan , Ping Li

Local differential privacy (LDP) involves users perturbing their inputs to provide plausible deniability of their data. However, this also makes LDP vulnerable to poisoning attacks. In this paper, we first introduce novel poisoning attacks…

Cryptography and Security · Computer Science 2025-07-01 Pei Zhan , Peng Tang , Yangzhuo Li , Puwen Wei , Shanqing Guo

Recent results suggest that attacks against supervised machine learning systems are quite effective, while defenses are easily bypassed by new attacks. However, the specifications for machine learning systems currently lack precise…

Cryptography and Security · Computer Science 2019-03-11 Octavian Suciu , Radu Mărginean , Yiğitcan Kaya , Hal Daumé , Tudor Dumitraş

The purpose of anonymizing structured data is to protect the privacy of individuals in the data while retaining the statistical properties of the data. An important class of attack on anonymized data is attribute inference, where an…

Cryptography and Security · Computer Science 2025-07-03 Paul Francis , David Wagner

Gray-box graph attacks aim at disrupting the performance of the victim model by using inconspicuous attacks with limited knowledge of the victim model. The parameters of the victim model and the labels of the test nodes are invisible to the…

Artificial Intelligence · Computer Science 2022-02-23 Zihan Liu , Yun Luo , Zelin Zang , Stan Z. Li

Transfer-based adversarial attacks can evaluate model robustness in the black-box setting. Several methods have demonstrated impressive untargeted transferability, however, it is still challenging to efficiently produce targeted…

Machine Learning · Computer Science 2022-07-25 Xiao Yang , Yinpeng Dong , Tianyu Pang , Hang Su , Jun Zhu