English
Related papers

Related papers: You Autocomplete Me: Poisoning Vulnerabilities in …

200 papers

This paper proposes a novel, data-agnostic, model poisoning attack on Federated Learning (FL), by designing a new adversarial graph autoencoder (GAE)-based framework. The attack requires no knowledge of FL training data and achieves both…

Machine Learning · Computer Science 2023-12-01 Kai Li , Jingjing Zheng , Xin Yuan , Wei Ni , Ozgur B. Akan , H. Vincent Poor

This paper investigates the critical issue of data poisoning attacks on AI models, a growing concern in the ever-evolving landscape of artificial intelligence and cybersecurity. As advanced technology systems become increasingly prevalent…

Cryptography and Security · Computer Science 2025-03-13 Halima I. Kure , Pradipta Sarkar , Ahmed B. Ndanusa , Augustine O. Nwajana

Federated learning is known to be vulnerable to both security and privacy issues. Existing research has focused either on preventing poisoning attacks from users or on concealing the local model updates from the server, but not both.…

Machine Learning · Computer Science 2024-06-05 Truc Nguyen , My T. Thai

Graph Neural Networks (GNNs) have achieved remarkable results in various tasks. Recent studies reveal that graph backdoor attacks can poison the GNN model to predict test nodes with triggers attached as the target class. However, apart from…

Machine Learning · Computer Science 2026-04-15 Yuxiang Zhang , Bin Ma , Enyan Dai

Two widely used techniques for training supervised machine learning models on small datasets are Active Learning and Transfer Learning. The former helps to optimally use a limited budget to label new data. The latter uses large pre-trained…

Machine Learning · Computer Science 2021-01-28 Nicolas M. Müller , Konstantin Böttinger

Query auto-completion is a search engine feature whereby the system suggests completed queries as the user types. Recently, the use of a recurrent neural network language model was suggested as a method of generating query completions. We…

Computation and Language · Computer Science 2018-04-26 Aaron Jaech , Mari Ostendorf

Data poisoning and backdoor attacks manipulate training data in order to cause models to fail during inference. A recent survey of industry practitioners found that data poisoning is the number one concern among threats ranging from model…

Machine Learning · Computer Science 2021-06-18 Avi Schwarzschild , Micah Goldblum , Arjun Gupta , John P Dickerson , Tom Goldstein

Data poisoning and leakage risks impede the massive deployment of federated learning in the real world. This chapter reveals the truths and pitfalls of understanding two dominating threats: {\em training data privacy intrusion} and {\em…

Machine Learning · Computer Science 2024-09-23 Wenqi Wei , Tiansheng Huang , Zachary Yahn , Anoop Singhal , Margaret Loper , Ling Liu

Neural code models (NCMs) have demonstrated extraordinary capabilities in code intelligence tasks. Meanwhile, the security of NCMs and NCMs-based systems has garnered increasing attention. In particular, NCMs are often trained on…

Software Engineering · Computer Science 2025-02-25 Weisong Sun , Yuchen Chen , Mengzhe Yuan , Chunrong Fang , Zhenpeng Chen , Chong Wang , Yang Liu , Baowen Xu , Zhenyu Chen

Prompt injection attack, where an attacker injects a prompt into the original one, aiming to make an Large Language Model (LLM) follow the injected prompt to perform an attacker-chosen task, represent a critical security threat. Existing…

Cryptography and Security · Computer Science 2025-09-16 Zedian Shao , Hongbin Liu , Jaden Mu , Neil Zhenqiang Gong

Instruction-tuned Large Language Models designed for coding tasks are increasingly employed as AI coding assistants. However, the cybersecurity vulnerabilities and implications arising from the widespread integration of these models are not…

Cryptography and Security · Computer Science 2025-03-10 Md Imran Hossen , Sai Venkatesh Chilukoti , Liqun Shan , Sheng Chen , Yinzhi Cao , Xiali Hei

Imperceptible poisoning attacks on entire datasets have recently been touted as methods for protecting data privacy. However, among a number of defenses preventing the practical use of these techniques, early-stopping stands out as a…

Machine Learning · Computer Science 2022-04-20 Pedro Sandoval-Segura , Vasu Singla , Liam Fowl , Jonas Geiping , Micah Goldblum , David Jacobs , Tom Goldstein

Adversarial data poisoning is an effective attack against machine learning and threatens model integrity by introducing poisoned data into the training dataset. So far, it has been studied mostly for classification, even though regression…

Machine Learning · Computer Science 2020-09-16 Nicolas Michael Müller , Daniel Kowatsch , Konstantin Böttinger

We present a data poisoning attack -- Phantom Transfer -- with the property that, even if you know precisely how the poison was placed into an otherwise benign dataset, you cannot filter it out. We achieve this by modifying subliminal…

Cryptography and Security · Computer Science 2026-02-06 Andrew Draganov , Tolga H. Dur , Anandmayi Bhongade , Mary Phuong

The widespread availability of large-scale code datasets has accelerated the development of code large language models (CodeLLMs), raising concerns about unauthorized dataset usage. Dataset poisoning offers a proactive defense by reducing…

Cryptography and Security · Computer Science 2026-04-27 Yuan Xiao , Jiaming Wang , Yuchen Chen , Wei Song , Jun Sun , Shiqing Ma , Yanzhou Mu , Juan Zhai , Chunrong Fang , Jin Song Dong , Zhenyu Chen

Machine learning techniques have been widely applied to various applications. However, they are potentially vulnerable to data poisoning attacks, where sophisticated attackers can disrupt the learning procedure by injecting a fraction of…

Cryptography and Security · Computer Science 2021-05-11 Jian Chen , Xuxin Zhang , Rui Zhang , Chen Wang , Ling Liu

The lifecycle of large language models (LLMs) is far more complex than that of traditional machine learning models, involving multiple training stages, diverse data sources, and varied inference methods. While prior research on data…

Cryptography and Security · Computer Science 2025-02-21 Pengfei He , Yue Xing , Han Xu , Zhen Xiang , Jiliang Tang

These days, deep learning models have achieved great success in multiple fields, from autonomous driving to medical diagnosis. These models have expanded the abilities of artificial intelligence by offering great solutions to complex…

Cryptography and Security · Computer Science 2023-11-27 Gopichandh Golla

During fine-tuning, large language models (LLMs) are increasingly vulnerable to data-poisoning backdoor attacks, which compromise their reliability and trustworthiness. However, existing defense strategies suffer from limited…

Cryptography and Security · Computer Science 2025-10-13 Shuai Zhao , Xinyi Wu , Shiqian Zhao , Xiaobao Wu , Zhongliang Guo , Yanhao Jia , Anh Tuan Luu

Backdoors and poisoning attacks are a major threat to the security of machine-learning and vision systems. Often, however, these attacks leave visible artifacts in the images that can be visually detected and weaken the efficacy of the…

Cryptography and Security · Computer Science 2020-03-20 Erwin Quiring , Konrad Rieck