English
Related papers

Related papers: TrojanPuzzle: Covertly Poisoning Code-Suggestion M…

200 papers

Recent years have witnessed the emergence of a new paradigm of building natural language processing (NLP) systems: general-purpose, pre-trained language models (LMs) are composed with simple downstream models and fine-tuned for a variety of…

Cryptography and Security · Computer Science 2021-03-12 Xinyang Zhang , Zheng Zhang , Shouling Ji , Ting Wang

We present a Trojan (backdoor or trapdoor) attack that targets deep learning applications in wireless communications. A deep learning classifier is considered to classify wireless signals using raw (I/Q) samples as features and modulation…

Networking and Internet Architecture · Computer Science 2019-10-25 Kemal Davaslioglu , Yalin E. Sagduyu

Test-time personalization in federated learning enables models at clients to adjust online to local domain shifts, enhancing robustness and personalization in deployment. Yet, existing federated learning work largely overlooks the security…

Cryptography and Security · Computer Science 2025-11-25 Md Akil Raihan Iftee , Syed Md. Ahnaf Hasan , Amin Ahsan Ali , AKM Mahbubur Rahman , Sajib Mistry , Aneesh Krishna

As large language models (LLMs) are increasingly fine-tuned for hardware tasks like RTL code generation, the scarcity of high-quality datasets often leads to the use of rapidly assembled or generated training data. These datasets frequently…

Cryptography and Security · Computer Science 2026-05-01 Mahshid Rezakhani , Nowfel Mashnoor , Kimia Azar , Hadi Kamali

Large-scale language models have achieved tremendous success across various natural language processing (NLP) applications. Nevertheless, language models are vulnerable to backdoor attacks, which inject stealthy triggers into models for…

Cryptography and Security · Computer Science 2023-02-09 Yujin Huang , Terry Yue Zhuo , Qiongkai Xu , Han Hu , Xingliang Yuan , Chunyang Chen

Deep learning models have recently shown to be vulnerable to backdoor poisoning, an insidious attack where the victim model predicts clean images correctly but classifies the same images as the target class when a trigger poison pattern is…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Alvin Chan , Yew-Soon Ong

Deep neural networks are being widely deployed for many critical tasks due to their high classification accuracy. In many cases, pre-trained models are sourced from vendors who may have disrupted the training pipeline to insert Trojan…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Xiaoyu Zhang , Ajmal Mian , Rohit Gupta , Nazanin Rahnavard , Mubarak Shah

The proliferation of pre-trained models (PTMs) and datasets has led to the emergence of centralized model hubs like Hugging Face, which facilitate collaborative development and reuse. However, recent security reports have uncovered…

Cryptography and Security · Computer Science 2024-09-17 Jian Zhao , Shenao Wang , Yanjie Zhao , Xinyi Hou , Kailong Wang , Peiming Gao , Yuanchao Zhang , Chen Wei , Haoyu Wang

Trojan backdoors can be injected into large language models at various stages, including pretraining, fine-tuning, and in-context learning, posing a significant threat to the model's alignment. Due to the nature of causal language modeling,…

Computation and Language · Computer Science 2025-01-22 Vedant Bhasin , Matthew Yudin , Razvan Stefanescu , Rauf Izmailov

Modern machine learning increasingly requires training on a large collection of data from multiple sources, not all of which can be trusted. A particularly concerning scenario is when a small fraction of poisoned data changes the behavior…

Machine Learning · Computer Science 2021-04-26 Jonathan Hayase , Weihao Kong , Raghav Somani , Sewoong Oh

Various attack methods against recommender systems have been proposed in the past years, and the security issues of recommender systems have drawn considerable attention. Traditional attacks attempt to make target items recommended to as…

Information Retrieval · Computer Science 2025-11-11 Dazhong Rong , Qinming He , Jianhai Chen

Federated learning allows multiple clients to collaboratively train a global model with the assistance of a server. However, its distributed nature makes it susceptible to poisoning attacks, where malicious clients can compromise the global…

Cryptography and Security · Computer Science 2025-01-30 Wenbin Wang , Qiwen Ma , Zifan Zhang , Yuchen Liu , Zhuqing Liu , Minghong Fang

Backdoor attacks pose a new threat to NLP models. A standard strategy to construct poisoned data in backdoor attacks is to insert triggers (e.g., rare words) into selected sentences and alter the original label to a target label. This…

Computation and Language · Computer Science 2022-04-28 Leilei Gan , Jiwei Li , Tianwei Zhang , Xiaoya Li , Yuxian Meng , Fei Wu , Yi Yang , Shangwei Guo , Chun Fan

Backdoor attacks are emerging threats to deep neural networks, which typically embed malicious behaviors into a victim model by injecting poisoned samples. Adversaries can activate the injected backdoor during inference by presenting the…

Cryptography and Security · Computer Science 2025-12-05 Bingyin Zhao , Yingjie Lao

Indiscriminate data poisoning attacks aim to decrease a model's test accuracy by injecting a small amount of corrupted training data. Despite significant interest, existing attacks remain relatively ineffective against modern machine…

Machine Learning · Computer Science 2023-06-07 Yiwei Lu , Gautam Kamath , Yaoliang Yu

Training machine learning models can be very expensive or even unaffordable. This may be, for example, due to data limitations, such as unavailability or being too large, or computational power limitations. Therefore, it is a common…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Mohamed E. Hussein , Sudharshan Subramaniam Janakiraman , Wael AbdAlmageed

Large language models (LLMs) are becoming an integrated part of software development. These models are trained on large datasets for code, where it is hard to verify each data point. Therefore, a potential attack surface can be to inject…

Software Engineering · Computer Science 2023-12-12 Aftab Hussain , Md Rafiqul Islam Rabin , Toufique Ahmed , Mohammad Amin Alipour , Bowen Xu

Pre-trained programming language (PL) models (such as CodeT5, CodeBERT, GraphCodeBERT, etc.,) have the potential to automate software engineering tasks involving code understanding and code generation. However, these models operate in the…

Computation and Language · Computer Science 2023-04-20 Akshita Jha , Chandan K. Reddy

Early research into data poisoning attacks against Large Language Models (LLMs) demonstrated the ease with which backdoors could be injected. More recent LLMs add step-by-step reasoning, expanding the attack surface to include the…

Cryptography and Security · Computer Science 2025-09-09 Hanna Foerster , Ilia Shumailov , Yiren Zhao , Harsh Chaudhari , Jamie Hayes , Robert Mullins , Yarin Gal

Model poisoning attacks pose a significant security threat to Federated Learning (FL). Most existing model poisoning attacks rely on collusion, requiring adversarial clients to coordinate by exchanging local benign models and synchronizing…

Cryptography and Security · Computer Science 2026-04-13 Israt Jahan Mouri , Muhammad Ridowan , Muhammad Abdullah Adnan