English
Related papers

Related papers: Token-Level Generalization in LoRA Adapter Backdoo…

200 papers

Training deep neural networks (DNNs) usually requires massive training data and computational resources. Users who cannot afford this may prefer to outsource training to a third party or resort to publicly available pre-trained models.…

Cryptography and Security · Computer Science 2023-02-27 Najeeb Moharram Jebreel , Josep Domingo-Ferrer , Yiming Li

In recent years, attention-based models have excelled across various domains but remain vulnerable to backdoor attacks, often from downloading or fine-tuning on poisoned datasets. Many current methods to mitigate backdoors in NLP models…

Cryptography and Security · Computer Science 2025-01-07 Yidong Ding , Jiafei Niu , Ping Yi

Reinforcement learning (RL) has achieved remarkable success across diverse domains, enabling autonomous systems to learn and adapt to dynamic environments by optimizing a reward function. However, this reliance on reward signals creates a…

Cryptography and Security · Computer Science 2025-12-01 Bokang Zhang , Chaojun Lu , Jianhui Li , Junfeng Wu

Reasoning models leverage inference-time compute to significantly enhance the performance of language models on difficult logical tasks, and have become a dominating paradigm in frontier LLMs. Despite their wide adoption, the mechanisms…

Machine Learning · Computer Science 2025-11-11 Jake Ward , Paul Riechers , Adam Shai

Reinforcement Learning with Verifiable Rewards (RLVR) is an emerging paradigm that significantly boosts a Large Language Model's (LLM's) reasoning abilities on complex logical tasks, such as mathematics and programming. However, we…

Cryptography and Security · Computer Science 2026-04-14 Weiyang Guo , Zesheng Shi , Zeen Zhu , Yuan Zhou , Min Zhang , Jing Li

Backdoor attacks change a small portion of training data by introducing hand-crafted triggers and rewiring the corresponding labels towards a desired target class. Training on such data injects a backdoor which causes malicious inference in…

Machine Learning · Computer Science 2024-09-05 Ivan Sabolić , Ivan Grubišić , Siniša Šegvić

Recent studies have revealed that deep neural networks (DNNs) are vulnerable to backdoor attacks, where attackers embed hidden backdoors in the DNN model by poisoning a few training samples. The attacked model behaves normally on benign…

Cryptography and Security · Computer Science 2022-02-09 Kunzhe Huang , Yiming Li , Baoyuan Wu , Zhan Qin , Kui Ren

Backdoor attacks pose a significant threat to Large Language Models (LLMs), where adversaries can embed hidden triggers to manipulate LLM's outputs. Most existing defense methods, primarily designed for classification tasks, are ineffective…

Cryptography and Security · Computer Science 2025-11-12 Zihan Wang , Rui Zhang , Hongwei Li , Wenshu Fan , Wenbo Jiang , Qingchuan Zhao , Guowen Xu

Learned index structures achieve high performance by modeling the cumulative distribution function (CDF) of keys, but this reliance on data distributions introduces potential vulnerability to adversarial manipulation. Prior work has…

Cryptography and Security · Computer Science 2026-04-29 Allen Jue

Self-supervised representation learning for point cloud has demonstrated effectiveness in improving pre-trained model performance across diverse tasks. However, as pre-trained models grow in complexity, fully fine-tuning them for downstream…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Song Wang , Xiaolu Liu , Lingdong Kong , Jianyun Xu , Chunyong Hu , Gongfan Fang , Wentong Li , Jianke Zhu , Xinchao Wang

Designing models that are robust to small adversarial perturbations of their inputs has proven remarkably difficult. In this work we show that the reverse problem---making models more vulnerable---is surprisingly easy. After presenting some…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Thomas Tanay , Jerone T. A. Andrews , Lewis D. Griffin

Deep Reinforcement Learning (DRL) systems are increasingly used in safety-critical applications, yet their security remains severely underexplored. This work investigates backdoor attacks, which implant hidden triggers that cause malicious…

Machine Learning · Computer Science 2025-07-08 Sanyam Vyas , Alberto Caron , Chris Hicks , Pete Burnap , Vasilios Mavroudis

Deep neural networks (DNNs) have shown unprecedented success in object detection tasks. However, it was also discovered that DNNs are vulnerable to multiple kinds of attacks, including Backdoor Attacks. Through the attack, the attacker…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Yize Cheng , Wenbin Hu , Minhao Cheng

AI control protocols serve as a defense mechanism to stop untrusted LLM agents from causing harm in autonomous settings. Prior work treats this as a security problem, stress testing with exploits that use the deployment context to subtly…

Low-rank adaptation (LoRA) is widely used for parameter-efficient fine-tuning, but its standard all-token, all-head design ignores the heterogeneous structure of vision language model (VLM) inputs. We introduce \emph{Image-LoRA}, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Tiange Luo , Lajanugen Logeswaran , Jaekyeom Kim , Justin Johnson , Honglak Lee

Reliable detection of speech deepfakes (spoofs) must remain effective when the distribution of spoofing attacks shifts. We frame the task as domain generalization and show that inserting Low-Rank Adaptation (LoRA) adapters into every…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-18 Janne Laakkonen , Ivan Kukanov , Ville Hautamäki

Early research into data poisoning attacks against Large Language Models (LLMs) demonstrated the ease with which backdoors could be injected. More recent LLMs add step-by-step reasoning, expanding the attack surface to include the…

Cryptography and Security · Computer Science 2025-09-09 Hanna Foerster , Ilia Shumailov , Yiren Zhao , Harsh Chaudhari , Jamie Hayes , Robert Mullins , Yarin Gal

Low-rank adaptation (LoRA) enables parameter efficient specialization of large language models (LLMs) through modular adapters, resulting in rapidly growing public adapter pools spanning diverse tasks. Effectively using these adapters…

Machine Learning · Computer Science 2026-02-02 Akash Dhasade , Anne-Marie Kermarrec , Igor Pavlovic , Diana Petrescu , Rafael Pires , Mathis Randl , Martijn de Vos

As collaborative learning allows joint training of a model using multiple sources of data, the security problem has been a central concern. Malicious users can upload poisoned data to prevent the model's convergence or inject hidden…

Cryptography and Security · Computer Science 2021-01-21 Ximing Qiao , Yuhua Bai , Siping Hu , Ang Li , Yiran Chen , Hai Li

Backdoor attacks can cause reinforcement learning (RL) policies to behave normally under clean inputs while executing malicious behaviors when triggers are present. Existing RL backdoor attacks are primarily studied in simulation and often…

Robotics · Computer Science 2026-05-14 Tairan Huang , Qingqing Ye , Yulin Jin , Jiawei Lian , Yaxin Xiao , Yi Wang , Haibo Hu