English
Related papers

Related papers: SBFA: Single Sneaky Bit Flip Attack to Break Large…

200 papers

Ensuring awareness of fairness and privacy in Large Language Models (LLMs) is critical. Interestingly, we discover a counter-intuitive trade-off phenomenon that enhancing an LLM's privacy awareness through Supervised Fine-Tuning (SFT)…

Artificial Intelligence · Computer Science 2025-06-04 Chen Qian , Dongrui Liu , Jie Zhang , Yong Liu , Jing Shao

As large language models (LLMs) gain popularity, their vulnerability to adversarial attacks emerges as a primary concern. While fine-tuning models on domain-specific datasets is often employed to improve model performance, it can…

Computation and Language · Computer Science 2026-02-24 Punya Syon Pandey , Samuel Simko , Kellin Pelrine , Zhijing Jin

Large vision-language models (LVLMs) have achieved impressive performance across a wide range of vision-language tasks, while they remain vulnerable to backdoor attacks. Existing backdoor attacks on LVLMs aim to force the victim model to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zhifang Zhang , Qiqi Tao , Jiaqi Lv , Na Zhao , Lei Feng , Joey Tianyi Zhou

To reduce the resource demand of neural network (NN) inference systems, it has been proposed to use approximate memory, in which the supply voltage and the timing parameters are tuned trading accuracy with energy consumption and…

Recent studies have uncovered a troubling vulnerability in the fine-tuning stage of large language models (LLMs): even fine-tuning on entirely benign datasets can lead to a significant increase in the harmfulness of LLM outputs. Building on…

Machine Learning · Computer Science 2025-05-27 Zihan Guan , Mengxuan Hu , Ronghang Zhu , Sheng Li , Anil Vullikanti

The deployment of large language models (LLMs) is frequently hindered by prohibitive memory and computational requirements. While quantization mitigates these bottlenecks, maintaining model fidelity in the sub-1-bit regime remains a…

Machine Learning · Computer Science 2026-02-06 Banseok Lee , Dongkyu Kim , Youngcheon You , Youngmin Kim

Modern large language models increasingly require long contexts for reasoning and multi-document tasks, but attention's quadratic complexity creates a severe computational bottleneck. We present Block-Sparse FlashAttention (BSFA), a drop-in…

Machine Learning · Computer Science 2025-12-09 Daniel Ohayon , Itay Lamprecht , Itay Hubara , Israel Cohen , Daniel Soudry , Noam Elata

Backdoor attacks pose a severe threat to deep neural networks (DNNs) by implanting hidden backdoors that can be activated with predefined triggers to manipulate model behaviors maliciously. Recent studies have extended backdoor attacks to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yu Feng , Dingxin Zhang , Runkai Zhao , Yong Xia , Heng Huang , Weidong Cai

Multimodal large language models (MLLMs) remain vulnerable to transferable adversarial examples. While existing methods typically achieve targeted attacks by aligning global features-such as CLIP's [CLS] token-between adversarial and target…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Xiaojun Jia , Sensen Gao , Simeng Qin , Tianyu Pang , Chao Du , Yihao Huang , Xinfeng Li , Yiming Li , Bo Li , Yang Liu

Large Language Models (LLMs) have become a cornerstone in the field of Natural Language Processing (NLP), offering transformative capabilities in understanding and generating human-like text. However, with their rising prominence, the…

Cryptography and Security · Computer Science 2024-03-26 Arijit Ghosh Chowdhury , Md Mofijul Islam , Vaibhav Kumar , Faysal Hossain Shezan , Vaibhav Kumar , Vinija Jain , Aman Chadha

As large language models (LLMs) expose systemic security challenges in high risk applications, including privacy leaks, bias amplification, and malicious abuse, there is an urgent need for a dynamic risk assessment and collaborative defence…

Cryptography and Security · Computer Science 2026-02-05 Xiaoyan Zhang , Dongyang Lyu , Xiaoqi Li

We investigate the vulnerability of Graph Neural Networks (GNNs) to bit-flip attacks (BFAs) by introducing an analytical framework to study the influence of architectural features, graph properties, and their interaction. The expressivity…

Machine Learning · Computer Science 2025-04-21 Lorenz Kummer , Wilfried N. Gansterer , Nils M. Kriege

In this paper, we present the first structural binarization method for LLM compression to less than 1-bit precision. Although LLMs have achieved remarkable performance, their memory-bound nature during the inference stage hinders the…

Machine Learning · Computer Science 2024-10-10 Peijie Dong , Lujun Li , Yuedong Zhong , Dayou Du , Ruibo Fan , Yuhan Chen , Zhenheng Tang , Qiang Wang , Wei Xue , Yike Guo , Xiaowen Chu

Background: Fine-tuning is central to adapting pre-trained Large Language Models (LLMs) to downstream tasks, but its reliance on training data, parameter updates, and reusable components opens entry points for attackers. Threats have…

Cryptography and Security · Computer Science 2026-05-26 Wenjuan Li , Yitao Liu , Runze Chen , Rajkumar Buyya

Large Language Models (LLMs) demonstrate impressive capabilities across various fields, yet their increasing use raises critical security concerns. This article reviews recent literature addressing key issues in LLM security, with a focus…

Cryptography and Security · Computer Science 2025-11-26 Benji Peng , Keyu Chen , Ming Li , Pohsun Feng , Ziqian Bi , Junyu Liu , Xinyuan Song , Qian Niu

Memorization in Large Language Models (LLMs) poses privacy and security risks, as models may unintentionally reproduce sensitive or copyrighted data. Existing analyses focus on average-case scenarios, often neglecting the highly skewed…

Artificial Intelligence · Computer Science 2025-02-04 Hao Li , Di Huang , Ziyu Wang , Amir M. Rahmani

Hard-to-detect hardware bit flips, from either malicious circuitry or bugs, have already been shown to make transformers vulnerable in non-generative tasks. This work, for the first time, investigates how low-level, bitwise perturbations…

Machine Learning · Computer Science 2025-12-18 Zafaryab Haider , Md Hafizur Rahman , Shane Moeykens , Vijay Devabhaktuni , Prabuddha Chakraborty

While critical for alignment, Supervised Fine-Tuning (SFT) incurs the risk of catastrophic forgetting, yet the layer-wise emergence of instruction-following capabilities remains elusive. We investigate this mechanism via a comprehensive…

Machine Learning · Computer Science 2026-04-15 Qinghua Zhao , Xueling Gong , Xinyu Chen , Zhongfeng Kang , Xinlu Li

While large language models (LLMs) such as Llama-2 or GPT-4 have shown impressive zero-shot performance, fine-tuning is still necessary to enhance their performance for customized datasets, domain-specific tasks, or other private needs.…

Machine Learning · Computer Science 2025-01-07 Chia-Yi Hsu , Yu-Lin Tsai , Chih-Hsun Lin , Pin-Yu Chen , Chia-Mu Yu , Chun-Ying Huang

Harmful fine-tuning attacks pose a major threat to the security of large language models (LLMs), allowing adversaries to compromise safety guardrails with minimal harmful data. While existing defenses attempt to reinforce LLM alignment,…

Machine Learning · Computer Science 2026-03-03 Yuhui Wang , Rongyi Zhu , Ting Wang