中文
相关论文

相关论文: DualEdit: Mitigating Safety Fallback in LLM Backdo…

200 篇论文

Machine learning is advancing rapidly, with applications bringing notable benefits, such as improvements in translation and code generation. Models like ChatGPT, powered by Large Language Models (LLMs), are increasingly integrated into…

机器学习 · 计算机科学 2025-06-10 Torsten Krauß , Hamid Dashtbani , Alexandra Dmitrienko

Leading language model (LM) providers like OpenAI and Anthropic allow customers to fine-tune frontier LMs for specific use cases. To prevent abuse, these providers apply filters to block fine-tuning on overtly harmful data. In this setting,…

密码学与安全 · 计算机科学 2025-07-15 Joshua Kazdan , Abhay Puri , Rylan Schaeffer , Lisa Yu , Chris Cundy , Jason Stanley , Sanmi Koyejo , Krishnamurthy Dvijotham

In the rapidly advancing field of artificial intelligence, the concept of Red-Teaming or Jailbreaking large language models (LLMs) has emerged as a crucial area of study. This approach is especially significant in terms of assessing and…

计算与语言 · 计算机科学 2024-05-17 Rima Hazra , Sayan Layek , Somnath Banerjee , Soujanya Poria

Large Language Models (LLMs) are swiftly advancing in architecture and capability, and as they integrate more deeply into complex systems, the urgency to scrutinize their security properties grows. This paper surveys research in the…

计算与语言 · 计算机科学 2023-10-18 Erfan Shayegani , Md Abdullah Al Mamun , Yu Fu , Pedram Zaree , Yue Dong , Nael Abu-Ghazaleh

The integration of Large Language Models (LLMs) into healthcare applications offers promising advancements in medical diagnostics, treatment recommendations, and patient care. However, the susceptibility of LLMs to adversarial attacks poses…

人工智能 · 计算机科学 2024-12-18 Yifan Yang , Qiao Jin , Furong Huang , Zhiyong Lu

Multi-modal large language models (MLLMs) extend large language models (LLMs) to process multi-modal information, enabling them to generate responses to image-text inputs. MLLMs have been incorporated into diverse multi-modal applications,…

密码学与安全 · 计算机科学 2025-03-21 Zenghui Yuan , Jiawen Shi , Pan Zhou , Neil Zhenqiang Gong , Lichao Sun

Open-source Large Language Models (LLMs) often employ safety alignment methods to resist harmful instructions. However, recent research shows that maliciously fine-tuning these LLMs on harmful data can easily bypass these safeguards. To…

密码学与安全 · 计算机科学 2025-07-30 Zixuan Chen , Weikai Lu , Xin Lin , Ziqian Zeng

Textual data is often represented as real-numbered embeddings in NLP, particularly with the popularity of large language models (LLMs) and Embeddings as a Service (EaaS). However, storing sensitive information as embeddings can be…

计算与语言 · 计算机科学 2024-06-06 Yiyi Chen , Heather Lent , Johannes Bjerva

Backdoor attacks undermine the reliability and trustworthiness of machine learning systems by injecting hidden behaviors that can be maliciously activated at inference time. While such threats have been extensively studied in unimodal…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Juncheng Li , Yige Li , Hanxun Huang , Yunhao Chen , Xin Wang , Yixu Wang , Xingjun Ma , Yu-Gang Jiang

In recent trends, one can observe Large Language Models (LLMs) are exposed to backdoor attacks where vicious triggers added during training or model editing to elicit harmful outputs on specific input patterns while maintaining clean…

密码学与安全 · 计算机科学 2026-05-14 Jagadeesh Rachapudi , Ritali Vatsi , Pranav Singh , Praful Hambarde , Amit Shukla

The growing safety concerns surrounding large language models raise an urgent need to align them with diverse human preferences to simultaneously enhance their helpfulness and safety. A promising approach is to enforce safety constraints…

人工智能 · 计算机科学 2024-11-25 Xinmeng Huang , Shuo Li , Edgar Dobriban , Osbert Bastani , Hamed Hassani , Dongsheng Ding

Large Language Models (LLMs) exhibit impressive capabilities but also present risks such as biased content generation and privacy issues. One of the current alignment techniques includes principle-driven integration, but it faces challenges…

计算与语言 · 计算机科学 2025-05-30 Yi Luo , Zhenghao Lin , Yuhao Zhang , Jiashuo Sun , Chen Lin , Chengjin Xu , Xiangdong Su , Yelong Shen , Jian Guo , Yeyun Gong

The advent of Large Language Models (LLMs) has revolutionized various applications by providing advanced natural language processing capabilities. However, this innovation introduces new cybersecurity challenges. This paper explores the…

密码学与安全 · 计算机科学 2024-06-18 Stephen Burabari Tete

The security issue of large language models (LLMs) has gained wide attention recently, with various defense mechanisms developed to prevent harmful output, among which safeguards based on text embedding models serve as a fundamental…

计算与语言 · 计算机科学 2025-05-20 Haoyu Liang , Youran Sun , Yunfeng Cai , Jun Zhu , Bo Zhang

Safety fine-tuning helps align Large Language Models (LLMs) with human preferences for their safe deployment. To better understand the underlying factors that make models safe via safety fine-tuning, we design a synthetic data generation…

Customized Large Language Model (LLM) agents face a critical security threat from black-box instruction backdoors, where malicious behaviors are covertly injected through hidden system instructions. Although existing prompt-based defenses…

密码学与安全 · 计算机科学 2026-04-17 Zhengxian Wu , Juan Wen , Wanli Peng , Haowei Chang , Yinghan Zhou , Yiming Xue

Large language models (LLMs) are vulnerable to adversarial attacks that can elicit harmful responses. Defending against such attacks remains challenging due to the opacity of jailbreaking mechanisms and the high computational cost of…

机器学习 · 计算机科学 2025-03-21 Lei Yu , Virginie Do , Karen Hambardzumyan , Nicola Cancedda

As large language models (LLMs) become integral to various applications, ensuring both their safety and utility is paramount. Jailbreak attacks, which manipulate LLMs into generating harmful content, pose significant challenges to this…

密码学与安全 · 计算机科学 2025-02-10 Guobin Shen , Dongcheng Zhao , Yiting Dong , Xiang He , Yi Zeng

Large Language Models (LLMs) rapidly reshape modern life, advancing fields from healthcare to education and beyond. However, alongside their remarkable capabilities lies a significant threat: the susceptibility of these models to…

计算与语言 · 计算机科学 2025-05-16 Michael Fire , Yitzhak Elbazis , Adi Wasenstein , Lior Rokach

Vision Language Models (VLMs) have shown remarkable performance, but are also vulnerable to backdoor attacks whereby the adversary can manipulate the model's outputs through hidden triggers. Prior attacks primarily rely on single-modality…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Zhiyuan Zhong , Zhen Sun , Yepang Liu , Xinlei He , Guanhong Tao