中文
相关论文

相关论文: One-shot Optimized Steering Vectors Mediate Safety…

200 篇论文

Recent work has demonstrated the potential of contrastive steering for jailbreaking Large Language Models (LLMs). However, existing methods rely on limited and inherently biased contrastive prompts and require laborious manual tuning of…

密码学与安全 · 计算机科学 2026-05-21 Junxi Chen , Junhao Dong , Xiaohua Xie

Current vision large language models (VLLMs) exhibit remarkable capabilities yet are prone to generate harmful content and are vulnerable to even the simplest jailbreaking attacks. Our initial analysis finds that this is due to the presence…

机器学习 · 计算机科学 2024-06-19 Yongshuo Zong , Ondrej Bohdal , Tingyang Yu , Yongxin Yang , Timothy Hospedales

Current multimodal models often suffer from shallow reasoning, leading to errors caused by incomplete or inconsistent thought processes. To address this limitation, we propose Self-Verification and Self-Rectification (SVSR), a unified…

人工智能 · 计算机科学 2026-05-29 Zhe Qian , Nianbing Su , Zhonghua Wang , Hebei Li , Zhongxing Xu , Yueying Li , Fei Luo , Zhuohan Ouyang , Yanbiao Ma

Large language models (LLMs) have revolutionized various applications, making robust safety alignment essential to prevent harmful outputs. Current safety alignment techniques, however, harbor inherent vulnerabilities due to their reliance…

密码学与安全 · 计算机科学 2026-04-21 Yuxi Li , Yi Liu , Yuekang Li , Ling Shi , Gelei Deng , Shengquan Chen , Kailong Wang

Alignment in large language models (LLMs) is used to enforce guidelines such as safety. Yet, alignment fails in the face of jailbreak attacks that modify inputs to induce unsafe outputs. In this paper, we introduce and evaluate a new…

密码学与安全 · 计算机科学 2026-02-19 Jean-Charles Noirot Ferrand , Yohan Beugin , Eric Pauley , Ryan Sheatsley , Patrick McDaniel

Recent advances in large language models (LLMs) have intensified the need to understand and reliably curb their harmful behaviours. We introduce a multidimensional framework for probing and steering harmful content in model internals. For…

Vision-language-action models (VLAs) show potential as generalist robot policies. However, these models pose extreme safety challenges during real-world deployment, including the risk of harm to the environment, the robot itself, and…

机器人学 · 计算机科学 2026-04-21 Borong Zhang , Yuhao Zhang , Jiaming Ji , Yingshan Lei , Yishuai Cai , Josef Dai , Yuanpei Chen , Yaodong Yang

Large Reasoning Models possess remarkable capabilities for self-correction in general domain; however, they frequently struggle to recover from unsafe reasoning trajectories under adversarial attacks. Existing alignment methods attempt to…

人工智能 · 计算机科学 2026-05-12 Dongcheng Zhang , Yi Zhang , Yuxin Chen , An Zhang , Xiang Wang , Chaochao Lu

Safety-aligned large language models (LLMs) are increasingly deployed in real-world pipelines, yet this deployment also enlarges the supply-chain attack surface: adversaries can distribute backdoored checkpoints that behave normally under…

密码学与安全 · 计算机科学 2026-04-15 Rui Yin , Tianxu Han , Naen Xu , Changjiang Li , Ping He , Chunyi Zhou , Jun Wang , Zhihui Fu , Tianyu Du , Jinbao Li , Shouling Ji

With the rapid development of large language models (LLMs), they are not only used as general-purpose AI assistants but are also customized through further fine-tuning to meet the requirements of different applications. A pivotal factor in…

计算与语言 · 计算机科学 2024-01-23 Pengyu Wang , Dong Zhang , Linyang Li , Chenkun Tan , Xinghao Wang , Ke Ren , Botian Jiang , Xipeng Qiu

Fine-tuning large language models (LLMs) on additional datasets is often necessary to optimize them for specific downstream tasks. However, existing safety alignment measures, which restrict harmful behavior during inference, are…

计算与语言 · 计算机科学 2024-10-15 Minjun Zhu , Linyi Yang , Yifan Wei , Ningyu Zhang , Yue Zhang

Large Vision-Language Models (LVLMs) undergo safety alignment to suppress harmful content. However, current defenses predominantly target explicit malicious patterns in the input representation, often overlooking the vulnerabilities…

密码学与安全 · 计算机科学 2026-03-11 Quanchen Zou , Moyang Chen , Zonghao Ying , Wenzhuo Xu , Yisong Xiao , Deyue Zhang , Dongdong Yang , Zhao Liu , Xiangzheng Zhang

Large language models (LLMs) have emerged as powerful tools for addressing a wide range of general inquiries and tasks. Despite this, fine-tuning aligned LLMs on smaller, domain-specific datasets, critical to adapting them to specialized…

人工智能 · 计算机科学 2025-02-04 Guanlin Li , Kangjie Chen , Shangwei Guo , Jie Zhang , Han Qiu , Chao Zhang , Guoyin Wang , Tianwei Zhang , Jiwei Li

This paper presents VisLingInstruct, a novel approach to advancing Multi-Modal Language Models (MMLMs) in zero-shot learning. Current MMLMs show impressive zero-shot abilities in multi-modal tasks, but their performance depends heavily on…

人工智能 · 计算机科学 2024-06-21 Dongsheng Zhu , Xunzhu Tang , Weidong Han , Jinghui Lu , Yukun Zhao , Guoliang Xing , Junfeng Wang , Dawei Yin

The ability to follow instructions is crucial for numerous real-world applications of language models. In pursuit of deeper insights and more powerful capabilities, we derive instruction-specific vector representations from language models…

计算与语言 · 计算机科学 2025-04-15 Alessandro Stolfo , Vidhisha Balachandran , Safoora Yousefi , Eric Horvitz , Besmira Nushi

Visual language models (VLMs) have made significant progress in image captioning tasks, yet recent studies have found they are vulnerable to backdoor attacks. Attackers can inject undetectable perturbations into the data during inference,…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Shuhan Xu , Siyuan Liang , Hongling Zheng , Aishan Liu , Xinbiao Wang , Yong Luo , Fu Lin , Leszek Rutkowski , Dacheng Tao

Current safety evaluations of language models rely on benchmark-based assessments that may miss localized vulnerabilities. We present RepIt, a simple and data-efficient framework for isolating concept-specific representations in LM…

人工智能 · 计算机科学 2026-04-22 Vincent Siu , Nathan W. Henry , Nicholas Crispino , Yang Liu , Dawn Song , Chenguang Wang

Vehicular Ad Hoc Network has attracted both research and industrial community due to its benefits in facilitating human life and enhancing the security and comfort. However, various issues have been faced in such networks such as…

网络与互联网体系结构 · 计算机科学 2019-06-21 Mohammed Laroui , Akrem Sellami , Boubakr Nour , Hassine Moungla , Hossam Afifi , Sofiane B. Hacene

Support vector machine (SVM) has attracted great attentions for the last two decades due to its extensive applications, and thus numerous optimization models have been proposed. To distinguish all of them, in this paper, we introduce a new…

最优化与控制 · 数学 2021-04-06 Huajun Wang , Yuanhai Shao , Shenglong Zhou , Ce Zhang , Naihua Xiu

Large Language Models (LLMs) have demonstrated impressive capabilities in natural language tasks, but their safety and morality remain contentious due to their training on internet text corpora. To address these concerns, alignment…

计算与语言 · 计算机科学 2024-08-06 Mohammad Bahrami Karkevandi , Nishant Vishwamitra , Peyman Najafirad