English
Related papers

Related papers: SARSteer: Safeguarding Large Audio-Language Models…

200 papers

Fine-tuning large language models (LLMs) to adapt to evolving safety policies is costly and impractical. Mechanistic interpretability enables inference-time control through latent activation steering, yet its potential for precise,…

Machine Learning · Computer Science 2025-06-06 Shaona Ghosh , Amrita Bhattacharjee , Yftah Ziser , Christopher Parisien

Despite extensive efforts in safety alignment, large language models (LLMs) remain vulnerable to jailbreak attacks. Activation steering offers a training-free defense method but relies on fixed steering coefficients, resulting in suboptimal…

Cryptography and Security · Computer Science 2025-09-22 Weixiang Zhao , Jiahe Guo , Yulin Hu , Yang Deng , An Zhang , Xingyu Sui , Xinyang Han , Yanyan Zhao , Bing Qin , Tat-Seng Chua , Ting Liu

Multimodal large language models (MLLMs) are gaining increasing attention. Due to the heterogeneity of their input features, they face significant challenges in terms of jailbreak defenses. Current defense methods rely on costly fine-tuning…

Artificial Intelligence · Computer Science 2026-05-13 Xinyi Zeng , Xue Yang , Jingyuan Zhang , Huanqian Yan , Xiang Chen , Kaiwen Wei , Hankun Kang , Yu Tian

As the capabilities of Vision Language Models (VLMs) continue to improve, they are increasingly targeted by jailbreak attacks. Existing defense methods face two major limitations: (1) they struggle to ensure safety without compromising the…

Cryptography and Security · Computer Science 2025-09-29 Xiyu Zeng , Siyuan Liang , Liming Lu , Haotian Zhu , Enguang Liu , Jisheng Dang , Yongbin Zhou , Shuchao Pang

Recent progress in Multimodal Large Language Models (MLLMs) has unlocked powerful cross-modal reasoning abilities, but also raised new safety concerns, particularly when faced with adversarial multimodal inputs. To improve the safety of…

Computation and Language · Computer Science 2025-09-24 Lyucheng Wu , Mengru Wang , Ziwen Xu , Tri Cao , Nay Oo , Bryan Hooi , Shumin Deng

Large Audio Language Models (LALMs) have extended the capabilities of Large Language Models (LLMs) by enabling audio-based human interactions. However, recent research has revealed that LALMs remain vulnerable to harmful queries due to…

Computation and Language · Computer Science 2025-05-27 Hao Yang , Lizhen Qu , Ehsan Shareghi , Gholamreza Haffari

As LLMs are increasingly deployed in real-world applications, ensuring their ability to refuse malicious prompts, especially jailbreak attacks, is essential for safe and reliable use. Recently, activation steering has emerged as an…

Machine Learning · Computer Science 2026-02-10 Leheng Sheng , Changshuo Shen , Weixiang Zhao , Junfeng Fang , Xiaohao Liu , Zhenkai Liang , Xiang Wang , An Zhang , Tat-Seng Chua

Despite the strong performance of large language models (LLMs) across diverse tasks, their susceptibility to adversarial attacks and unsafe content generation remains a significant obstacle to deployment, particularly in high-stakes…

Machine Learning · Computer Science 2026-05-25 Thanh Q. Tran , Arun Verma , Kiwan Wong , Bryan Kian Hsiang Low , Daniela Rus , Wei Xiao

Achieving robust safety alignment in large language models (LLMs) while preserving their utility remains a fundamental challenge. Existing approaches often struggle to balance comprehensive safety with fine-grained controllability at the…

Artificial Intelligence · Computer Science 2025-09-25 Huizhen Shu , Xuying Li , Zhuo Li

Safety alignment is indispensable for Large Language Models (LLMs) to defend threats from malicious instructions. However, recent researches reveal safety-aligned LLMs prone to reject benign queries due to the exaggerated safety issue,…

Artificial Intelligence · Computer Science 2024-12-18 Zouying Cao , Yifei Yang , Hai Zhao

Large Language Models (LLMs) have emerged as powerful tools, but their inherent safety risks - ranging from harmful content generation to broader societal harms - pose significant challenges. These risks can be amplified by the recent…

Large language models (LLMs) are typically aligned to refuse harmful instructions through safety fine-tuning. A recent attack, termed abliteration, identifies and suppresses the single latent direction most responsible for refusal behavior,…

Computation and Language · Computer Science 2025-10-08 Harethah Abu Shairah , Hasan Abed Al Kader Hammoud , Bernard Ghanem , George Turkiyyah

While large language models (LLMs) have seen unprecedented advancements in capabilities and applications across a variety of use-cases, safety alignment of these models is still an area of active research. The fragile nature of LLMs, even…

Computation and Language · Computer Science 2024-10-03 Amrita Bhattacharjee , Shaona Ghosh , Traian Rebedea , Christopher Parisien

Vision Language Models (VLMs) can produce unintended and harmful content when exposed to adversarial attacks, particularly because their vision capabilities create new vulnerabilities. Existing defenses, such as input preprocessing,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Han Wang , Gang Wang , Huan Zhang

As vision-language models (VLMs) are increasingly deployed in open-world scenarios, they can be easily induced by visual jailbreak attacks to generate harmful content, posing serious risks to model safety and trustworthy usage. Recent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Xingyu Zhu , Beier Zhu , Shuo Wang , Junfeng Fang , Kesen Zhao , Hanwang Zhang , Xiangnan He

Safety alignment of large language models currently faces a central challenge: existing alignment techniques often prioritize mitigating responses to harmful prompts at the expense of overcautious behavior, leading models to incorrectly…

Large Language Models (LLMs) with safe-alignment training are powerful instruments with robust language comprehension capabilities. These models typically undergo meticulous alignment procedures involving human feedback to ensure the…

Machine Learning · Computer Science 2025-09-22 Maithili Joshi , Palash Nandi , Tanmoy Chakraborty

Recent advancements in large language models (LLMs) have accelerated progress toward artificial general intelligence, yet their potential to generate harmful content poses critical safety challenges. Existing alignment methods often…

Computation and Language · Computer Science 2025-10-08 Kehua Feng , Keyan Ding , Yuhao Wang , Menghan Li , Fanjunduo Wei , Xinda Wang , Qiang Zhang , Huajun Chen

Harmful fine-tuning attacks pose a major threat to the security of large language models (LLMs), allowing adversaries to compromise safety guardrails with minimal harmful data. While existing defenses attempt to reinforce LLM alignment,…

Machine Learning · Computer Science 2026-03-03 Yuhui Wang , Rongyi Zhu , Ting Wang

Ensuring the safety and harmlessness of Large Language Models (LLMs) has become equally critical as their performance in applications. However, existing safety alignment methods typically suffer from safety-performance trade-offs and the…

Computation and Language · Computer Science 2025-06-30 Yichi Zhang , Siyuan Zhang , Yao Huang , Zeyu Xia , Zhengwei Fang , Xiao Yang , Ranjie Duan , Dong Yan , Yinpeng Dong , Jun Zhu
‹ Prev 1 2 3 10 Next ›