English
Related papers

Related papers: When Safe Unimodal Inputs Collide: Optimizing Reas…

200 papers

Benefiting from the powerful capabilities of Large Language Models (LLMs), pre-trained visual encoder models connected to an LLMs can realize Vision Language Models (VLMs). However, existing research shows that the visual modality of VLMs…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zhendong Liu , Yuanbi Nie , Yingshui Tan , Xiangyu Yue , Qiushi Cui , Chongjun Wang , Xiaoyong Zhu , Bo Zheng

Multimodal large language models (MLLMs) are gaining increasing attention. Due to the heterogeneity of their input features, they face significant challenges in terms of jailbreak defenses. Current defense methods rely on costly fine-tuning…

Artificial Intelligence · Computer Science 2026-05-13 Xinyi Zeng , Xue Yang , Jingyuan Zhang , Huanqian Yan , Xiang Chen , Kaiwen Wei , Hankun Kang , Yu Tian

Large Language Models (LLMs) have achieved impressive performance across diverse natural language processing tasks, but their growing power also amplifies potential risks such as jailbreak attacks that circumvent built-in safety mechanisms.…

Artificial Intelligence · Computer Science 2025-10-01 Qinjian Zhao , Jiaqi Wang , Zhiqiang Gao , Zhihao Dou , Belal Abuhaija , Kaizhu Huang

The security of Large Language Model (LLM) applications is fundamentally challenged by "form-first" attacks like prompt injection and jailbreaking, where malicious instructions are embedded within user inputs. Conventional defenses, which…

Cryptography and Security · Computer Science 2025-10-15 Dominik Schwarz

Large language models (LLMs) have demonstrated remarkable capabilities in complex reasoning and text generation. However, these models can inadvertently generate unsafe or biased responses when prompted with problematic inputs, raising…

Computation and Language · Computer Science 2024-12-03 Avinash Amballa , Durga Sandeep Saluru , Gayathri Akkinapalli , Abhishek Sureddy , Akshay Kumar Sureddy

Large language models (LLMs) are being deployed across the Global South, where everyday use involves low-resource languages, code-mixing, and culturally specific norms. Yet safety pipelines, benchmarks, and alignment still largely target…

Computation and Language · Computer Science 2026-02-17 Somnath Banerjee , Rima Hazra , Animesh Mukherjee

As the influence of large language models (LLMs) spans across global communities, their safety challenges in multilingual settings become paramount for alignment research. This paper examines the variations in safety challenges faced by…

Computation and Language · Computer Science 2024-01-25 Lingfeng Shen , Weiting Tan , Sihao Chen , Yunmo Chen , Jingyu Zhang , Haoran Xu , Boyuan Zheng , Philipp Koehn , Daniel Khashabi

The trustworthiness of Multimodal Large Language Models (MLLMs) remains an intense concern despite the significant progress in their capabilities. Existing evaluation and mitigation approaches often focus on narrow aspects and overlook…

Computation and Language · Computer Science 2025-08-22 Yichi Zhang , Yao Huang , Yifan Wang , Yitong Sun , Chang Liu , Zhe Zhao , Zhengwei Fang , Huanran Chen , Xiao Yang , Xingxing Wei , Hang Su , Yinpeng Dong , Jun Zhu

Ensuring the safe alignment of large language models (LLMs) with human values is critical as they become integral to applications like translation and question answering. Current alignment methods struggle with dynamic user intentions and…

Computation and Language · Computer Science 2024-10-29 Rima Hazra , Sayan Layek , Somnath Banerjee , Soujanya Poria

Large Reasoning Models (LRMs) have recently demonstrated impressive performances across diverse domains. However, how the safety of Large Language Models (LLMs) benefits from enhanced reasoning capabilities against jailbreak queries remains…

Computation and Language · Computer Science 2025-09-23 Junda Zhu , Lingyong Yan , Shuaiqiang Wang , Dawei Yin , Lei Sha

Emerging large reasoning models (LRMs), such as DeepSeek-R1 models, leverage long chain-of-thought (CoT) reasoning to generate structured intermediate steps, enhancing their reasoning capabilities. However, long CoT does not inherently…

Artificial Intelligence · Computer Science 2025-02-18 Fengqing Jiang , Zhangchen Xu , Yuetai Li , Luyao Niu , Zhen Xiang , Bo Li , Bill Yuchen Lin , Radha Poovendran

Recent advances in alignment techniques such as Supervised Fine-Tuning (SFT), Reinforcement Learning from Human Feedback (RLHF), and Direct Preference Optimization (DPO) have improved the safety of large language models (LLMs). However,…

Computation and Language · Computer Science 2026-02-26 Mengxuan Hu , Vivek V. Datla , Anoop Kumar , Zihan Guan , Sheng Li , Alfy Samuel , Daben Liu

Larger language models (LLMs) have taken the world by storm with their massive multi-tasking capabilities simply by optimizing over a next-word prediction objective. With the emergence of their properties and encoded knowledge, the risk of…

Computation and Language · Computer Science 2023-08-31 Rishabh Bhardwaj , Soujanya Poria

Large visual-language models (LVLMs) integrate aligned large language models (LLMs) with visual modules to process multimodal inputs. However, the safety mechanisms developed for text-based LLMs do not naturally extend to visual modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Shen Li , Liuyi Yao , Wujia Niu , Lan Zhang , Yaliang Li

Large language models (LLMs) increasingly rely on knowledge editing to support knowledge-intensive reasoning, but this flexibility also introduces critical safety risks: adversaries can inject malicious or misleading knowledge that corrupts…

Artificial Intelligence · Computer Science 2026-05-12 Qinghua Mao , Xi Lin , Jinze Gu , Jun Wu , Siyuan Li , Yuliang Chen

Large Reasoning Models (LRMs) have exhibited extraordinary prowess in tasks like mathematics and coding, leveraging their advanced reasoning capabilities. Nevertheless, as these capabilities progress, significant concerns regarding their…

Computation and Language · Computer Science 2025-05-27 Cheng Wang , Yue Liu , Baolong Bi , Duzhen Zhang , Zhong-Zhi Li , Yingwei Ma , Yufei He , Shengju Yu , Xinfeng Li , Junfeng Fang , Jiaheng Zhang , Bryan Hooi

Unified Multimodal Large Models (UMLMs) integrate understanding and generation capabilities within a single architecture. While this architectural unification, driven by the deep fusion of multimodal features, enhances model performance, it…

Artificial Intelligence · Computer Science 2026-04-02 Zixiang Peng , Yongxiu Xu , Qinyi Zhang , Jiexun Shen , Yifan Zhang , Hongbo Xu , Yubin Wang , Gaopeng Gou

Large language models (LLMs) for code generation are typically evaluated on functional correctness alone, overlooking whether generated code propagates harmful content embedded in the prompt. Prior work has shown that most Code LLMs…

Software Engineering · Computer Science 2026-04-15 Honghao Tan , Haibo Wang , Shin Hwei Tan

The rapid advancement of large language models (LLMs) has demonstrated milestone success in a variety of tasks, yet their potential for generating harmful content has raised significant safety concerns. Existing safety evaluation approaches…

Computation and Language · Computer Science 2025-05-22 Tianqi Du , Zeming Wei , Quan Chen , Chenheng Zhang , Yisen Wang

Mechanistic interpretability reveals that safety-critical behaviors (e.g., alignment, jailbreak, backdoor) in Large Language Models (LLMs) are grounded in specialized functional components. However, existing safety attribution methods…

Machine Learning · Computer Science 2026-03-25 Miao Yu , Siyuan Fu , Moayad Aloqaily , Zhenhong Zhou , Safa Otoum , Xing fan , Kun Wang , Yufei Guo , Qingsong Wen