English
Related papers

Related papers: Reasoning-Oriented Programming: Chaining Semantic …

200 papers

Multimodal large language models (MLLMs) are widely used in vision-language reasoning tasks. However, their vulnerability to adversarial prompts remains a serious concern, as safety mechanisms often fail to prevent the generation of harmful…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Zuoou Li , Weitong Zhang , Jingyuan Wang , Shuyuan Zhang , Wenjia Bai , Bernhard Kainz , Mengyun Qiao

Multimodal large language models (MLLMs) excel in vision-language tasks but also pose significant risks of generating harmful content, particularly through jailbreak attacks. Jailbreak attacks refer to intentional manipulations that bypass…

Cryptography and Security · Computer Science 2025-07-18 Yi Nian , Shenzhe Zhu , Yuehan Qin , Li Li , Ziyi Wang , Chaowei Xiao , Yue Zhao

Large Language Models (LLMs) are implicit troublemakers. While they provide valuable insights and assist in problem-solving, they can also potentially serve as a resource for malicious activities. Implementing safety alignment could…

Cryptography and Security · Computer Science 2024-08-27 Haoyu Wang , Bingzhe Wu , Yatao Bian , Yongzhe Chang , Xueqian Wang , Peilin Zhao

Safeguarding vision-language models (VLMs) is a critical challenge, as existing methods often suffer from over-defense, which harms utility, or rely on shallow alignment, failing to detect complex threats that require deep reasoning. To…

Cryptography and Security · Computer Science 2026-04-03 Nanxi Li , Zhengyue Zhao , G. Edward Suh , Marco Pavone , Chaowei Xiao

Large language models (LLMs) have achieved impressive performance across natural language tasks and are increasingly deployed in real-world applications. Despite extensive safety alignment efforts, recent studies show that such alignment is…

Artificial Intelligence · Computer Science 2026-02-02 Yinzhi Zhao , Ming Wang , Shi Feng , Xiaocui Yang , Daling Wang , Yifei Zhang

Despite the remarkable versatility of Large Language Models (LLMs) and Multimodal LLMs (MLLMs) to generalize across both language and vision tasks, LLMs and MLLMs have shown vulnerability to jailbreaking, generating textual outputs that…

Cryptography and Security · Computer Science 2025-03-28 Joonhyun Jeong , Seyun Bae , Yeonsung Jung , Jaeryong Hwang , Eunho Yang

Large Language Models (LLMs) have been equipped with safety mechanisms to prevent harmful outputs, but these guardrails can often be bypassed through "jailbreak" prompts. This paper introduces a novel graph-based approach to systematically…

Cryptography and Security · Computer Science 2025-04-18 Sinan He , An Wang

Large Language Models (LLMs) have transformed artificial intelligence by advancing natural language understanding and generation, enabling applications across fields beyond healthcare, software engineering, and conversational systems.…

Ensuring the safety and alignment of large language models (LLMs) with human values is crucial for generating responses that are beneficial to humanity. While LLMs have the capability to identify and avoid harmful queries, they remain…

Computation and Language · Computer Science 2024-10-22 Yihua Zhou , Xiaochuan Shi

The emergence of Multimodal Large Language Models (MLRMs) has enabled sophisticated visual reasoning capabilities by integrating reinforcement learning and Chain-of-Thought (CoT) supervision. However, while these enhanced reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Bingrui Sima , Linhua Cong , Wenxuan Wang , Kun He

Recent advances in alignment techniques such as Supervised Fine-Tuning (SFT), Reinforcement Learning from Human Feedback (RLHF), and Direct Preference Optimization (DPO) have improved the safety of large language models (LLMs). However,…

Computation and Language · Computer Science 2026-02-26 Mengxuan Hu , Vivek V. Datla , Anoop Kumar , Zihan Guan , Sheng Li , Alfy Samuel , Daben Liu

Large Language Models (LLMs) have demonstrated impressive capabilities in natural language tasks, but their safety and morality remain contentious due to their training on internet text corpora. To address these concerns, alignment…

Computation and Language · Computer Science 2024-08-06 Mohammad Bahrami Karkevandi , Nishant Vishwamitra , Peyman Najafirad

Considerable research efforts have been devoted to ensuring that large language models (LLMs) align with human values and generate safe text. However, an excessive focus on sensitivity to certain topics can compromise the model's robustness…

Computation and Language · Computer Science 2023-08-29 Huachuan Qiu , Shuai Zhang , Anqi Li , Hongliang He , Zhenzhong Lan

Large Language Models (LLMs) are known to be susceptible to crafted adversarial attacks or jailbreaks that lead to the generation of objectionable content despite being aligned to human preferences using safety fine-tuning methods. While…

Computation and Language · Computer Science 2025-03-26 Sravanti Addepalli , Yerram Varun , Arun Suggala , Karthikeyan Shanmugam , Prateek Jain

With the significant advancement of Large Vision-Language Models (VLMs), concerns about their potential misuse and abuse have grown rapidly. Previous studies have highlighted VLMs' vulnerability to jailbreak attacks, where carefully crafted…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Yu Wang , Xiaofei Zhou , Yichen Wang , Geyuan Zhang , Tianxing He

Deploying large vision-language models (LVLMs) introduces a unique vulnerability: susceptibility to malicious attacks via visual inputs. However, existing defense methods suffer from two key limitations: (1) They solely focus on textual…

Cryptography and Security · Computer Science 2025-03-17 Shuyang Hao , Yiwei Wang , Bryan Hooi , Ming-Hsuan Yang , Jun Liu , Chengcheng Tang , Zi Huang , Yujun Cai

In this paper, we present a challenging code reasoning task: vulnerability detection. Large Language Models (LLMs) have shown promising results in natural-language and math reasoning, but state-of-the-art (SOTA) models reported only 54.5%…

Software Engineering · Computer Science 2025-01-09 Benjamin Steenhoek , Md Mahbubur Rahman , Monoshi Kumar Roy , Mirza Sanjida Alam , Hengbo Tong , Swarna Das , Earl T. Barr , Wei Le

Aligning Vision-Language Models (VLMs) with safety standards is essential to mitigate risks arising from their multimodal complexity, where integrating vision and language unveils subtle threats beyond the reach of conventional safeguards.…

Machine Learning · Computer Science 2025-10-14 Menglan Chen , Xianghe Pang , Jingjing Dong , WenHao Wang , Yaxin Du , Siheng Chen

The security of Large Language Model (LLM) applications is fundamentally challenged by "form-first" attacks like prompt injection and jailbreaking, where malicious instructions are embedded within user inputs. Conventional defenses, which…

Cryptography and Security · Computer Science 2025-10-15 Dominik Schwarz

Current LLM safety research predominantly focuses on mitigating Goal Hijacking, preventing attackers from redirecting a model's high-level objective (e.g., from "summarizing emails" to "phishing users"). In this paper, we argue that this…

Cryptography and Security · Computer Science 2026-04-28 Yuansen Liu , Yixuan Tang , Anthony Kum Hoe Tun