English
Related papers

Related papers: The Forgotten Shield: Safety Grafting in Parameter…

200 papers

Multimodal Large Language Models (MLLMs) trained on massive data may memorize sensitive personal information and photos, posing serious privacy risks. To mitigate this, MLLM unlearning methods are proposed, which fine-tune MLLMs to reduce…

Machine Learning · Computer Science 2025-09-23 Xianren Zhang , Hui Liu , Delvin Ce Zhang , Xianfeng Tang , Qi He , Dongwon Lee , Suhang Wang

Generative medical vision-language models~(Med-VLMs) are primarily designed to generate complex textual information~(e.g., diagnostic reports) from multimodal inputs including vision modality~(e.g., medical images) and language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Zhiyu Xue , Reza Abbasi-Asl , Ramtin Pedarsani

Vision-Language Models (VLMs) exhibit impressive performance, yet the integration of powerful vision encoders has significantly broadened their attack surface, rendering them increasingly susceptible to jailbreak attacks. However, lacking…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Jiaxin Song , Yixu Wang , Jie Li , Rui Yu , Yan Teng , Xingjun Ma , Yingchun Wang

The safety of large language models (LLMs) has increasingly emerged as a fundamental aspect of their development. Existing safety alignment for LLMs is predominantly achieved through post-training methods, which are computationally…

Artificial Intelligence · Computer Science 2026-02-03 Sicheng Shen , Mingyang Lv , Han Shen , Jialin Wu , Binghao Wang , Zhou Yang , Guobin Shen , Dongcheng Zhao , Feifei Zhao , Yi Zeng

Background: Fine-tuning is central to adapting pre-trained Large Language Models (LLMs) to downstream tasks, but its reliance on training data, parameter updates, and reusable components opens entry points for attackers. Threats have…

Cryptography and Security · Computer Science 2026-05-26 Wenjuan Li , Yitao Liu , Runze Chen , Rajkumar Buyya

Medical vision--language models (MVLMs) are increasingly used as perceptual backbones in radiology pipelines and as the visual front end of multimodal assistants, yet their reliability under real clinical workflows remains underexplored.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Xiang Chen , Fangfang Yang , Chunlei Meng , Yuxian Dong , Ang Li , Yiwei Wei , Jiahuan Long , Jiujiang Guo , Chengyin Hu

Large Language Models (LLMs), despite advanced general capabilities, still suffer from numerous safety risks, especially jailbreak attacks that bypass safety protocols. Understanding these vulnerabilities through black-box jailbreak…

Cryptography and Security · Computer Science 2025-05-29 Yao Huang , Yitong Sun , Shouwei Ruan , Yichi Zhang , Yinpeng Dong , Xingxing Wei

Despite the rapid advancements of Large Language Models (LLMs), safety risks remain a critical challenge for low-resource languages. Existing safety datasets are predominantly English centric, limiting progress in multilingual safety…

Computation and Language · Computer Science 2026-02-16 Hyunseo Shin , Wonseok Hwang

Multimodal Large Language Models (MLLMs) have tremendous potential to improve the accuracy, availability, and cost-effectiveness of healthcare by providing automated solutions or serving as aids to medical professionals. Despite promising…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Mohammad Shahab Sepehri , Zalan Fabian , Maryam Soltanolkotabi , Mahdi Soltanolkotabi

Ensuring the safety of Large Language Models (LLMs) is critical for real-world deployment. However, current safety measures often fail to address implicit, domain-specific risks. To investigate this gap, we introduce a dataset of 3,000…

Artificial Intelligence · Computer Science 2026-01-09 Liang Shan , Kaicheng Shen , Wen Wu , Zhenyu Ying , Chaochao Lu , Yan Teng , Jingqi Huang , Guangze Ye , Guoqing Wang , Liang He

Multimodal Large Language Models (MLLMs) have achieved remarkable success in cross-modal understanding and generation, yet their deployment is threatened by critical safety vulnerabilities. While prior works have demonstrated the…

Cryptography and Security · Computer Science 2026-04-22 Kun Wang , Cheng Qian , Miao Yu , Lilan Peng , Liang Lin , Jiaming Zhang , Tianyu Zhang , Yu Cheng , Yang Wang

Large Language Models (LLMs), characterized by being trained on broad amounts of data in a self-supervised manner, have shown impressive performance across a wide range of tasks. Indeed, their generative abilities have aroused interest on…

Machine Learning · Computer Science 2024-07-30 Jorge García-Carrasco , Alejandro Maté , Juan Trujillo

While safety alignment for Multimodal Large Language Models (MLLMs) has gained significant attention, current paradigms primarily target malicious intent or situational violations. We propose shifting the safety frontier toward…

Artificial Intelligence · Computer Science 2026-03-11 Ming Wen , Kun Yang , Jingyu Zhang , Yuxuan Liu , shiwen cui , Shouling Ji , Xingjun Ma

The emergence of finetuning-as-a-service has revealed a new vulnerability in large language models (LLMs). A mere handful of malicious data uploaded by users can subtly manipulate the finetuning process, resulting in an alignment-broken…

Computation and Language · Computer Science 2024-12-18 Xin Yi , Shunfan Zheng , Linlin Wang , Gerard de Melo , Xiaoling Wang , Liang He

Current safety alignment techniques for large language models (LLMs) face two key challenges: (1) under-generalization, which leaves models vulnerable to novel jailbreak attacks, and (2) over-alignment, which leads to the excessive refusal…

Computation and Language · Computer Science 2025-04-15 Yutao Mou , Yuxiao Luo , Shikun Zhang , Wei Ye

Studying the robustness of Large Language Models (LLMs) to unsafe behaviors is an important topic of research today. Building safety classification models or guard models, which are fine-tuned models for input/output safety classification…

Computation and Language · Computer Science 2025-07-30 Sowmya Vajjala

Large Language Models (LLMs) have achieved remarkable success across domains such as healthcare, education, and cybersecurity. However, this openness also introduces significant security risks, particularly through embedding space…

Computation and Language · Computer Science 2025-07-14 Zhibo Zhang , Yuxi Li , Kailong Wang , Shuai Yuan , Ling Shi , Haoyu Wang

Large language models (LLMs) are increasingly deployed in real-world applications, raising concerns about their security. While jailbreak attacks highlight failures under overtly harmful queries, they overlook a critical risk: incorrectly…

Cryptography and Security · Computer Science 2025-06-10 Yukai Zhou , Sibei Yang , Wenjie Wang

Before adopting a new large language model (LLM) architecture, it is critical to understand vulnerabilities accurately. Existing evaluations can be difficult to trust, often drawing conclusions from LLMs that are not meaningfully…

Cryptography and Security · Computer Science 2025-10-08 Mary Llewellyn , Annie Gray , Josh Collyer , Michael Harries

Large Language Models (LLMs) have been equipped with safety mechanisms to prevent harmful outputs, but these guardrails can often be bypassed through "jailbreak" prompts. This paper introduces a novel graph-based approach to systematically…

Cryptography and Security · Computer Science 2025-04-18 Sinan He , An Wang