English
Related papers

Related papers: CeTAD: Towards Certified Toxicity-Aware Distance i…

200 papers

Recent advancements in Large Language Models (LLMs) have sparked widespread concerns about their safety. Recent work demonstrates that safety alignment of LLMs can be easily removed by fine-tuning with a few adversarially chosen…

Computation and Language · Computer Science 2025-03-03 Samuele Poppi , Zheng-Xin Yong , Yifei He , Bobbie Chern , Han Zhao , Aobo Yang , Jianfeng Chi

Vision-language models demand watermarking solutions that protect intellectual property without compromising multimodal coherence. Existing text watermarking methods disrupt visual-textual alignment through biased token selection and static…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Shuliang Liu , Qi Zheng , Jesse Jiaxi Xu , Yibo Yan , Junyan Zhang , He Geng , Aiwei Liu , Peijie Jiang , Jia Liu , Yik-Cheung Tam , Xuming Hu

In recent years, the security vulnerabilities of Multi-modal Large Language Models (MLLMs) have become a serious concern in the Generative Artificial Intelligence (GenAI) research. These highly intelligent models, capable of performing…

Cryptography and Security · Computer Science 2026-01-12 Badhan Chandra Das , Md Tasnim Jawad , Joaquin Molto , M. Hadi Amini , Yanzhao Wu

Large Language Models (LLMs) have exploded a new heatwave of AI for their ability to engage end-users in human-level conversations with detailed and articulate answers across many knowledge domains. In response to their fast adoption in…

Vision-language models (VLMs) are essential for contextual understanding of both visual and textual information. However, their vulnerability to adversarially manipulated inputs presents significant risks, leading to compromised outputs and…

Machine Learning · Computer Science 2024-10-02 Xuefeng Du , Reshmi Ghosh , Robert Sim , Ahmed Salem , Vitor Carvalho , Emily Lawton , Yixuan Li , Jack W. Stokes

Vision Language Models (VLMs) have become essential backbones for multimodal intelligence, yet significant safety challenges limit their real-world application. While textual inputs are often effectively safeguarded, adversarial visual…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yi Ding , Bolian Li , Ruqi Zhang

Automating software vulnerability detection (SVD) remains a critical challenge in an era of increasingly complex and interdependent software systems. Despite significant advances in Large Language Models (LLMs) for code analysis, prevailing…

Software Engineering · Computer Science 2025-03-25 Arastoo Zibaeirad , Marco Vieira

This paper introduces MetaDefense, a novel framework for defending against finetuning-based jailbreak attacks in large language models (LLMs). We observe that existing defense mechanisms fail to generalize to harmful queries disguised by…

Machine Learning · Computer Science 2025-10-10 Weisen Jiang , Sinno Jialin Pan

Large Language Models (LLMs) have transformed machine learning but raised significant legal concerns due to their potential to produce text that infringes on copyrights, resulting in several high-profile lawsuits. The legal landscape is…

Computation and Language · Computer Science 2024-08-22 Xiaoze Liu , Ting Sun , Tianyang Xu , Feijie Wu , Cunxiang Wang , Xiaoqian Wang , Jing Gao

With the widespread adoption of Large Language Models (LLMs), jailbreak attacks have become an increasingly pressing safety concern. While safety-aligned LLMs can effectively defend against normal harmful queries, they remain vulnerable to…

Computation and Language · Computer Science 2025-04-21 Yu Li , Han Jiang , Zhihua Wei

As large language models (LLMs) become ubiquitous, parameter-efficient fine-tuning methods and safety-first defenses have proliferated rapidly. However, the number of approaches and their recent increase have resulted in diverse…

Machine Learning · Computer Science 2025-06-03 Saad Hossain , Samanvay Vajpayee , Sirisha Rambhatla

Large Audio Language Models (LALMs) expand jailbreak risks from token-level prompting to the full speech perception-to-reasoning pipeline, where unsafe behavior can be induced through semantics, acoustic style, signal artifacts, or internal…

Sound · Computer Science 2026-05-29 Bo-Han Feng , Yu-Hsuan Li Liang , Chien-Feng Liu , You-Hsuan Chang , Yun-Nung Chen

As the use of large language models (LLMs) continues to expand, ensuring their safety and robustness has become a critical challenge. In particular, jailbreak attacks that bypass built-in safety mechanisms are increasingly recognized as a…

Cryptography and Security · Computer Science 2025-11-19 Hajun Kim , Hyunsik Na , Daeseon Choi

Jailbreak attacks represent one of the most sophisticated threats to the security of large language models (LLMs). To deal with such risks, we introduce an innovative framework that can help evaluate the effectiveness of jailbreak attacks…

Computation and Language · Computer Science 2025-03-19 Dong Shu , Chong Zhang , Mingyu Jin , Zihao Zhou , Lingyao Li , Yongfeng Zhang

Vision-Language Models (VLMs) have witnessed a surge in both research and real-world applications. However, as they are becoming increasingly prevalent, ensuring their robustness against adversarial attacks is paramount. This work…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Rishika Bhagwatkar , Shravan Nayak , Reza Bayat , Alexis Roger , Daniel Z Kaplan , Pouya Bashivan , Irina Rish

Vision-Language Models (VLMs) can perform zero-shot classification but are susceptible to adversarial attacks. While robust fine-tuning improves their robustness, existing approaches align fixed text embeddings with an image embedding,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Junhao Dong , Yifei Zhang , Hao Zhu , Yew-Soon Ong , Piotr Koniusz

Large language models (LLMs), such as ChatGPT, have emerged with astonishing capabilities approaching artificial general intelligence. While providing convenience for various societal needs, LLMs have also lowered the cost of generating…

Computation and Language · Computer Science 2023-08-28 Zhenhua Wang , Wei Xie , Kai Chen , Baosheng Wang , Zhiwen Gui , Enze Wang

Training end-to-end policies from image data to directly predict navigation actions for robotic systems has proven inherently difficult. Existing approaches often suffer from either the sim-to-real gap during policy transfer or a limited…

Robotics · Computer Science 2026-03-17 Lazar Milikic , Manthan Patel , Jonas Frey

As the real propagation environment becomes in creasingly complex and dynamic, millimeter wave beam prediction faces huge challenges. However, the powerful cross modal representation capability of vision-language model (VLM) provides a…

Signal Processing · Electrical Eng. & Systems 2025-08-18 Ji Wang , Bin Tang , Jian Xiao , Qimei Cui , Xingwang Li , Tony Q. S. Quek

Large language models (LLMs) have become increasingly integrated with various applications. To ensure that LLMs do not generate unsafe responses, they are aligned with safeguards that specify what content is restricted. However, such…

Computation and Language · Computer Science 2024-05-08 Hongyu Cai , Arjun Arunasalam , Leo Y. Lin , Antonio Bianchi , Z. Berkay Celik