中文
相关论文

相关论文: SafeRoPE: Risk-specific Head-wise Embedding Rotati…

200 篇论文

Modern text-to-image (T2I) generation systems (e.g., DALL$\cdot$E 3) exploit the memory mechanism, which captures key information in multi-turn interactions for faithful generation. Despite its practicality, the security analyses of this…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Shiqian Zhao , Jiayang Liu , Yiming Li , Runyi Hu , Xiaojun Jia , Wenshu Fan , Xiao Bao , Xinfeng Li , Jie Zhang , Wei Dong , Tianwei Zhang , Luu Anh Tuan

While Multimodal Large Language Models (MLLMs) have made remarkable progress in vision-language reasoning, they are also more susceptible to producing harmful content compared to models that focus solely on text. Existing defensive…

计算与语言 · 计算机科学 2024-12-30 Yilei Jiang , Yingshui Tan , Xiangyu Yue

Generative image compression has recently shown impressive perceptual quality, but often suffers from semantic deviations caused by generative hallucinations at ultra-low bitrate (bpp < 0.05), limiting its reliable deployment in…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Kaile Wang , Lijun He , Haisheng Fu , Haixia Bi , Fan Li

Recent works show that text-to-image generative models are surprisingly vulnerable to a variety of poisoning attacks. Empirical results find that these models can be corrupted by altering associations between individual text prompts and…

密码学与安全 · 计算机科学 2024-09-20 Wenxin Ding , Cathy Y. Li , Shawn Shan , Ben Y. Zhao , Haitao Zheng

Controllable text-to-image (T2I) diffusion models generate images conditioned on both text prompts and semantic inputs of other modalities like edge maps. Nevertheless, current controllable T2I methods commonly face challenges related to…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Xuehai He , Jian Zheng , Jacob Zhiyuan Fang , Robinson Piramuthu , Mohit Bansal , Vicente Ordonez , Gunnar A Sigurdsson , Nanyun Peng , Xin Eric Wang

Text-to-image models have shown remarkable capabilities in generating high-quality images from natural language descriptions. However, these models are highly vulnerable to adversarial prompts, which can bypass safety measures and produce…

密码学与安全 · 计算机科学 2025-10-16 Peigui Qi , Kunsheng Tang , Wenbo Zhou , Weiming Zhang , Nenghai Yu , Tianwei Zhang , Qing Guo , Jie Zhang

Multimodal Large Language Models (MLLMs) are susceptible to the implicit reasoning risk, wherein innocuous unimodal inputs synergistically assemble into risky multimodal data that produce harmful outputs. We attribute this vulnerability to…

人工智能 · 计算机科学 2025-09-17 Wei Cai , Shujuan Liu , Jian Zhao , Ziyan Shi , Yusheng Zhao , Yuchen Yuan , Tianle Zhang , Chi Zhang , Xuelong Li

This paper studies how Transformer models with Rotary Position Embeddings (RoPE) develop emergent, wavelet-like properties that compensate for the positional encoding's theoretical limitations. Through an analysis spanning model scales,…

机器学习 · 计算机科学 2025-06-06 Valeria Ruscio , Umberto Nanni , Fabrizio Silvestri

Large Reasoning Models (LRMs) achieve remarkable success through explicit thinking steps, yet the thinking steps introduce a novel risk by potentially amplifying unsafe behaviors. Despite this vulnerability, conventional defense mechanisms…

人工智能 · 计算机科学 2026-01-08 Su-Hyeon Kim , Hyundong Jin , Yejin Lee , Yo-Sub Han

Rotary Positional Encoding (RoPE) is widely used in modern large language models. However, when sequences are extended beyond the range seen during training, rotary phases can enter out-of-distribution regimes, leading to spurious…

机器学习 · 计算机科学 2026-05-12 Riccardo Ali , Alessio Borgi , Christopher Irwin , Mario Severino , Pietro Liò

Generating rare compositional concepts in text-to-image synthesis remains a challenge for diffusion models, particularly for attributes that are uncommon in the training data. While recent approaches, such as R2F, address this challenge by…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Kwanyoung Lee , Hyunwoo Oh , SeungJu Cha , Sungho Koh , Dong-Jin Kim

Rectified flow models have become a de facto standard in image generation due to their stable sampling trajectories and high-fidelity outputs. Despite their strong generative capabilities, they face critical limitations in image editing…

计算机视觉与模式识别 · 计算机科学 2025-10-31 Sung-Hoon Yoon , Minghan Li , Gaspard Beaudouin , Congcong Wen , Muhammad Rafay Azhar , Mengyu Wang

Neural network NLP models are vulnerable to small modifications of the input that maintain the original meaning but result in a different prediction. In this paper, we focus on robustness of text classification against word substitutions,…

计算与语言 · 计算机科学 2021-05-06 Emanuele La Malfa , Min Wu , Luca Laurenti , Benjie Wang , Anthony Hartshorn , Marta Kwiatkowska

Transformer-based text classifiers such as BERT, RoBERTa, T5, and GPT have shown strong performance in natural language processing tasks but remain vulnerable to adversarial examples. These vulnerabilities raise significant security…

计算与语言 · 计算机科学 2025-10-27 Bushra Sabir , Yansong Gao , Alsharif Abuadbba , M. Ali Babar

Text guided diffusion models are used by millions of users, but can be easily exploited to produce harmful content. Concept unlearning methods aim at reducing the models' likelihood of generating harmful content. Traditionally, this has…

人工智能 · 计算机科学 2026-02-10 Mansi , Avinash Kori , Francesca Toni , Soteris Demetriou

The recent advances in diffusion models (DMs) have revolutionized the generation of realistic and complex images. However, these models also introduce potential safety hazards, such as producing harmful content and infringing data…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Yimeng Zhang , Jinghan Jia , Xin Chen , Aochuan Chen , Yihua Zhang , Jiancheng Liu , Ke Ding , Sijia Liu

Text-to-image (T2I) models have been widely applied in generating high-fidelity images across various domains. However, these models may also be abused to produce Not-Safe-for-Work (NSFW) content via jailbreak attacks. Existing jailbreak…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Xingkai Peng , Jun Jiang , Meng Tong , Shuai Li , Weiming Zhang , Nenghai Yu , Kejiang Chen

Extending context window sizes allows large language models (LLMs) to process longer sequences and handle more complex tasks. Rotary Positional Embedding (RoPE) has become the de facto standard due to its relative positional encoding…

计算与语言 · 计算机科学 2024-11-27 Haonan Wang , Qian Liu , Chao Du , Tongyao Zhu , Cunxiao Du , Kenji Kawaguchi , Tianyu Pang

The rapid advancement of generative AI highlights the importance of text-to-image (T2I) security, particularly with the threat of backdoor poisoning. Timely disclosure and mitigation of security vulnerabilities in T2I models are crucial for…

密码学与安全 · 计算机科学 2025-04-22 Chongye Guo , Jinhu Fu , Junfeng Fang , Kun Wang , Guorui Feng

Text-to-Image (T2I) models have made remarkable progress in generating images from text prompts, but their output quality and safety still depend heavily on how prompts are phrased. Existing safety methods typically refine prompts using…

计算机视觉与模式识别 · 计算机科学 2025-09-18 Jinwoo Jeon , JunHyeok Oh , Hayeong Lee , Byung-Jun Lee