中文
相关论文

相关论文: Towards Resilient Safety-driven Unlearning for Dif…

200 篇论文

Reference-to-video (R2V) generation is a controllable video synthesis paradigm that constrains the generation process using both text prompts and reference images, enabling applications such as personalized advertising and virtual try-on.…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Lei Wang , YuXin Song , Ge Wu , Haocheng Feng , Hang Zhou , Jingdong Wang , Yaxing Wang , jian Yang

Diffusion models have achieved remarkable success in text-to-image generation. However, their practical applications are hindered by the misalignment between generated images and corresponding text prompts. To tackle this issue,…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Zijing Hu , Fengda Zhang , Long Chen , Kun Kuang , Jiahui Li , Kaifeng Gao , Jun Xiao , Xin Wang , Wenwu Zhu

Text-to-image (T2I) models such as Stable Diffusion have advanced rapidly and are now widely used in content creation. However, these models can be misused to generate harmful content, including nudity or violence, posing significant safety…

密码学与安全 · 计算机科学 2025-06-13 Zilong Wang , Xiang Zheng , Xiaosen Wang , Bo Wang , Xingjun Ma , Yu-Gang Jiang

The rapid advancement of diffusion models has enabled high-fidelity and semantically rich text-to-image generation; however, ensuring fairness and safety remains an open challenge. Existing methods typically improve fairness and safety at…

计算机视觉与模式识别 · 计算机科学 2025-10-09 Silpa Vadakkeeveetil Sreelatha , Sauradip Nag , Muhammad Awais , Serge Belongie , Anjan Dutta

Text-to-image diffusion models have revolutionized generative AI, but their vulnerability to backdoor attacks poses significant security risks. Adversaries can inject imperceptible textual triggers into training data, causing models to…

计算机视觉与模式识别 · 计算机科学 2025-08-26 Ashwath Vaithinathan Aravindan , Abha Jha , Matthew Salaway , Atharva Sandeep Bhide , Duygu Nur Yaldiz

In the recent development of conditional diffusion models still require heavy supervised fine-tuning for performing control on a category of tasks. Training-free conditioning via guidance with off-the-shelf models is a favorable alternative…

计算机视觉与模式识别 · 计算机科学 2025-08-04 Christian Simon , Masato Ishii , Akio Hayakawa , Zhi Zhong , Shusuke Takahashi , Takashi Shibuya , Yuki Mitsufuji

This tutorial provides a comprehensive survey of methods for fine-tuning diffusion models to optimize downstream reward functions. While diffusion models are widely known to provide excellent generative modeling capability, practical…

机器学习 · 计算机科学 2024-07-19 Masatoshi Uehara , Yulai Zhao , Tommaso Biancalani , Sergey Levine

While generative models have made significant advancements in recent years, they also raise concerns such as privacy breaches and biases. Machine unlearning has emerged as a viable solution, aiming to remove specific training data, e.g.,…

机器学习 · 计算机科学 2025-02-20 Xiaohua Feng , Yuyuan Li , Chaochao Chen , Li Zhang , Longfei Li , Jun Zhou , Xiaolin Zheng

Autoregressive video diffusion models hold promise for world simulation but are vulnerable to exposure bias arising from the train-test mismatch. While recent works address this via post-training, they typically rely on a bidirectional…

计算机视觉与模式识别 · 计算机科学 2025-12-18 Yuwei Guo , Ceyuan Yang , Hao He , Yang Zhao , Meng Wei , Zhenheng Yang , Weilin Huang , Dahua Lin

Text-to-image (T2I) models are widespread, but their limited safety guardrails expose end users to harmful content and potentially allow for model misuse. Current safety measures are typically limited to text-based filtering or concept…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Runtao Liu , I Chieh Chen , Jindong Gu , Jipeng Zhang , Renjie Pi , Qifeng Chen , Philip Torr , Ashkan Khakzar , Fabio Pizzati

Denoising-based generative models, particularly diffusion and flow matching algorithms, have achieved remarkable success. However, aligning their output distributions with complex downstream objectives, such as human preferences,…

机器学习 · 计算机科学 2025-08-29 Luozhijie Jin , Zijie Qiu , Jie Liu , Zijie Diao , Lifeng Qiao , Ning Ding , Alex Lamb , Xipeng Qiu

Advanced text-to-image diffusion models raise safety concerns regarding identity privacy violation, copyright infringement, and Not Safe For Work content generation. Towards this, unlearning methods have been developed to erase these…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Xiaoxuan Han , Songlin Yang , Wei Wang , Yang Li , Jing Dong

The generative AI revolution in recent years has been spurred by an expansion in compute power and data quantity, which together enable extensive pre-training of powerful text-to-image (T2I) models. With their greater capabilities to…

Security concerns surrounding text-to-image diffusion models have driven researchers to unlearn inappropriate concepts through fine-tuning. Recent fine-tuning methods typically align the prediction distributions of unsafe prompts with those…

机器学习 · 计算机科学 2025-01-03 Mengnan Zhao , Lihe Zhang , Xingyi Yang , Tianhang Zheng , Baocai Yin

Machine unlearning offers a promising solution to privacy and safety concerns in large language models (LLMs) by selectively removing targeted knowledge while preserving utility. However, current methods are highly sensitive to downstream…

Text-to-Image (T2I) diffusion models have demonstrated significant advancements in generating high-quality images, while raising potential safety concerns regarding harmful content generation. Safety-guidance-based methods have been…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Yongli Xiang , Ziming Hong , Zhaoqing Wang , Xiangyu Zhao , Bo Han , Tongliang Liu

In the text-to-image generation field, recent remarkable progress in Stable Diffusion makes it possible to generate rich kinds of novel photorealistic images. However, current models still face misalignment issues (e.g., problematic spatial…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Leigang Qu , Shengqiong Wu , Hao Fei , Liqiang Nie , Tat-Seng Chua

Recently, we have seen a surge of personalization methods for text-to-image (T2I) diffusion models to learn a concept using a few images. Existing approaches, when used for face personalization, suffer to achieve convincing inversion with…

计算机视觉与模式识别 · 计算机科学 2024-08-12 Rishubh Parihar , Sachidanand VS , Sabariswaran Mani , Tejan Karmali , R. Venkatesh Babu

Text-to-Image (T2I) diffusion/flow models have recently achieved remarkable progress in visual fidelity and text alignment. However, they remain limited when users need to precisely control image layouts, something that natural language…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Amadou S. Sangare , Adrien Maglo , Mohamed Chaouch , Bertrand Luvison

Instruction-following language models are trained to be helpful and safe, yet their safety behavior can deteriorate under benign fine-tuning and worsen under adversarial updates. Existing defenses often offer limited protection or force a…

计算与语言 · 计算机科学 2026-05-12 Jyotin Goel , Souvik Maji , Pratik Mazumder