中文
相关论文

相关论文: Unlearning Concepts from Text-to-Video Diffusion M…

200 篇论文

Recent advances in generative diffusion models have enabled text-controlled synthesis of realistic and diverse images with impressive quality. Despite these remarkable advances, the application of text-to-image generative models in computer…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Yulu Gan , Sungwoo Park , Alexander Schubert , Anthony Philippakis , Ahmed M. Alaa

Machine unlearning has emerged as a new paradigm to deliberately forget data samples from a given model in order to adhere to stringent regulations. However, existing machine unlearning methods have been primarily focused on classification…

机器学习 · 计算机科学 2024-02-05 Guihong Li , Hsiang Hsu , Chun-Fu Chen , Radu Marculescu

Text-to-Image (T2I) generation methods based on diffusion model have garnered significant attention in the last few years. Although these image synthesis methods produce visually appealing results, they frequently exhibit spelling errors…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Yiming Zhao , Zhouhui Lian

As Text-to-Image models continue to evolve, so does the risk of generating unsafe, copyrighted, or privacy-violating content. Existing safety interventions - ranging from training data curation and model fine-tuning to inference-time…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Shristi Das Biswas , Arani Roy , Kaushik Roy

A key aspect of text-to-image personalization methods is the manner in which the target concept is represented within the generative process. This choice greatly affects the visual fidelity, downstream editability, and disk space needed to…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Yuval Alaluf , Elad Richardson , Gal Metzer , Daniel Cohen-Or

Large-scale diffusion generative models are greatly simplifying image, video and 3D asset creation from user-provided text prompts and images. However, the challenging problem of text-to-4D dynamic 3D scene generation with diffusion…

计算机视觉与模式识别 · 计算机科学 2024-05-08 Yufeng Zheng , Xueting Li , Koki Nagano , Sifei Liu , Karsten Kreis , Otmar Hilliges , Shalini De Mello

Lifelong few-shot customization for text-to-image diffusion aims to continually generalize existing models for new tasks with minimal data while preserving old knowledge. Current customization diffusion models excel in few-shot tasks but…

计算机视觉与模式识别 · 计算机科学 2024-11-11 Nan Song , Xiaofeng Yang , Ze Yang , Guosheng Lin

Vision-language models bridge visual and linguistic understanding and have proven to be powerful for video recognition tasks. Existing approaches primarily rely on parameter-efficient fine-tuning of image-text pre-trained models, yet they…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Wencheng Zhu , Yuexin Wang , Hongxuan Li , Pengfei Zhu , Qinghua Hu

Instruction-based unlearning has proven effective for modifying the behavior of large language models at inference time, but whether this paradigm extends to other generative models remains unclear. In this work, we investigate…

计算与语言 · 计算机科学 2026-04-03 Zeliang Zhang , Rui Sun , Jiani Liu , Qi Wu , Chenliang Xu

We present an efficient text-to-video generation framework based on latent diffusion models, termed MagicVideo. MagicVideo can generate smooth video clips that are concordant with the given text descriptions. Due to a novel and efficient 3D…

计算机视觉与模式识别 · 计算机科学 2023-05-12 Daquan Zhou , Weimin Wang , Hanshu Yan , Weiwei Lv , Yizhe Zhu , Jiashi Feng

Customized text-to-video generation (CTVG) has recently witnessed great progress in generating tailored videos from user-specific text. However, most CTVG methods assume that personalized concepts remain static and do not expand…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Jiahua Dong , Xudong Wang , Wenqi Liang , Zongyan Han , Meng Cao , Duzhen Zhang , Hanbin Zhao , Zhi Han , Salman Khan , Fahad Shahbaz Khan

We introduce a novel approach for concept blending in pretrained text-to-image diffusion models, aiming to generate images at the intersection of multiple text prompts. At each time step during diffusion denoising, our algorithm forecasts…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Divya Kothandaraman , Ming Lin , Dinesh Manocha

Visual concept learning, also known as Text-to-image personalization, is the process of teaching new concepts to a pretrained model. This has numerous applications from product placement to entertainment and personalized design. Here we…

计算机视觉与模式识别 · 计算机科学 2025-08-13 Ori Malca , Dvir Samuel , Gal Chechik

Post-hoc unlearning has emerged as a practical mechanism for removing undesirable concepts from large text-to-image diffusion models. However, prior work primarily evaluates unlearning through erasure success; its impact on broader…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Arian Komaei Koma , Seyed Amir Kasaei , Ali Aghayari , AmirMahdi Sadeghzadeh , Mohammad Hossein Rohban

Security concerns surrounding text-to-image diffusion models have driven researchers to unlearn inappropriate concepts through fine-tuning. Recent fine-tuning methods typically align the prediction distributions of unsafe prompts with those…

机器学习 · 计算机科学 2025-01-03 Mengnan Zhao , Lihe Zhang , Xingyi Yang , Tianhang Zheng , Baocai Yin

Recent advances in large-scale text-to-image diffusion models have heightened concerns about their potential misuse, especially in generating harmful or misleading content. This underscores the urgent need for effective machine unlearning,…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Agnieszka Polowczyk , Alicja Polowczyk , Dawid Malarz , Artur Kasymov , Marcin Mazur , Jacek Tabor , Przemysław Spurek

Machine unlearning aims to remove specific outputs from trained models, often at the concept level, such as forgetting all occurrences of a particular celebrity or filtering content via text prompts. However, many undesired outputs, such as…

机器学习 · 计算机科学 2026-03-13 Kyungryeol Lee , Kyeonghyun Lee , Seongmin Hong , Byung Hyun Lee , Se Young Chun

Text-to-image models encounter safety issues, including concerns related to copyright and Not-Safe-For-Work (NSFW) content. Despite several methods have been proposed for erasing inappropriate concepts from diffusion models, they often…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Chao Gong , Kai Chen , Zhipeng Wei , Jingjing Chen , Yu-Gang Jiang

Text-to-image diffusion models have emerged as powerful tools for high-quality image generation and editing. Many existing approaches rely on text prompts as editing guidance. However, these methods are constrained by the need for manual…

计算机视觉与模式识别 · 计算机科学 2025-05-21 Yuanyuan Chang , Yinghua Yao , Tao Qin , Mengmeng Wang , Ivor Tsang , Guang Dai

Text-to-image model personalization aims to introduce a user-provided concept to the model, allowing its synthesis in diverse contexts. However, current methods primarily focus on the case of learning a single concept from multiple images…

计算机视觉与模式识别 · 计算机科学 2023-12-14 Omri Avrahami , Kfir Aberman , Ohad Fried , Daniel Cohen-Or , Dani Lischinski