中文
相关论文

相关论文: Safeguard Text-to-Image Diffusion Models with Huma…

200 篇论文

Text-to-image diffusion models suffer from the risk of generating outdated, copyrighted, incorrect, and biased content. While previous methods have mitigated the issues on a small scale, it is essential to handle them simultaneously in…

计算机视觉与模式识别 · 计算机科学 2024-10-14 Tianwei Xiong , Yue Wu , Enze Xie , Yue Wu , Zhenguo Li , Xihui Liu

Image diffusion models, trained on massive image collections, have emerged as the most versatile image generator model in terms of quality and diversity. They support inverting real images and conditional (e.g., text) generation, making…

计算机视觉与模式识别 · 计算机科学 2023-03-23 Duygu Ceylan , Chun-Hao Paul Huang , Niloy J. Mitra

Image-to-image translation aims to learn a mapping between a source and a target domain, enabling tasks such as style transfer, appearance transformation, and domain adaptation. In this work, we explore a diffusion-based framework for…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Qiang Zhu , Kuan Lu , Menghao Huo , Yuxiao Li

The rapid adoption of text-to-image diffusion models in society underscores an urgent need to address their biases. Without interventions, these biases could propagate a skewed worldview and restrict opportunities for minority groups. In…

机器学习 · 计算机科学 2024-03-18 Xudong Shen , Chao Du , Tianyu Pang , Min Lin , Yongkang Wong , Mohan Kankanhalli

Vanilla text-to-image diffusion models struggle with generating accurate human images, commonly resulting in imperfect anatomies such as unnatural postures or disproportionate limbs.Existing methods address this issue mostly by fine-tuning…

计算机视觉与模式识别 · 计算机科学 2024-03-11 Junyan Wang , Zhenhong Sun , Zhiyu Tan , Xuanbai Chen , Weihua Chen , Hao Li , Cheng Zhang , Yang Song

Diffusion models have attained remarkable success in the domains of image generation and editing. It is widely recognized that employing larger inversion and denoising steps in diffusion model leads to improved image reconstruction quality.…

计算机视觉与模式识别 · 计算机科学 2024-01-05 Chen Hou , Guoqiang Wei , Zhibo Chen

Recently, large-scale text-to-image (T2I) diffusion models have emerged as a powerful tool for image-to-image translation (I2I), allowing open-domain image translation via user-provided text prompts. This paper proposes frequency-controlled…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Xiang Gao , Zhengbo Xu , Junhan Zhao , Jiaying Liu

We propose Context Diffusion, a diffusion-based framework that enables image generation models to learn from visual examples presented in context. Recent work tackles such in-context learning for image generation, where a query image is…

计算机视觉与模式识别 · 计算机科学 2025-07-24 Ivona Najdenkoska , Animesh Sinha , Abhimanyu Dubey , Dhruv Mahajan , Vignesh Ramanathan , Filip Radenovic

Text-to-image (TTI) systems, particularly those utilizing open-source frameworks, have become increasingly prevalent in the production of Artificial Intelligence (AI)-generated visuals. While existing literature has explored various…

人机交互 · 计算机科学 2024-08-29 Maria-Teresa De Rosa Palmini , Laura Wagner , Eva Cetinic

Text-to-image models have recently made significant advances in generating realistic and semantically coherent images, driven by advanced diffusion models and large-scale web-crawled datasets. However, these datasets often contain…

机器学习 · 计算机科学 2025-10-29 Byeonghu Na , Mina Kang , Jiseok Kwak , Minsang Park , Jiwoo Shin , SeJoon Jun , Gayoung Lee , Jin-Hwa Kim , Il-Chul Moon

Recent advances in Diffusion Models have enabled the generation of images from text, with powerful closed-source models like DALL-E and Midjourney leading the way. However, open-source alternatives, such as StabilityAI's Stable Diffusion,…

Recent advancements in controllable text-to-image (T2I) diffusion models, such as Ctrl-X and FreeControl, have demonstrated robust spatial and appearance control without requiring auxiliary module training. However, these models often…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Jiwon Kim , Pureum Kim , SeonHwa Kim , Soobin Park , Eunju Cha , Kyong Hwan Jin

Text-to-image diffusion models are a class of deep generative models that have demonstrated an impressive capacity for high-quality image generation. However, these models are susceptible to implicit biases that arise from web-scale…

计算机视觉与模式识别 · 计算机科学 2024-01-24 Yinan Zhang , Eric Tzeng , Yilun Du , Dmitry Kislyuk

In today's age of social media and marketing, copyright issues can be a major roadblock to the free sharing of images. Generative AI models have made it possible to create high-quality images, but concerns about copyright infringement are a…

计算机视觉与模式识别 · 计算机科学 2025-05-23 Mazharul Islam Rakib , Showrin Rahman , Joyanta Jyoti Mondal , Xi Xiao , David Lewis , Alessandra Mileo , Meem Arafat Manab

While modern diffusion models excel at generating high-quality and diverse images, they still struggle with high-fidelity compositional and multimodal control, particularly when users simultaneously specify text prompts, subject references,…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Yusuf Dalva , Guocheng Gordon Qian , Maya Goldenberg , Tsai-Shien Chen , Kfir Aberman , Sergey Tulyakov , Pinar Yanardag , Kuan-Chieh Jackson Wang

The use of denoising diffusion models is becoming increasingly popular in the field of image editing. However, current approaches often rely on either image-guided methods, which provide a visual reference but lack control over semantic…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Zhanbo Feng , Zenan Ling , Xinyu Lu , Ci Gong , Feng Zhou , Wugedele Bao , Jie Li , Fan Yang , Robert C. Qiu

Natural language often contains ambiguities that can lead to misinterpretation and miscommunication. While humans can handle ambiguities effectively by asking clarifying questions and/or relying on contextual cues and common-sense…

While there has been significant progress in customizing text-to-image generation models, generating images that combine multiple personalized concepts remains challenging. In this work, we introduce Concept Weaver, a method for composing…

计算机视觉与模式识别 · 计算机科学 2024-04-08 Gihyun Kwon , Simon Jenni , Dingzeyu Li , Joon-Young Lee , Jong Chul Ye , Fabian Caba Heilbron

We present a simple but effective training-free approach for text-driven image-to-image translation based on a pretrained text-to-image diffusion model. Our goal is to generate an image that aligns with the target task while preserving the…

计算机视觉与模式识别 · 计算机科学 2024-12-23 Hyunsoo Lee , Minsoo Kang , Bohyung Han

Real-world text image super-resolution aims to restore overall visual quality and text legibility in images suffering from diverse degradations and text distortions. However, the scarcity of text image data in existing datasets results in…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Haodong He , Xin Zhan , Yancheng Bai , Rui Lan , Lei Sun , Xiangxiang Chu