中文
相关论文

相关论文: Responsible Diffusion Models via Constraining Text…

200 篇论文

Pre-trained diffusion models have demonstrated remarkable proficiency in synthesizing images across a wide range of scenarios with customizable prompts, indicating their effective capacity to capture universal features. Motivated by this,…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Yuxiang Ji , Boyong He , Chenyuan Qu , Zhuoyue Tan , Chuan Qin , Liaoni Wu

As one of the most successful generative models, diffusion models have demonstrated remarkable efficacy in synthesizing high-quality images. These models learn the underlying high-dimensional data distribution in an unsupervised manner.…

计算机视觉与模式识别 · 计算机科学 2024-12-12 Min Hou , Yueying Wu , Chang Xu , Yu-Hao Huang , Chenxi Bai , Le Wu , Jiang Bian

Novel diffusion models can synthesize photo-realistic images with integrated high-quality text. Surprisingly, we demonstrate through attention activation patching that only less than $1$% of diffusion models' parameters, all contained in…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Łukasz Staniszewski , Bartosz Cywiński , Franziska Boenisch , Kamil Deja , Adam Dziedzic

The advent of social media in recent years has fed into some highly undesirable phenomena such as proliferation of offensive language, hate speech, sexist remarks, etc. on the Internet. In light of this, there have been several efforts to…

计算与语言 · 计算机科学 2018-09-05 Pushkar Mishra , Helen Yannakoudakis , Ekaterina Shutova

In spite of the rapidly evolving landscape of text-to-image generation, the synthesis and manipulation of multiple entities while adhering to specific relational constraints pose enduring challenges. This paper introduces an innovative…

计算机视觉与模式识别 · 计算机科学 2024-01-22 YuTeng Ye , Jiale Cai , Hang Zhou , Guanwen Li , Youjia Zhang , Zikai Song , Chenxing Gao , Junqing Yu , Wei Yang

Diffusion models have attracted significant attention due to its exceptional data generation capabilities in fields such as image synthesis. However, recent studies have shown that diffusion models are vulnerable to copyright infringement…

人工智能 · 计算机科学 2025-08-22 Zhixiang Guo , Siyuan Liang , Aishan Liu , Dacheng Tao

This paper explores a novel lightweight approach LightFair to achieve fair text-to-image diffusion models (T2I DMs) by addressing the adverse effects of the text encoder. Most existing methods either couple different parts of the diffusion…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Boyu Han , Qianqian Xu , Shilong Bao , Zhiyong Yang , Kangli Zi , Qingming Huang

Diffusion models have demonstrated significant potential in achieving state-of-the-art performance across various text generation tasks. In this systematic study, we investigate their application to the table-to-text problem by adapting the…

计算与语言 · 计算机科学 2024-09-24 Aleksei S. Krylov , Oleg D. Somov

Diffusion models for text-to-image generation, known for their efficiency, accessibility, and quality, have gained popularity. While inference with these systems on consumer-grade GPUs is increasingly feasible, training from scratch…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Bram de Wilde , Anindo Saha , Maarten de Rooij , Henkjan Huisman , Geert Litjens

The goal of scene text image super-resolution is to reconstruct high-resolution text-line images from unrecognizable low-resolution inputs. The existing methods relying on the optimization of pixel-level loss tend to yield text edges that…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Baolin Liu , Zongyuan Yang , Pengfei Wang , Junjie Zhou , Ziqi Liu , Ziyi Song , Yan Liu , Yongping Xiong

Scene text editing is a challenging task that involves modifying or inserting specified texts in an image while maintaining its natural and realistic appearance. Most previous approaches to this task rely on style-transfer models that crop…

计算机视觉与模式识别 · 计算机科学 2023-04-13 Jiabao Ji , Guanhua Zhang , Zhaowen Wang , Bairu Hou , Zhifei Zhang , Brian Price , Shiyu Chang

Text-to-image diffusion models have been widely adopted in real-world applications due to their ability to generate realistic images from textual descriptions. However, recent studies have shown that these methods are vulnerable to backdoor…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Oscar Chew , Po-Yi Lu , Jayden Lin , Hsuan-Tien Lin

Textual image generation spans diverse fields like advertising, education, product packaging, social media, information visualization, and branding. Despite recent strides in language-guided image synthesis using diffusion models, current…

计算机视觉与模式识别 · 计算机科学 2024-05-22 Shubham Paliwal , Arushi Jain , Monika Sharma , Vikram Jamwal , Lovekesh Vig

Diffusion models have achieved remarkable results in generating high-quality, diverse, and creative images. However, when it comes to text-based image generation, they often fail to capture the intended meaning presented in the text. For…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Kota Sueyoshi , Takashi Matsubara

The diffusion model has been proven a powerful generative model in recent years, yet remains a challenge in generating visual text. Several methods alleviated this issue by incorporating explicit text position and content as guidance on…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Jingye Chen , Yupan Huang , Tengchao Lv , Lei Cui , Qifeng Chen , Furu Wei

Diffusion models have shown superior performance in image generation and manipulation, but the inherent stochasticity presents challenges in preserving and manipulating image content and identity. While previous approaches like DreamBooth…

计算机视觉与模式识别 · 计算机科学 2023-04-20 Inhwa Han , Serin Yang , Taesung Kwon , Jong Chul Ye

Advanced diffusion-based Text-to-Image (T2I) models, such as the Stable Diffusion Model, have made significant progress in generating diverse and high-quality images using text prompts alone. However, when non-famous users require…

计算机视觉与模式识别 · 计算机科学 2024-03-25 Yang Li , Songlin Yang , Wei Wang , Jing Dong

Diffusion models for text-to-image (T2I) synthesis, such as Stable Diffusion (SD), have recently demonstrated exceptional capabilities for generating high-quality content. However, this progress has raised several concerns of potential…

机器学习 · 计算机科学 2024-06-10 Yu-Lin Tsai , Chia-Yi Hsu , Chulin Xie , Chih-Hsun Lin , Jia-You Chen , Bo Li , Pin-Yu Chen , Chia-Mu Yu , Chun-Ying Huang

Text-driven person image generation is an emerging and challenging task in cross-modality image generation. Controllable person image generation promotes a wide range of applications such as digital human interaction and virtual try-on.…

计算机视觉与模式识别 · 计算机科学 2022-11-14 Kaiduo Zhang , Muyi Sun , Jianxin Sun , Binghao Zhao , Kunbo Zhang , Zhenan Sun , Tieniu Tan

The emergence of Neural Radiance Fields (NeRF) has promoted the development of synthesized high-fidelity views of the intricate real world. However, it is still a very demanding task to repaint the content in NeRF. In this paper, we propose…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Xingchen Zhou , Ying He , F. Richard Yu , Jianqiang Li , You Li