English
Related papers

Related papers: Stable Diffusion is a Natural Cross-Modal Decoder …

200 papers

Latent diffusion models excel at producing high-quality images from text. Yet, concerns appear about the lack of diversity in the generated imagery. To tackle this, we introduce Diverse Diffusion, a method for boosting image diversity…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Mariia Zameshina , Olivier Teytaud , Laurent Najman

Generative image modeling enables a wide range of applications but raises ethical concerns about responsible deployment. This paper introduces an active strategy combining image watermarking and Latent Diffusion Models. The goal is for all…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Pierre Fernandez , Guillaume Couairon , Hervé Jégou , Matthijs Douze , Teddy Furon

The Stable Diffusion model is a prominent text-to-image generation model that relies on a text prompt as its input, which is encoded using the Contrastive Language-Image Pre-Training (CLIP). However, text prompts have limitations when it…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Yuxuan Ding , Chunna Tian , Haoxuan Ding , Lingqiao Liu

Text-guided non-rigid editing involves complex edits for input images, such as changing motion or compositions within their surroundings. Since it requires manipulating the input structure, existing methods often struggle with preserving…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Yunji Jung , Seokju Lee , Tair Djanibekov , Hyunjung Shim , Jong Chul Ye

Text-driven diffusion models have exhibited impressive generative capabilities, enabling various image editing tasks. In this paper, we propose TF-ICON, a novel Training-Free Image COmpositioN framework that harnesses the power of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Shilin Lu , Yanzhu Liu , Adams Wai-Kin Kong

Denoising diffusion models have emerged as the go-to generative framework for solving inverse problems in imaging. A critical concern regarding these models is their performance on out-of-distribution tasks, which remains an under-explored…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Riccardo Barbano , Alexander Denker , Hyungjin Chung , Tae Hoon Roh , Simon Arridge , Peter Maass , Bangti Jin , Jong Chul Ye

This paper examines three major generative modelling frameworks: Variational Autoencoders (VAEs), Generative Adversarial Networks (GANs), and Stable Diffusion models. VAEs are effective at learning latent representations but frequently…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Sanchayan Vivekananthan

Generative models, e.g., Stable Diffusion, have enabled the creation of photorealistic images from text prompts. Yet, the generation of 360-degree panorama images from text remains a challenge, particularly due to the dearth of paired…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Cheng Zhang , Qianyi Wu , Camilo Cruz Gambardella , Xiaoshui Huang , Dinh Phung , Wanli Ouyang , Jianfei Cai

Diffusion models have attracted significant attention due to the remarkable ability to create content and generate data for tasks like image classification. However, the usage of diffusion models to generate the high-quality object…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Kai Chen , Enze Xie , Zhe Chen , Yibo Wang , Lanqing Hong , Zhenguo Li , Dit-Yan Yeung

In the ever-expanding digital landscape, safeguarding sensitive information remains paramount. This paper delves deep into digital protection, specifically focusing on steganography. While prior research predominantly fixated on individual…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Quang Nguyen , Truong Vu , Cuong Pham , Anh Tran , Khoi Nguyen

We seek to give users precise control over diffusion-based image generation by modeling complex scenes as sequences of layers, which define the desired spatial arrangement and visual attributes of objects in the scene. Collage Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Vishnu Sarukkai , Linden Li , Arden Ma , Christopher Ré , Kayvon Fatahalian

Image-based fashion design with AI techniques has attracted increasing attention in recent years. We focus on a new fashion design task, where we aim to transfer a reference appearance image onto a clothing image while preserving the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Shidong Cao , Wenhao Chai , Shengyu Hao , Yanting Zhang , Hangyue Chen , Gaoang Wang

Diffusion-based image compression has recently shown outstanding perceptual fidelity, yet its practicality is hindered by prohibitive sampling overhead and high memory usage. Most existing diffusion codecs employ U-Net architectures, where…

Image and Video Processing · Electrical Eng. & Systems 2026-03-16 Junqi Shi , Ming Lu , Xingchen Li , Anle Ke , Ruiqi Zhang , Zhan Ma

Recent progress in generative AI, especially diffusion models, has demonstrated significant utility in text-to-image synthesis. Particularly in healthcare, these models offer immense potential in generating synthetic datasets and training…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yan Luo , Muhammad Osama Khan , Congcong Wen , Muhammad Muneeb Afzal , Titus Fidelis Wuermeling , Min Shi , Yu Tian , Yi Fang , Mengyu Wang

Recently, diffusion models have made remarkable progress in text-to-image (T2I) generation, synthesizing images with high fidelity and diverse contents. Despite this advancement, latent space smoothness within diffusion models remains…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Jiayi Guo , Xingqian Xu , Yifan Pu , Zanlin Ni , Chaofei Wang , Manushree Vasu , Shiji Song , Gao Huang , Humphrey Shi

Animating stylized avatars with dynamic poses and expressions has attracted increasing attention for its broad range of applications. Previous research has made significant progress by training controllable generative models to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Ken Chen , Sachith Seneviratne , Wei Wang , Dongting Hu , Sanjay Saha , Md. Tarek Hasan , Sanka Rasnayaka , Tamasha Malepathirana , Mingming Gong , Saman Halgamuge

Text-to-image (T2I) models have significantly advanced the development of artificial intelligence, enabling the generation of high-quality images in diverse contexts based on specific text prompts. However, existing T2I-based methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Salaheldin Mohamed , Dong Han , Yong Li

Text-to-image generation has important implications for generation of diverse and controllable images. Several attempts have been made to adapt Stable Diffusion (SD) to the medical domain. However, the large distribution difference between…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Peng Huang , Xue Gao , Lihong Huang , Jing Jiao , Xiaokang Li , Yuanyuan Wang , Yi Guo

Generating cognitive-aligned layered SVGs remains challenging due to existing methods' tendencies toward either oversimplified single-layer outputs or optimization-induced shape redundancies. We propose LayerTracer, a diffusion transformer…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Yiren Song , Danze Chen , Mike Zheng Shou

Transparent image layer generation plays a significant role in digital art and design workflows. Existing methods typically decompose transparent layers from a single RGB image using a set of tools or generate multiple transparent layers…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Dingbang Huang , Wenbo Li , Yifei Zhao , Xinyu Pan , Chun Wang , Yanhong Zeng , Bo Dai