English
Related papers

Related papers: Diffusion Autoencoders are Scalable Image Tokenize…

200 papers

Text-to-image diffusion models have emerged as powerful tools for high-quality image generation and editing. Many existing approaches rely on text prompts as editing guidance. However, these methods are constrained by the need for manual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Yuanyuan Chang , Yinghua Yao , Tao Qin , Mengmeng Wang , Ivor Tsang , Guang Dai

Large-scale, pre-trained Text-to-Image (T2I) diffusion models have gained significant popularity in image generation tasks and have shown unexpected potential in image Super-Resolution (SR). However, most existing T2I diffusion models are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Brian B. Moser , Stanislav Frolov , Tobias C. Nauen , Federico Raue , Andreas Dengel

Recently, diffusion models have been proven to perform remarkably well in text-to-image synthesis tasks in a number of studies, immediately presenting new study opportunities for image generation. Google's Imagen follows this research trend…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Ruijun Li , Weihua Li , Yi Yang , Hanyu Wei , Jianhua Jiang , Quan Bai

Conventional class-guided diffusion models generally succeed in generating images with correct semantic content, but often struggle with texture details. This limitation stems from the usage of class priors, which only provide coarse and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Xiaoyu Yue , Zidong Wang , Zeyu Lu , Shuyang Sun , Meng Wei , Wanli Ouyang , Lei Bai , Luping Zhou

Recent advancements in diffusion models have significantly improved performance in super-resolution (SR) tasks. However, previous research often overlooks the fundamental differences between SR and general image generation. General image…

Image and Video Processing · Electrical Eng. & Systems 2024-10-31 Hanlin Wu , Jiangwei Mo , Xiaohui Sun , Jie Ma

Text-to-image diffusion models have made significant progress in generating naturalistic images from textual inputs, and demonstrate the capacity to learn and represent complex visual-semantic relationships. While these diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Rushikesh Zawar , Shaurya Dewan , Prakanshul Saxena , Yingshan Chang , Andrew Luo , Yonatan Bisk

As scaling laws in generative AI push performance, they also simultaneously concentrate the development of these models among actors with large computational resources. With a focus on text-to-image (T2I) generative models, we aim to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Vikash Sehwag , Xianghao Kong , Jingtao Li , Michael Spranger , Lingjuan Lyu

Recent advances in latent diffusion models have demonstrated their effectiveness for high-resolution image synthesis. However, the properties of the latent space from tokenizer for better learning and generation of diffusion models remain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Hao Chen , Yujin Han , Fangyi Chen , Xiang Li , Yidong Wang , Jindong Wang , Ze Wang , Zicheng Liu , Difan Zou , Bhiksha Raj

While Large Language Models (LLMs) are the dominant models for generative tasks in language, they do not perform as well as diffusion models on image and video generation. To effectively use LLMs for visual generation, one crucial component…

Neural networks struggle with image classification when biases are learned and misleads correlations, affecting their generalization and performance. Previous methods require attribute labels (e.g. background, color) or utilizes Generative…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Donggeun Ko , Dongjun Lee , Namjun Park , Wonkyeong Shim , Jaekwang Kim

Text-to-image (T2I) diffusion models have achieved strong performance in semantic alignment, yet they still struggle with generating the correct number of objects specified in prompts. Existing approaches typically incorporate auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Nobline Yoo , Olga Russakovsky , Ye Zhu

This paper introduces a pioneering 3D volumetric encoder designed for text-to-3D generation. To scale up the training data for the diffusion model, a lightweight network is developed to efficiently acquire feature volumes from multi-view…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Zhicong Tang , Shuyang Gu , Chunyu Wang , Ting Zhang , Jianmin Bao , Dong Chen , Baining Guo

Recent research arXiv:2410.15027 has explored the use of diffusion transformers (DiTs) for task-agnostic image generation by simply concatenating attention tokens across images. However, despite substantial computational resources, the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Lianghua Huang , Wei Wang , Zhi-Fan Wu , Yupeng Shi , Huanzhang Dou , Chen Liang , Yutong Feng , Yu Liu , Jingren Zhou

Diffusion transformers have shown significant effectiveness in both image and video synthesis at the expense of huge computation costs. To address this problem, feature caching methods have been introduced to accelerate diffusion…

Machine Learning · Computer Science 2025-02-20 Chang Zou , Xuyang Liu , Ting Liu , Siteng Huang , Linfeng Zhang

Diffusion models have become the go-to method for text-to-image generation, producing high-quality images from pure noise. However, the inner workings of diffusion models is still largely a mystery due to their black-box nature and complex,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Berk Tinaz , Zalan Fabian , Mahdi Soltanolkotabi

Layout-to-image generation refers to the task of synthesizing photo-realistic images based on semantic layouts. In this paper, we propose LayoutDiffuse that adapts a foundational diffusion model pretrained on large-scale image or text-image…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Jiaxin Cheng , Xiao Liang , Xingjian Shi , Tong He , Tianjun Xiao , Mu Li

For learned image representations, basic autoencoders often produce blurry results. Reconstruction quality can be improved by incorporating additional penalties such as adversarial (GAN) and perceptual losses. Arguably, these approaches…

Machine Learning · Computer Science 2025-09-25 Vighnesh Birodkar , Gabriel Barcik , James Lyon , Sergey Ioffe , David Minnen , Joshua V. Dillon

Text-to-image diffusion models have made significant advances in generating and editing high-quality images. As a result, numerous approaches have explored the ability of diffusion model features to understand and process single images for…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Junyi Zhang , Charles Herrmann , Junhwa Hur , Luisa Polania Cabrera , Varun Jampani , Deqing Sun , Ming-Hsuan Yang

Accurately controlling object count in text-to-image generation remains a key challenge. Supervised methods often fail, as training data rarely covers all count variations. Methods that manipulate the denoising process to add or remove…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Oz Zafar , Yuval Cohen , Lior Wolf , Idan Schwartz

Diffusion-based text-to-image generative models, e.g., Stable Diffusion, have revolutionized the field of content generation, enabling significant advancements in areas like image editing and video synthesis. Despite their formidable…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Yanyu Li , Xian Liu , Anil Kag , Ju Hu , Yerlan Idelbayev , Dhritiman Sagar , Yanzhi Wang , Sergey Tulyakov , Jian Ren