English
Related papers

Related papers: Smooth Diffusion: Crafting Smooth Latent Spaces in…

200 papers

Stable Diffusion has advanced text-to-image synthesis, but training models to generate images with accurate object quantity is still difficult due to the high computational cost and the challenge of teaching models the abstract concept of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Yanyu Li , Pencheng Wan , Liang Han , Yaowei Wang , Liqiang Nie , Min Zhang

Text-conditioned image generation models have recently achieved astonishing results in image quality and text alignment and are consequently employed in a fast-growing number of applications. Since they are highly data-driven, relying on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Patrick Schramowski , Manuel Brack , Björn Deiseroth , Kristian Kersting

Latent diffusion models have become the popular choice for scaling up diffusion models for high resolution image synthesis. Compared to pixel-space models that are trained end-to-end, latent models are perceived to be more efficient and to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Emiel Hoogeboom , Thomas Mensink , Jonathan Heek , Kay Lamerigts , Ruiqi Gao , Tim Salimans

In real-life conversations, the content is diverse, and there exists the one-to-many problem that requires diverse generation. Previous studies attempted to introduce discrete or Gaussian-based continuous latent variables to address the…

Computation and Language · Computer Science 2024-04-11 Jianxiang Xiang , Zhenhua Liu , Haodong Liu , Yin Bai , Jia Cheng , Wenliang Chen

We present LayerDiffuse, an approach enabling large-scale pretrained latent diffusion models to generate transparent images. The method allows generation of single transparent images or of multiple transparent layers. The method learns a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Lvmin Zhang , Maneesh Agrawala

The rapid evolution of the fashion industry increasingly intersects with technological advancements, particularly through the integration of generative AI. This study introduces a novel generative pipeline designed to transform the fashion…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Abhishek Kumar Singh , Ioannis Patras

Diffusion models have revolutionized image generation, yet several challenges restrict their application to large-image domains, such as digital pathology and satellite imagery. Given that it is infeasible to directly train a model on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Srikar Yellapragada , Alexandros Graikos , Kostas Triaridis , Prateek Prasanna , Rajarsi R. Gupta , Joel Saltz , Dimitris Samaras

Despite many attempts to leverage pre-trained text-to-image models (T2I) like Stable Diffusion (SD) for controllable image editing, producing good predictable results remains a challenge. Previous approaches have focused on either…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Sherry X. Chen , Yaron Vaxman , Elad Ben Baruch , David Asulin , Aviad Moreshet , Kuo-Chin Lien , Misha Sra , Pradeep Sen

The Stable Diffusion Model (SDM) is a popular and efficient text-to-image (t2i) generation and image-to-image (i2i) generation model. Although there have been some attempts to reduce sampling steps, model distillation, and network…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Jinchao Zhu , Yuxuan Wang , Xiaobing Tu , Siyuan Pan , Pengfei Wan , Gao Huang

Image tiling -- the seamless connection of disparate images to create a coherent visual field -- is crucial for applications such as texture creation, video game asset development, and digital art. Traditionally, tiles have been constructed…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Or Madar , Ohad Fried

Latent diffusion models achieve state-of-the-art performance on a variety of generative tasks, such as image synthesis and image editing. However, the robustness of latent diffusion models is not well studied. Previous works only focus on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Jianping Zhang , Zhuoer Xu , Shiwen Cui , Changhua Meng , Weibin Wu , Michael R. Lyu

Scene flow estimation, which aims to predict per-point 3D displacements of dynamic scenes, is a fundamental task in the computer vision field. However, previous works commonly suffer from unreliable correlation caused by locally constrained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Jiuming Liu , Guangming Wang , Weicai Ye , Chaokang Jiang , Jinru Han , Zhe Liu , Guofeng Zhang , Dalong Du , Hesheng Wang

Discrete diffusion models have emerged as a powerful class of models and a promising route to fast language generation, but practical implementations typically rely on factored reverse transitions ignoring cross-token dependencies and…

Machine Learning · Computer Science 2026-05-14 Dario Shariatian , Alain Durmus , Umut Simsekli , Stefano Peluchetti

Diffusion Models (DMs) have demonstrated state-of-the-art performance in content generation without requiring adversarial training. These models are trained using a two-step process. First, a forward - diffusion - process gradually adds…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Anwaar Ulhaq , Naveed Akhtar

Diffusion models are widely used for generative tasks across domains. Given a pre-trained diffusion model, it is often desirable to fine-tune it further either to correct for errors in learning or to align with downstream applications.…

Diffusion models have recently achieved remarkable performance in image super-resolution (SR), but their high computational cost limits practical deployment in remote sensing applications. To address this issue, we propose SlimDiffSR, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Ce Wang , Zhenyu Hu , Wanjie Sun

Diffusion models have achieved impressive success in generating photorealistic images, but challenges remain in ensuring precise semantic alignment with input prompts. Optimizing the initial noisy latent offers a more efficient alternative…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Boming Miao , Chunxiao Li , Xiaoxiao Wang , Andi Zhang , Rui Sun , Zizhe Wang , Yao Zhu

Layout generation is a foundation task of graphic design, which requires the integration of visual aesthetics and harmonious expression of content delivery. However, existing methods still face challenges in generating precise and visually…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yu Li , Yifan Chen , Gongye Liu , Fei Yin , Qingyan Bai , Jie Wu , Hongfa Wang , Ruihang Chu , Yujiu Yang

As text-to-image models grow increasingly powerful and complex, their burgeoning size presents a significant obstacle to widespread adoption, especially on resource-constrained devices. This paper presents a pioneering study on…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Samarth N Ramesh , Zhixue Zhao

Text-guided motion synthesis aims to generate 3D human motion that not only precisely reflects the textual description but reveals the motion details as much as possible. Pioneering methods explore the diffusion model for text-to-motion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zhenyu Xie , Yang Wu , Xuehao Gao , Zhongqian Sun , Wei Yang , Xiaodan Liang