中文
相关论文

相关论文: LayoutDiffusion: Controllable Diffusion Model for …

200 篇论文

Recent diffusion-based generators can produce high-quality images from textual prompts. However, they often disregard textual instructions that specify the spatial layout of the composition. We propose a simple approach that achieves robust…

计算机视觉与模式识别 · 计算机科学 2023-11-30 Minghao Chen , Iro Laina , Andrea Vedaldi

Diffusion-based generative modeling has been achieving state-of-the-art results on various generation tasks. Most diffusion models, however, are limited to a single-generation modeling. Can we generalize diffusion models with the ability of…

计算机视觉与模式识别 · 计算机科学 2024-09-26 Changyou Chen , Han Ding , Bunyamin Sisman , Yi Xu , Ouye Xie , Benjamin Z. Yao , Son Dinh Tran , Belinda Zeng

Diffusion probabilistic models have been successful in generating high-quality and diverse images. However, traditional models, whose input and output are high-resolution images, suffer from excessive memory requirements, making them less…

计算机视觉与模式识别 · 计算机科学 2023-04-17 Shinei Arakawa , Hideki Tsunashima , Daichi Horita , Keitaro Tanaka , Shigeo Morishima

Recently, the multimedia community has witnessed the rise of diffusion models trained on large-scale multi-modal data for visual content creation, particularly in the field of text-to-image generation. In this paper, we propose a new task…

计算机视觉与模式识别 · 计算机科学 2023-11-10 Jingwen Chen , Yingwei Pan , Ting Yao , Tao Mei

Despite the ability of existing large-scale text-to-image (T2I) models to generate high-quality images from detailed textual descriptions, they often lack the ability to precisely edit the generated or real images. In this paper, we propose…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Latent diffusion models excel at producing high-quality images from text. Yet, concerns appear about the lack of diversity in the generated imagery. To tackle this, we introduce Diverse Diffusion, a method for boosting image diversity…

计算机视觉与模式识别 · 计算机科学 2023-10-20 Mariia Zameshina , Olivier Teytaud , Laurent Najman

Fashionable image generation aims to synthesize images of diverse fashion prevalent around the globe, helping fashion designers in real-time visualization by giving them a basic customized structure of how a specific design preference would…

计算机视觉与模式识别 · 计算机科学 2023-06-14 Krishna Sri Ipsit Mantri , Nevasini Sasikumar

Recent advances in generative modeling, namely Diffusion models, have revolutionized generative modeling, enabling high-quality image generation tailored to user needs. This paper proposes a framework for the generative design of structural…

Recent advancements in image synthesis are fueled by the advent of large-scale diffusion models. Yet, integrating realistic object visualizations seamlessly into new or existing backgrounds without extensive training remains a challenge.…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Phillip Mueller , Jannik Wiese , Ioan Craciun , Lars Mikelsons

Text-driven person image generation is an emerging and challenging task in cross-modality image generation. Controllable person image generation promotes a wide range of applications such as digital human interaction and virtual try-on.…

计算机视觉与模式识别 · 计算机科学 2022-11-14 Kaiduo Zhang , Muyi Sun , Jianxin Sun , Binghao Zhao , Kunbo Zhang , Zhenan Sun , Tieniu Tan

Creative sketch is a universal way of visual expression, but translating images from an abstract sketch is very challenging. Traditionally, creating a deep learning model for sketch-to-image synthesis needs to overcome the distorted input…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Qiang Wang , Di Kong , Fengyin Lin , Yonggang Qi

We introduce the Fixed Point Diffusion Model (FPDM), a novel approach to image generation that integrates the concept of fixed point solving into the framework of diffusion-based generative modeling. Our approach embeds an implicit fixed…

计算机视觉与模式识别 · 计算机科学 2024-01-18 Xingjian Bai , Luke Melas-Kyriazi

Recent advances in diffusion models have significantly improved the synthesis of materials, textures, and 3D shapes. By conditioning these models via text or images, users can guide the generation, reducing the time required to create…

计算机视觉与模式识别 · 计算机科学 2026-01-28 Marzia Riso , Giuseppe Vecchio , Fabio Pellacini

Diffusion models achieved unprecedented fidelity and diversity for synthesizing image, video, 3D assets, etc. However, subject mixing is an unresolved issue for diffusion-based image synthesis, particularly for synthesizing multiple…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Weimin Qiu , Jieke Wang , Meng Tang

Recent successes in image synthesis are powered by large-scale diffusion models. However, most methods are currently limited to either text- or image-conditioned generation for synthesizing an entire image, texture transfer or inserting…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Yufei Ye , Xueting Li , Abhinav Gupta , Shalini De Mello , Stan Birchfield , Jiaming Song , Shubham Tulsiani , Sifei Liu

Diffusion-driven text-to-image (T2I) generation has achieved remarkable advancements in recent years. To further improve T2I models' capability in numerical and spatial reasoning, layout is employed as an intermedium to bridge large…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Yuhao Jia , Wenhan Tan

Layout generation is a task to synthesize a harmonious layout with elements characterized by attributes such as category, position, and size. Human designers experiment with the placement and modification of elements to create aesthetic…

计算机视觉与模式识别 · 计算机科学 2024-09-26 Shoma Iwai , Atsuki Osanai , Shunsuke Kitada , Shinichiro Omachi

We present LayerDiffuse, an approach enabling large-scale pretrained latent diffusion models to generate transparent images. The method allows generation of single transparent images or of multiple transparent layers. The method learns a…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Lvmin Zhang , Maneesh Agrawala

Diffusion models have emerged as a leading technique for generating images due to their ability to create high-resolution and realistic images. Despite their strong performance, diffusion models still struggle in managing image collections…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Hailong Yang , Te Zhang , Kup-sze Choi , Zhaohong Deng

The recent success of transformer-based image generative models in object-centric learning highlights the importance of powerful image generators for handling complex scenes. However, despite the high expressiveness of diffusion models in…

计算机视觉与模式识别 · 计算机科学 2023-11-06 Jindong Jiang , Fei Deng , Gautam Singh , Sungjin Ahn