中文
相关论文

相关论文: The Stable Artist: Steering Semantics in Diffusion…

200 篇论文

Stylized Text-to-Image Generation (STIG) aims to generate images from text prompts and style reference images. In this paper, we present ArtWeaver, a novel framework that leverages pretrained Stable Diffusion (SD) to address challenges such…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Chengming Xu , Kai Hu , Qilin Wang , Donghao Luo , Jiangning Zhang , Xiaobin Hu , Yanwei Fu , Chengjie Wang

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Controllable image synthesis models allow creation of diverse images based on text instructions or guidance from a reference image. Recently, denoising diffusion probabilistic models have been shown to generate more realistic imagery than…

计算机视觉与模式识别 · 计算机科学 2022-12-06 Xihui Liu , Dong Huk Park , Samaneh Azadi , Gong Zhang , Arman Chopikyan , Yuxiao Hu , Humphrey Shi , Anna Rohrbach , Trevor Darrell

Modern diffusion models have set the state-of-the-art in AI image generation. Their success is due, in part, to training on Internet-scale data which often includes copyrighted work. This prompts questions about the extent to which these…

计算机视觉与模式识别 · 计算机科学 2023-07-11 Stephen Casper , Zifan Guo , Shreya Mogulothu , Zachary Marinov , Chinmay Deshpande , Rui-Jie Yew , Zheng Dai , Dylan Hadfield-Menell

Semantic Image Synthesis (SIS) is among the most popular and effective techniques in the field of face generation and editing, thanks to its good generation quality and the versatility is brings along. Recent works attempted to go beyond…

计算机视觉与模式识别 · 计算机科学 2025-04-30 Alex Ergasti , Claudio Ferrari , Tomaso Fontanini , Massimo Bertozzi , Andrea Prati

Denoising diffusion models trained at web-scale have revolutionized image generation. The application of these tools to engineering design is an intriguing possibility, but is currently limited by their inability to parse and enforce…

机器学习 · 计算机科学 2023-06-19 Nikos Arechiga , Frank Permenter , Binyang Song , Chenyang Yuan

In this paper, we introduce StableGarment, a unified framework to tackle garment-centric(GC) generation tasks, including GC text-to-image, controllable GC text-to-image, stylized GC text-to-image, and robust virtual try-on. The main…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Rui Wang , Hailong Guo , Jiaming Liu , Huaxia Li , Haibo Zhao , Xu Tang , Yao Hu , Hao Tang , Peipei Li

Diffusion models are the current state-of-the-art in image generation, synthesizing high-quality images by breaking down the generation process into many fine-grained denoising steps. Despite their good performance, diffusion models are…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Noam Elata , Bahjat Kawar , Tomer Michaeli , Michael Elad

Latent diffusion models (LDMs) dominate high-quality image generation, yet integrating representation learning with generative modeling remains a challenge. We introduce a novel generative image modeling framework that seamlessly bridges…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Theodoros Kouzelis , Efstathios Karypidis , Ioannis Kakogeorgiou , Spyros Gidaris , Nikos Komodakis

Diffusion models have revolutionized the field of content synthesis and editing. Recent models have replaced the traditional UNet architecture with the Diffusion Transformer (DiT), and employed flow-matching for improved training and…

计算机视觉与模式识别 · 计算机科学 2025-09-10 Omri Avrahami , Or Patashnik , Ohad Fried , Egor Nemchinov , Kfir Aberman , Dani Lischinski , Daniel Cohen-Or

This pictorial presents an ongoing research programme comprising three practice-based Design Research projects conducted through 2024, exploring the affordances of diffusion-based AI image generation systems, specifically Stable Diffusion.…

人机交互 · 计算机科学 2024-11-21 Joseph Lindley , Roger Whitham

We present a novel, training-free approach for textual editing of real images using diffusion models. Unlike prior methods that rely on computationally expensive finetuning, our approach leverages LAtent SPatial Alignment (LASPA) to…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Yazeed Alharbi , Peter Wonka

Diffusion-based generative models' impressive ability to create convincing images has garnered global attention. However, their complex internal structures and operations often pose challenges for non-experts to grasp. We introduce…

Large-scale diffusion models have achieved state-of-the-art results on text-to-image synthesis (T2I) tasks. Despite their ability to generate high-quality yet creative images, we observe that attribution-binding and compositional…

计算机视觉与模式识别 · 计算机科学 2023-03-02 Weixi Feng , Xuehai He , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , Xin Eric Wang , William Yang Wang

Generative models have been widely studied in computer vision. Recently, diffusion models have drawn substantial attention due to the high quality of their generated images. A key desired property of image generative models is the ability…

计算机视觉与模式识别 · 计算机科学 2022-12-20 Qiucheng Wu , Yujian Liu , Handong Zhao , Ajinkya Kale , Trung Bui , Tong Yu , Zhe Lin , Yang Zhang , Shiyu Chang

Generative models have increasingly impacted various tasks, from computer vision to interior design and beyond. Stable Diffusion, a powerful diffusion model, enables the creation of high-resolution images with intricate details from text…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Boyang Deng

Text-guided semantic manipulation refers to semantically editing an image generated from a source prompt to match a target prompt, enabling the desired semantic changes (e.g., addition, removal, and style transfer) while preserving…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Yu Hong , Xiao Cai , Pengpeng Zeng , Shuai Zhang , Jingkuan Song , Lianli Gao , Heng Tao Shen

We present a simple but effective training-free approach for text-driven image-to-image translation based on a pretrained text-to-image diffusion model. Our goal is to generate an image that aligns with the target task while preserving the…

计算机视觉与模式识别 · 计算机科学 2024-12-23 Hyunsoo Lee , Minsoo Kang , Bohyung Han

Diffusion models have emerged as powerful tools for high-quality image generation and editing, but guiding these models to produce specific outputs remains a challenge. Conventional approaches rely on conditioning mechanisms, such as text…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Nithesh Chandher Karthikeyan , Jonas Unger , Gabriel Eilertsen

Negation is a fundamental linguistic operator, yet it remains inadequately modeled in diffusion-based generative systems. In this work, we present a formal treatment of linguistic negation in diffusion-based generative models by modeling it…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Taewon Kang , Ming C. Lin