中文
相关论文

相关论文: Diffusion Explainer: Visual Explanation for Text-t…

200 篇论文

Text-to-image generative models have garnered immense attention for their ability to produce high-fidelity images from text prompts. Among these, Stable Diffusion distinguishes itself as a leading open-source model in this fast-growing…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Shih-Ying Yeh , Yu-Guan Hsieh , Zhidong Gao , Bernard B W Yang , Giyeong Oh , Yanmin Gong

Generative models have enabled intuitive image creation and manipulation using natural language. In particular, diffusion models have recently shown remarkable results for natural image editing. In this work, we propose to apply diffusion…

Recent prosperity of text-to-image diffusion models, e.g. Stable Diffusion, has stimulated research to adapt them to 360-degree panorama generation. Prior work has demonstrated the feasibility of using conventional low-rank adaptation…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Jinhong Ni , Chang-Bin Zhang , Qiang Zhang , Jing Zhang

Text-guided diffusion models have revolutionized image generation and editing, offering exceptional realism and diversity. Specifically, in the context of diffusion-based editing, where a source image is edited according to a target prompt,…

计算机视觉与模式识别 · 计算机科学 2023-10-20 Xuan Ju , Ailing Zeng , Yuxuan Bian , Shaoteng Liu , Qiang Xu

Latent diffusion models excel at producing high-quality images from text. Yet, concerns appear about the lack of diversity in the generated imagery. To tackle this, we introduce Diverse Diffusion, a method for boosting image diversity…

计算机视觉与模式识别 · 计算机科学 2023-10-20 Mariia Zameshina , Olivier Teytaud , Laurent Najman

We explore the oscillatory behavior observed in inversion methods applied to large-scale text-to-image diffusion models, with a focus on the "Flux" model. By employing a fixed-point-inspired iterative approach to invert real-world images,…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Yan Zheng , Zhenxiao Liang , Xiaoyan Cong , Lanqing guo , Yuehao Wang , Peihao Wang , Zhangyang Wang

The quality of the prompts provided to text-to-image diffusion models determines how faithful the generated content is to the user's intent, often requiring `prompt engineering'. To harness visual concepts from target images without prompt…

计算机视觉与模式识别 · 计算机科学 2023-12-20 Shweta Mahajan , Tanzila Rahman , Kwang Moo Yi , Leonid Sigal

Text-to-Image artificial intelligence (AI) recently saw a major breakthrough with the release of Dall-E and its open-source counterpart, Stable Diffusion. These programs allow anyone to create original visual art pieces by simply providing…

人机交互 · 计算机科学 2023-01-06 Nassim Dehouche , Kullathida Dehouche

State-of-the-art Text-to-Image models like Stable Diffusion and DALLE$\cdot$2 are revolutionizing how people generate visual content. At the same time, society has serious concerns about how adversaries can exploit such models to generate…

计算机视觉与模式识别 · 计算机科学 2023-08-17 Yiting Qu , Xinyue Shen , Xinlei He , Michael Backes , Savvas Zannettou , Yang Zhang

The excellent generative capabilities of text-to-image diffusion models suggest they learn informative representations of image-text data. However, what knowledge their representations capture is not fully understood, and they have not been…

计算机视觉与模式识别 · 计算机科学 2023-09-07 Kevin Clark , Priyank Jaini

Text-to-Image (T2I) generation methods based on diffusion model have garnered significant attention in the last few years. Although these image synthesis methods produce visually appealing results, they frequently exhibit spelling errors…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Yiming Zhao , Zhouhui Lian

Recently large-scale language-image models (e.g., text-guided diffusion models) have considerably improved the image generation capabilities to generate photorealistic images in various domains. Based on this success, current image editing…

计算机视觉与模式识别 · 计算机科学 2023-05-09 Wenkai Dong , Song Xue , Xiaoyue Duan , Shumin Han

Recent advancements in text-to-image diffusion models have yielded impressive results in generating realistic and diverse images. However, these models still struggle with complex prompts, such as those that involve numeracy and spatial…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Long Lian , Boyi Li , Adam Yala , Trevor Darrell

Recent advancements in diffusion models have significantly impacted the trajectory of generative machine learning research, with many adopting the strategy of fine-tuning pre-trained models using domain-specific text-to-image datasets.…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Mischa Dombrowski , Hadrien Reynaud , Johanna P. Müller , Matthew Baugh , Bernhard Kainz

Classifiers are important components in many computer vision tasks, serving as the foundational backbone of a wide variety of models employed across diverse applications. However, understanding the decision-making process of classifiers…

计算机视觉与模式识别 · 计算机科学 2024-12-25 Tahira Kazimi , Ritika Allada , Pinar Yanardag

Diffusion models have become a powerful family of deep generative models, with record-breaking performance in many applications. This paper first gives an overview and derivation of the basic theory of diffusion models, then reviews the…

计算与语言 · 计算机科学 2023-03-15 Yuansong Zhu , Yu Zhao

Scene text detection techniques have garnered significant attention due to their wide-ranging applications. However, existing methods have a high demand for training data, and obtaining accurate human annotations is labor-intensive and…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Ling Fu , Zijie Wu , Yingying Zhu , Yuliang Liu , Xiang Bai

Diffusion models have shown an impressive ability to model complex data distributions, with several key advantages over GANs, such as stable training, better coverage of the training distribution's modes, and the ability to solve inverse…

计算机视觉与模式识别 · 计算机科学 2024-06-12 Yinbo Chen , Oliver Wang , Richard Zhang , Eli Shechtman , Xiaolong Wang , Michael Gharbi

Diffusion models have demonstrated exceptional capabilities in generating a broad spectrum of visual content, yet their proficiency in rendering text is still limited: they often generate inaccurate characters or words that fail to blend…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Jianyi Zhang , Yufan Zhou , Jiuxiang Gu , Curtis Wigington , Tong Yu , Yiran Chen , Tong Sun , Ruiyi Zhang

This paper explores the innovative application of Stable Video Diffusion (SVD), a diffusion model that revolutionizes the creation of dynamic video content from static images. As digital media and design industries accelerate, SVD emerges…

人机交互 · 计算机科学 2024-05-24 Elijah Miller , Thomas Dupont , Mingming Wang