English
Related papers

Related papers: Stable Diffusion is a Natural Cross-Modal Decoder …

200 papers

In this paper, we introduce an innovative application of artificial intelligence in the realm of interior design through the integration of Stable Diffusion and Dreambooth models. This paper explores the potential of these advanced…

Human-Computer Interaction · Computer Science 2024-05-30 Kaiwen Zhou , Tianyu Wang

Stable Diffusion fine-tuning technique is tried to assist bridge-type innovation. The bridge real photo dataset is built, and Stable Diffusion is fine tuned by using four methods that are Textual Inversion, Dreambooth, Hypernetwork and…

Machine Learning · Computer Science 2024-09-25 Leye Zhang , Xiangxiang Tian , Chengli Zhang , Hongjun Zhang

Image composition has advanced significantly with large-scale pre-trained T2I diffusion models. Despite progress in same-domain composition, cross-domain composition remains under-explored. The main challenges are the stochastic nature of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Haowen Li , Zhenfeng Fan , Zhang Wen , Zhengzhou Zhu , Yunjin Li

This paper outlines an end-to-end optimized lossy image compression framework using diffusion generative models. The approach relies on the transform coding paradigm, where an image is mapped into a latent space for entropy coding and, from…

Image and Video Processing · Electrical Eng. & Systems 2024-01-03 Ruihan Yang , Stephan Mandt

We demonstrate text as a strong cross-modal interface. Rather than relying on deep embeddings to connect image and language as the interface representation, our approach represents an image as text, from which we enjoy the interpretability…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Chen Wei , Chenxi Liu , Siyuan Qiao , Zhishuai Zhang , Alan Yuille , Jiahui Yu

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Stable Diffusion models have made remarkable strides in generating photorealistic images from text prompts but often falter when tasked with accurately representing complex spatial arrangements, particularly involving intricate 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Mao Xun Huang , Brian J Chan , Hen-Hsen Huang

Recently, stable diffusion (SD) models have typically flourished in the field of image synthesis and personalized editing, with a range of photorealistic and unprecedented images being successfully generated. As a result, widespread…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Zhiyuan Ma , Guoli Jia , Biqing Qi , Bowen Zhou

High-fidelity text-to-image diffusion models have revolutionized visual content generation, but their widespread use raises significant ethical concerns, including intellectual property protection and the misuse of synthetic media. To…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Yunzhuo Chen , Naveed Akhtar , Nur Al Hasan Haldar , Ajmal Mian

We present StableMotion, a novel framework leverages knowledge (geometry and content priors) from pretrained large-scale image diffusion models to perform motion estimation, solving single-image-based image rectification tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Ziyi Wang , Haipeng Li , Lin Sui , Tianhao Zhou , Hai Jiang , Lang Nie , Shuaicheng Liu

Diffusion models have been extensively utilized in AI-generated content (AIGC) in recent years, thanks to the superior generation capabilities. Combining with semantic communications, diffusion models are used for tasks such as denoising,…

Machine Learning · Computer Science 2025-07-10 Lei Guo , Wei Chen , Yuxuan Sun , Bo Ai , Nikolaos Pappas , Tony Q. S. Quek

Stylized Text-to-Image Generation (STIG) aims to generate images from text prompts and style reference images. In this paper, we present ArtWeaver, a novel framework that leverages pretrained Stable Diffusion (SD) to address challenges such…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Chengming Xu , Kai Hu , Qilin Wang , Donghao Luo , Jiangning Zhang , Xiaobin Hu , Yanwei Fu , Chengjie Wang

The task of steel surface defect recognition is an industrial problem with great industry values. The data insufficiency is the major challenge in training a robust defect recognition network. Existing methods have investigated to enlarge…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Yichun Tai , Kun Yang , Tao Peng , Zhenzhen Huang , Zhijiang Zhang

Image compression technology eliminates redundant information to enable efficient transmission and storage of images, serving both machine vision and human visual perception. For years, image coding focused on human perception has been…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Takahiro Shindo , Yui Tatsumi , Taiju Watanabe , Hiroshi Watanabe

Supervised machine learning algorithms play a crucial role in optical quality control within industrial production. These approaches require representative datasets for effective model training. However, while non-defective components are…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Dennis Sprute , Hanna Senke , Holger Flatt

The rapid progress of Deepfake technology has made face swapping highly realistic, raising concerns about the malicious use of fabricated facial content. Existing methods often struggle to generalize to unseen domains due to the diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Ke Sun , Shen Chen , Taiping Yao , Hong Liu , Xiaoshuai Sun , Shouhong Ding , Rongrong Ji

Image editing aims to edit the given synthetic or real image to meet the specific requirements from users. It is widely studied in recent years as a promising and challenging field of Artificial Intelligence Generative Content (AIGC).…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xincheng Shuai , Henghui Ding , Xingjun Ma , Rongcheng Tu , Yu-Gang Jiang , Dacheng Tao

Portrait animation aims to generate photo-realistic videos from a single source image by reenacting the expression and pose from a driving video. While early methods relied on 3D morphable models or feature warping techniques, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Mallikarjun B. R. , Fei Yin , Vikram Voleti , Nikita Drobyshev , Maksim Lapin , Aaryaman Vasishta , Varun Jampani

Modern diffusion models have set the state-of-the-art in AI image generation. Their success is due, in part, to training on Internet-scale data which often includes copyrighted work. This prompts questions about the extent to which these…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Stephen Casper , Zifan Guo , Shreya Mogulothu , Zachary Marinov , Chinmay Deshpande , Rui-Jie Yew , Zheng Dai , Dylan Hadfield-Menell

This paper introduces a generative model designed for multimodal control over text-to-image foundation generative AI models such as Stable Diffusion, specifically tailored for engineering design synthesis. Our model proposes parametric,…

Artificial Intelligence · Computer Science 2024-12-09 Rui Zhou , Yanxia Zhang , Chenyang Yuan , Frank Permenter , Nikos Arechiga , Matt Klenk , Faez Ahmed