中文
相关论文

相关论文: Stable Diffusion is a Natural Cross-Modal Decoder …

200 篇论文

In this paper, we introduce an innovative application of artificial intelligence in the realm of interior design through the integration of Stable Diffusion and Dreambooth models. This paper explores the potential of these advanced…

人机交互 · 计算机科学 2024-05-30 Kaiwen Zhou , Tianyu Wang

Stable Diffusion fine-tuning technique is tried to assist bridge-type innovation. The bridge real photo dataset is built, and Stable Diffusion is fine tuned by using four methods that are Textual Inversion, Dreambooth, Hypernetwork and…

机器学习 · 计算机科学 2024-09-25 Leye Zhang , Xiangxiang Tian , Chengli Zhang , Hongjun Zhang

Image composition has advanced significantly with large-scale pre-trained T2I diffusion models. Despite progress in same-domain composition, cross-domain composition remains under-explored. The main challenges are the stochastic nature of…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Haowen Li , Zhenfeng Fan , Zhang Wen , Zhengzhou Zhu , Yunjin Li

This paper outlines an end-to-end optimized lossy image compression framework using diffusion generative models. The approach relies on the transform coding paradigm, where an image is mapped into a latent space for entropy coding and, from…

图像与视频处理 · 电气工程与系统科学 2024-01-03 Ruihan Yang , Stephan Mandt

We demonstrate text as a strong cross-modal interface. Rather than relying on deep embeddings to connect image and language as the interface representation, our approach represents an image as text, from which we enjoy the interpretability…

计算机视觉与模式识别 · 计算机科学 2023-11-02 Chen Wei , Chenxi Liu , Siyuan Qiao , Zhishuai Zhang , Alan Yuille , Jiahui Yu

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Stable Diffusion models have made remarkable strides in generating photorealistic images from text prompts but often falter when tasked with accurately representing complex spatial arrangements, particularly involving intricate 3D…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Mao Xun Huang , Brian J Chan , Hen-Hsen Huang

Recently, stable diffusion (SD) models have typically flourished in the field of image synthesis and personalized editing, with a range of photorealistic and unprecedented images being successfully generated. As a result, widespread…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Zhiyuan Ma , Guoli Jia , Biqing Qi , Bowen Zhou

High-fidelity text-to-image diffusion models have revolutionized visual content generation, but their widespread use raises significant ethical concerns, including intellectual property protection and the misuse of synthetic media. To…

计算机视觉与模式识别 · 计算机科学 2025-08-21 Yunzhuo Chen , Naveed Akhtar , Nur Al Hasan Haldar , Ajmal Mian

We present StableMotion, a novel framework leverages knowledge (geometry and content priors) from pretrained large-scale image diffusion models to perform motion estimation, solving single-image-based image rectification tasks such as…

计算机视觉与模式识别 · 计算机科学 2025-05-13 Ziyi Wang , Haipeng Li , Lin Sui , Tianhao Zhou , Hai Jiang , Lang Nie , Shuaicheng Liu

Diffusion models have been extensively utilized in AI-generated content (AIGC) in recent years, thanks to the superior generation capabilities. Combining with semantic communications, diffusion models are used for tasks such as denoising,…

机器学习 · 计算机科学 2025-07-10 Lei Guo , Wei Chen , Yuxuan Sun , Bo Ai , Nikolaos Pappas , Tony Q. S. Quek

Stylized Text-to-Image Generation (STIG) aims to generate images from text prompts and style reference images. In this paper, we present ArtWeaver, a novel framework that leverages pretrained Stable Diffusion (SD) to address challenges such…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Chengming Xu , Kai Hu , Qilin Wang , Donghao Luo , Jiangning Zhang , Xiaobin Hu , Yanwei Fu , Chengjie Wang

The task of steel surface defect recognition is an industrial problem with great industry values. The data insufficiency is the major challenge in training a robust defect recognition network. Existing methods have investigated to enlarge…

计算机视觉与模式识别 · 计算机科学 2024-05-06 Yichun Tai , Kun Yang , Tao Peng , Zhenzhen Huang , Zhijiang Zhang

Image compression technology eliminates redundant information to enable efficient transmission and storage of images, serving both machine vision and human visual perception. For years, image coding focused on human perception has been…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Takahiro Shindo , Yui Tatsumi , Taiju Watanabe , Hiroshi Watanabe

Supervised machine learning algorithms play a crucial role in optical quality control within industrial production. These approaches require representative datasets for effective model training. However, while non-defective components are…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Dennis Sprute , Hanna Senke , Holger Flatt

The rapid progress of Deepfake technology has made face swapping highly realistic, raising concerns about the malicious use of fabricated facial content. Existing methods often struggle to generalize to unseen domains due to the diverse…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Ke Sun , Shen Chen , Taiping Yao , Hong Liu , Xiaoshuai Sun , Shouhong Ding , Rongrong Ji

Image editing aims to edit the given synthetic or real image to meet the specific requirements from users. It is widely studied in recent years as a promising and challenging field of Artificial Intelligence Generative Content (AIGC).…

计算机视觉与模式识别 · 计算机科学 2024-06-21 Xincheng Shuai , Henghui Ding , Xingjun Ma , Rongcheng Tu , Yu-Gang Jiang , Dacheng Tao

Portrait animation aims to generate photo-realistic videos from a single source image by reenacting the expression and pose from a driving video. While early methods relied on 3D morphable models or feature warping techniques, they often…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Mallikarjun B. R. , Fei Yin , Vikram Voleti , Nikita Drobyshev , Maksim Lapin , Aaryaman Vasishta , Varun Jampani

Modern diffusion models have set the state-of-the-art in AI image generation. Their success is due, in part, to training on Internet-scale data which often includes copyrighted work. This prompts questions about the extent to which these…

计算机视觉与模式识别 · 计算机科学 2023-07-11 Stephen Casper , Zifan Guo , Shreya Mogulothu , Zachary Marinov , Chinmay Deshpande , Rui-Jie Yew , Zheng Dai , Dylan Hadfield-Menell

This paper introduces a generative model designed for multimodal control over text-to-image foundation generative AI models such as Stable Diffusion, specifically tailored for engineering design synthesis. Our model proposes parametric,…

人工智能 · 计算机科学 2024-12-09 Rui Zhou , Yanxia Zhang , Chenyang Yuan , Frank Permenter , Nikos Arechiga , Matt Klenk , Faez Ahmed