中文
相关论文

相关论文: Boosting GUI Prototyping with Diffusion Models

200 篇论文

We present a simple but effective training-free approach for text-driven image-to-image translation based on a pretrained text-to-image diffusion model. Our goal is to generate an image that aligns with the target task while preserving the…

计算机视觉与模式识别 · 计算机科学 2024-12-23 Hyunsoo Lee , Minsoo Kang , Bohyung Han

Diffusion models have demonstrated exceptional capabilities in generating a broad spectrum of visual content, yet their proficiency in rendering text is still limited: they often generate inaccurate characters or words that fail to blend…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Jianyi Zhang , Yufan Zhou , Jiuxiang Gu , Curtis Wigington , Tong Yu , Yiran Chen , Tong Sun , Ruiyi Zhang

Diffusion models have become a mainstream approach for high-resolution image synthesis. However, directly generating higher-resolution images from pretrained diffusion models will encounter unreasonable object duplication and exponentially…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Shen Zhang , Zhaowei Chen , Zhenyu Zhao , Yuhao Chen , Yao Tang , Jiajun Liang

As machine learning-enabled Text-to-Image (TTI) systems are becoming increasingly prevalent and seeing growing adoption as commercial services, characterizing the social biases they exhibit is a necessary first step to lowering their risk…

计算机与社会 · 计算机科学 2023-11-13 Alexandra Sasha Luccioni , Christopher Akiki , Margaret Mitchell , Yacine Jernite

Diffusion and flow-based models have become the state of the art for generative AI across a wide range of data modalities, including images, videos, shapes, molecules, music, and more. This tutorial provides a self-contained introduction to…

机器学习 · 计算机科学 2026-03-19 Peter Holderrieth , Ezra Erives

The recent advancements in Generative AI have significantly advanced the field of text-to-image generation. The state-of-the-art text-to-image model, Stable Diffusion, is now capable of synthesizing high-quality images with a strong sense…

人机交互 · 计算机科学 2024-03-08 Zhijie Wang , Yuheng Huang , Da Song , Lei Ma , Tianyi Zhang

Diffusion-based generative modeling has been achieving state-of-the-art results on various generation tasks. Most diffusion models, however, are limited to a single-generation modeling. Can we generalize diffusion models with the ability of…

计算机视觉与模式识别 · 计算机科学 2024-09-26 Changyou Chen , Han Ding , Bunyamin Sisman , Yi Xu , Ouye Xie , Benjamin Z. Yao , Son Dinh Tran , Belinda Zeng

Conditional generative models typically demand large annotated training sets to achieve high-quality synthesis. As a result, there has been significant interest in designing models that perform plug-and-play generation, i.e., to use a…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Nithin Gopalakrishnan Nair , Anoop Cherian , Suhas Lohit , Ye Wang , Toshiaki Koike-Akino , Vishal M. Patel , Tim K. Marks

The rapid development of generative diffusion models has significantly advanced the field of style transfer. However, most current style transfer methods based on diffusion models typically involve a slow iterative optimization process,…

计算机视觉与模式识别 · 计算机科学 2024-10-28 Feihong He , Gang Li , Fuhui Sun , Mengyuan Zhang , Lingyu Si , Xiaoyan Wang , Li Shen

Recent advancements in text-to-image diffusion models have demonstrated remarkable success, yet they often struggle to fully capture the user's intent. Existing approaches using textual inputs combined with bounding boxes or region masks…

计算机视觉与模式识别 · 计算机科学 2024-09-13 Seonho Lee , Jiho Choi , Seohyun Lim , Jiwook Kim , Hyunjung Shim

Automatically constructing GUI groups of different granularities constitutes a critical intelligent step towards automating GUI design and implementation tasks. Specifically, in the industrial GUI-to-code process, fragmented layers may…

软件工程 · 计算机科学 2024-12-10 Yunnong Chen , Shuhong Xiao , Jiazhi Li , Tingting Zhou , Yanfang Chang , Yankun Zhen , Lingyun Sun , Liuqing Chen

Recent advances in diffusion models enable many powerful instruments for image editing. One of these instruments is text-driven image manipulations: editing semantic attributes of an image according to the provided text description. %…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Nikita Starodubcev , Dmitry Baranchuk , Valentin Khrulkov , Artem Babenko

Diffusion models have emerged as frontrunners in text-to-image generation, but their fixed image resolution during training often leads to challenges in high-resolution image generation, such as semantic deviations and object replication.…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Haoning Wu , Shaocheng Shen , Qiang Hu , Xiaoyun Zhang , Ya Zhang , Yanfeng Wang

This technical report presents a diffusion model based framework for face swapping between two portrait images. The basic framework consists of three components, i.e., IP-Adapter, ControlNet, and Stable Diffusion's inpainting pipeline, for…

计算机视觉与模式识别 · 计算机科学 2024-05-30 Feifei Wang

Fashionable image generation aims to synthesize images of diverse fashion prevalent around the globe, helping fashion designers in real-time visualization by giving them a basic customized structure of how a specific design preference would…

计算机视觉与模式识别 · 计算机科学 2023-06-14 Krishna Sri Ipsit Mantri , Nevasini Sasikumar

Diffusion models have demonstrated significant potential in achieving state-of-the-art performance across various text generation tasks. In this systematic study, we investigate their application to the table-to-text problem by adapting the…

计算与语言 · 计算机科学 2024-09-24 Aleksei S. Krylov , Oleg D. Somov

With the success of Diffusion Models for image generation, the technologies also have revolutionized the aesthetic Quick Response (QR) code generation. Despite significant improvements in visual attractiveness for the beautified codes,…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Jia-Wei Liao , Winston Wang , Tzu-Sian Wang , Li-Xuan Peng , Ju-Hsuan Weng , Cheng-Fu Chou , Jun-Cheng Chen

Given a 3D mesh with a UV parameterization, we introduce a novel approach to generating textures from text prompts. While prior work uses optimization from Text-to-Image Diffusion models to generate textures and geometry, this is slow and…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Julian Knodt , Xifeng Gao

The rapid expansion of edge devices and Internet-of-Things (IoT) continues to heighten the demand for data transport under limited spectrum resources. The goal-oriented communications (GO-COM), unlike traditional communication systems…

图像与视频处理 · 电气工程与系统科学 2025-10-07 Suchinthaka Wanninayaka , Achintha Wijesinghe , Weiwei Wang , Yu-Chieh Chao , Songyang Zhang , Zhi Ding

Text-to-image diffusion models have been adopted into key commercial workflows, such as art generation and image editing. Characterising the implicit social biases they exhibit, such as gender and racial stereotypes, is a necessary first…

计算机与社会 · 计算机科学 2023-12-19 Adhithya Prakash Saravanan , Rafal Kocielnik , Roy Jiang , Pengrui Han , Anima Anandkumar