中文
相关论文

相关论文: The Stable Artist: Steering Semantics in Diffusion…

200 篇论文

We investigate the potential of learning visual representations using synthetic images generated by text-to-image models. This is a natural question in the light of the excellent performance of such models in generating high-quality images.…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Yonglong Tian , Lijie Fan , Phillip Isola , Huiwen Chang , Dilip Krishnan

Sketch-guided image editing aims to achieve local fine-tuning of the image based on the sketch information provided by the user, while maintaining the original status of the unedited areas. Due to the high cost of acquiring human sketches,…

计算机视觉与模式识别 · 计算机科学 2023-11-15 Weihang Mao , Bo Han , Zihao Wang

The recent wave of large-scale text-to-image diffusion models has dramatically increased our text-based image generation abilities. These models can generate realistic images for a staggering variety of prompts and exhibit impressive…

机器学习 · 计算机科学 2023-09-14 Alexander C. Li , Mihir Prabhudesai , Shivam Duggal , Ellis Brown , Deepak Pathak

Based on recent advanced diffusion models, Text-to-image (T2I) generation models have demonstrated their capabilities to generate diverse and high-quality images. However, leveraging their potential for real-world content creation,…

计算机视觉与模式识别 · 计算机科学 2025-05-08 Sandra Zhang Ding , Jiafeng Mao , Kiyoharu Aizawa

While diffusion models have revolutionized text-to-image generation with their ability to synthesize realistic and diverse scenes, they continue to struggle to generate consistent and legible text within images. This shortcoming is commonly…

机器学习 · 计算机科学 2025-09-16 Tianyu Zhang , Xinyu Wang , Lu Li , Zhenghan Tai , Jijun Chi , Jingrui Tian , Hailin He , Suyuchen Wang

Prompt engineering is still the primary way for users of generative text-to-image models to manipulate generated images in a targeted way. Based on treating the model as a continuous function and by passing gradients between the image space…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Niklas Deckers , Julia Peters , Martin Potthast

In the text-to-image generation field, recent remarkable progress in Stable Diffusion makes it possible to generate rich kinds of novel photorealistic images. However, current models still face misalignment issues (e.g., problematic spatial…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Leigang Qu , Shengqiong Wu , Hao Fei , Liqiang Nie , Tat-Seng Chua

The rapid advancement of pretrained text-driven diffusion models has significantly enriched applications in image generation and editing. However, as the demand for personalized content editing increases, new challenges emerge especially…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Rui Jiang , Xinghe Fu , Guangcong Zheng , Teng Li , Taiping Yao , Xi Li

Text-conditioned image editing has recently attracted considerable interest. However, most methods are currently either limited to specific editing types (e.g., object overlay, style transfer), or apply to synthetically generated images, or…

计算机视觉与模式识别 · 计算机科学 2023-03-21 Bahjat Kawar , Shiran Zada , Oran Lang , Omer Tov , Huiwen Chang , Tali Dekel , Inbar Mosseri , Michal Irani

Traditional 3D content creation tools empower users to bring their imagination to life by giving them direct control over a scene's geometry, appearance, motion, and camera path. Creating computer-generated videos, however, is a tedious…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Shengqu Cai , Duygu Ceylan , Matheus Gadelha , Chun-Hao Paul Huang , Tuanfeng Yang Wang , Gordon Wetzstein

Recently, the multimedia community has witnessed the rise of diffusion models trained on large-scale multi-modal data for visual content creation, particularly in the field of text-to-image generation. In this paper, we propose a new task…

计算机视觉与模式识别 · 计算机科学 2023-11-10 Jingwen Chen , Yingwei Pan , Ting Yao , Tao Mei

Accurate and controllable image editing is a challenging task that has attracted significant attention recently. Notably, DragGAN is an interactive point-based image editing framework that achieves impressive editing results with…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Yujun Shi , Chuhui Xue , Jun Hao Liew , Jiachun Pan , Hanshu Yan , Wenqing Zhang , Vincent Y. F. Tan , Song Bai

Recent text-to-image generative models, particularly Stable Diffusion and its distilled variants, have achieved impressive fidelity and strong text-image alignment. However, their creative capability remains constrained, as including…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Jiyeon Han , Dahee Kwon , Gayoung Lee , Junho Kim , Jaesik Choi

The task of steel surface defect recognition is an industrial problem with great industry values. The data insufficiency is the major challenge in training a robust defect recognition network. Existing methods have investigated to enlarge…

计算机视觉与模式识别 · 计算机科学 2024-05-06 Yichun Tai , Kun Yang , Tao Peng , Zhenzhen Huang , Zhijiang Zhang

Text-to-image diffusion generative models can generate high quality images at the cost of tedious prompt engineering. Controllability can be improved by introducing layout conditioning, however existing methods lack layout editing ability…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Alessandro Fontanella , Petru-Daniel Tudosiu , Yongxin Yang , Shifeng Zhang , Sarah Parisot

The demand for stereo images increases as manufacturers launch more XR devices. To meet this demand, we introduce StereoDiffusion, a method that, unlike traditional inpainting pipelines, is trainning free, remarkably straightforward to use,…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Lezhong Wang , Jeppe Revall Frisvad , Mark Bo Jensen , Siavash Arjomand Bigdeli

Large-scale text-to-image generative models have been a revolutionary breakthrough in the evolution of generative AI, allowing us to synthesize diverse images that convey highly complex visual concepts. However, a pivotal challenge in…

计算机视觉与模式识别 · 计算机科学 2022-11-24 Narek Tumanyan , Michal Geyer , Shai Bagon , Tali Dekel

Diffusion Transformers (DiTs) have achieved remarkable success in diverse and high-quality text-to-image(T2I) generation. However, how text and image latents individually and jointly contribute to the semantics of generated images, remain…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Zitao Shuai , Chenwei Wu , Zhengxu Tang , Bowen Song , Liyue Shen

Rectified flow models have emerged as a dominant approach in image generation, showcasing impressive capabilities in high-quality image synthesis. However, despite their effectiveness in visual generation, rectified flow models often…

计算机视觉与模式识别 · 计算机科学 2024-12-13 Yusuf Dalva , Kavana Venkatesh , Pinar Yanardag

Stably placing an object in a multi-object scene is a fundamental challenge in robotic manipulation, as placements must be penetration-free, establish precise surface contact, and result in a force equilibrium. To assess stability, existing…

机器人学 · 计算机科学 2025-09-29 Philippe Nadeau , Miguel Rogel , Ivan Bilić , Ivan Petrović , Jonathan Kelly