中文
相关论文

相关论文: StableSketcher: Enhancing Diffusion Model for Pixe…

200 篇论文

Sketch animations offer a powerful medium for visual storytelling, from simple flip-book doodles to professional studio productions. While traditional animation requires teams of skilled artists to draw key frames and in-between frames,…

图形学 · 计算机科学 2024-11-19 Hmrishav Bandyopadhyay , Yi-Zhe Song

Recent developments in text-to-image models, particularly Stable Diffusion, have marked significant achievements in various applications. With these advancements, there are growing safety concerns about the vulnerability of the model that…

计算机视觉与模式识别 · 计算机科学 2024-01-18 Chenyu Zhang , Lanjun Wang , Anan Liu

Recent years have witnessed a rapid growth of deep generative models, with text-to-image models gaining significant attention from the public. However, existing models often generate images that do not align well with human preferences,…

计算机视觉与模式识别 · 计算机科学 2023-08-23 Xiaoshi Wu , Keqiang Sun , Feng Zhu , Rui Zhao , Hongsheng Li

Stable Diffusion is a popular Transformer-based model for image generation from text; it applies an image information creator to the input text and the visual knowledge is added in a step-by-step fashion to create an image that corresponds…

图像与视频处理 · 电气工程与系统科学 2024-04-02 Zhen Gao , Lini Yuan , Pedro Reviriego , Shanshan Liu , Fabrizio Lombardi

Current makeup transfer methods are limited to simple makeup styles, making them difficult to apply in real-world scenarios. In this paper, we introduce Stable-Makeup, a novel diffusion-based makeup transfer method capable of robustly…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Yuxuan Zhang , Yirui Yuan , Yiren Song , Jiaming Liu

Text-to-image generation via Stable Diffusion models (SDM) have demonstrated remarkable capabilities. However, their computational intensity, particularly in the iterative denoising process, hinders real-time deployment in latency-sensitive…

计算机视觉与模式识别 · 计算机科学 2025-05-08 Shuaiting Li , Juncan Deng , Zeyu Wang , Kedong Xu , Rongtao Deng , Hong Gu , Haibin Shen , Kejie Huang

With the advancement of generative artificial intelligence, previous studies have achieved the task of generating aesthetic images from hand-drawn sketches, fulfilling the public's needs for drawing. However, these methods are limited to…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Lifan Jiang , Shuang Chen , Boxi Wu , Xiaotong Guan , Jiahui Zhang

Recently, stable diffusion (SD) models have typically flourished in the field of image synthesis and personalized editing, with a range of photorealistic and unprecedented images being successfully generated. As a result, widespread…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Zhiyuan Ma , Guoli Jia , Biqing Qi , Bowen Zhou

Text-to-Image (T2I) generation methods based on diffusion model have garnered significant attention in the last few years. Although these image synthesis methods produce visually appealing results, they frequently exhibit spelling errors…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Yiming Zhao , Zhouhui Lian

Recent advances in Artificial Intelligence Generated Content (AIGC) have garnered significant interest, accompanied by an increasing need to transmit and compress the vast number of AI-generated images (AIGIs). However, there is a…

图像与视频处理 · 电气工程与系统科学 2024-12-18 Ruijie Chen , Qi Mao , Zhengxue Cheng

Sketches, with their expressive potential, allow humans to convey the essence of an object through even a rough contour. For the first time, we harness this expressive potential to improve segmentation performance in challenging tasks like…

计算机视觉与模式识别 · 计算机科学 2025-02-03 Ying Zang , Runlong Cao , Jianqi Zhang , Yidong Han , Ziyue Cao , Wenjun Hu , Didi Zhu , Lanyun Zhu , Zejian Li , Deyi Ji , Tianrun Chen

Diffusion models have gained increasing attention for their impressive generation abilities but currently struggle with rendering accurate and coherent text. To address this issue, we introduce TextDiffuser, focusing on generating images…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Jingye Chen , Yupan Huang , Tengchao Lv , Lei Cui , Qifeng Chen , Furu Wei

3D sketches are widely used for visually representing the 3D shape and structure of objects or scenes. However, the creation of 3D sketch often requires users to possess professional artistic skills. Existing research efforts primarily…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Yibo Zhang , Lihong Wang , Changqing Zou , Tieru Wu , Rui Ma

Text-to-image diffusion models have shown impressive capabilities in generating realistic visuals from natural-language prompts, yet they often struggle with accurately binding attributes to corresponding objects, especially in prompts…

计算机视觉与模式识别 · 计算机科学 2025-05-05 Do Huu Dat , Nam Hyeonu , Po-Yuan Mao , Tae-Hyun Oh

Current diffusion models for human image animation struggle to ensure identity (ID) consistency. This paper presents StableAnimator, the first end-to-end ID-preserving video diffusion framework, which synthesizes high-quality videos without…

计算机视觉与模式识别 · 计算机科学 2024-11-28 Shuyuan Tu , Zhen Xing , Xintong Han , Zhi-Qi Cheng , Qi Dai , Chong Luo , Zuxuan Wu

Diffusion models have demonstrated exceptional capabilities in generating a broad spectrum of visual content, yet their proficiency in rendering text is still limited: they often generate inaccurate characters or words that fail to blend…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Jianyi Zhang , Yufan Zhou , Jiuxiang Gu , Curtis Wigington , Tong Yu , Yiran Chen , Tong Sun , Ruiyi Zhang

Synthesizing face images from monochrome sketches is one of the most fundamental tasks in the field of image-to-image translation. However, it is still challenging to (1)~make models learn the high-dimensional face features such as geometry…

计算机视觉与模式识别 · 计算机科学 2023-02-28 Yichen Peng , Chunqi Zhao , Haoran Xie , Tsukasa Fukusato , Kazunori Miyata

Recent text-to-image diffusion models can generate striking visuals from text prompts, but they often fail to maintain subject consistency across generations and contexts. One major limitation of current fine-tuning approaches is the…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Gordon Chen , Ziqi Huang , Cheston Tan , Ziwei Liu

Recently, diffusion-based image generation methods are credited for their remarkable text-to-image generation capabilities, while still facing challenges in accurately generating multilingual scene text images. To tackle this problem, we…

计算机视觉与模式识别 · 计算机科学 2023-12-20 Lingjun Zhang , Xinyuan Chen , Yaohui Wang , Yue Lu , Yu Qiao

Recent advances in diffusion models have significantly improved text-to-image (T2I) generation, but they often struggle to balance fine-grained precision with high-level control. Methods like ControlNet and T2I-Adapter excel at following…

计算机视觉与模式识别 · 计算机科学 2025-04-11 Pouyan Navard , Amin Karimi Monsefi , Mengxi Zhou , Wei-Lun Chao , Alper Yilmaz , Rajiv Ramnath