中文
相关论文

相关论文: A Tale of Two Features: Stable Diffusion Complemen…

200 篇论文

A plethora of text-guided image editing methods has recently been developed by leveraging the impressive capabilities of large-scale diffusion-based generative models especially Stable Diffusion. Despite the success of diffusion models in…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Qihe Pan , Zhen Zhao , Zicheng Wang , Sifan Long , Yiming Wu , Wei Ji , Haoran Liang , Ronghua Liang

Zero-shot transfer learning for Dialogue State Tracking (DST) helps to handle a variety of task-oriented dialogue domains without the cost of collecting in-domain data. Existing works mainly study common data- or model-level augmentation…

计算与语言 · 计算机科学 2023-06-02 Qingyue Wang , Liang Ding , Yanan Cao , Yibing Zhan , Zheng Lin , Shi Wang , Dacheng Tao , Li Guo

Generative steganography is the process of hiding secret messages in generated images instead of cover images. Existing studies on generative steganography use GAN or Flow models to obtain high hiding message capacity and anti-detection…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Daegyu Kim , Chaehun Shin , Jooyoung Choi , Dahuin Jung , Sungroh Yoon

Medical image analysis plays a pivotal role in the early diagnosis of diseases such as skin lesions. However, the scarcity of data and the class imbalance significantly hinder the performance of deep learning models. We propose a novel…

图像与视频处理 · 电气工程与系统科学 2025-07-29 Zhaobin Xu

Intelligent agents must be generalists, capable of quickly adapting to various tasks. In reinforcement learning (RL), model-based RL learns a dynamics model of the world, in principle enabling transfer to arbitrary reward functions through…

机器学习 · 计算机科学 2025-01-22 Chuning Zhu , Xinqi Wang , Tyler Han , Simon S. Du , Abhishek Gupta

Conditional diffusion models have demonstrated impressive performance in image manipulation tasks. The general pipeline involves adding noise to the image and then denoising it. However, this method faces a trade-off problem: adding too…

计算机视觉与模式识别 · 计算机科学 2023-07-18 Luozhou Wang , Shuai Yang , Shu Liu , Ying-cong Chen

In image processing, one of the most challenging tasks is to render an image's semantic meaning using a variety of artistic approaches. Existing techniques for arbitrary style transfer (AST) frequently experience mode-collapse,…

计算机视觉与模式识别 · 计算机科学 2024-08-08 Onkar Susladkar , Gayatri Deshmukh , Sparsh Mittal , Parth Shastri

Diffusion models have shown an impressive ability to model complex data distributions, with several key advantages over GANs, such as stable training, better coverage of the training distribution's modes, and the ability to solve inverse…

计算机视觉与模式识别 · 计算机科学 2024-06-12 Yinbo Chen , Oliver Wang , Richard Zhang , Eli Shechtman , Xiaolong Wang , Michael Gharbi

Preparing training data for deep vision models is a labor-intensive task. To address this, generative models have emerged as an effective solution for generating synthetic data. While current generative models produce image-level category…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Quang Nguyen , Truong Vu , Anh Tran , Khoi Nguyen

Background: Text-to-image generation models are widely used across numerous domains. Among these models, Stable Diffusion (SD) - an open-source text-to-image generation model - has become the most popular, producing over 12 billion images…

软件工程 · 计算机科学 2025-12-08 Giordano d'Aloisio , Tosin Fadahunsi , Jay Choy , Rebecca Moussa , Federica Sarro

Recently, the text-to-image diffusion model has gained considerable attention from the community due to its exceptional image generation capability. A representative model, Stable Diffusion, amassed more than 10 million users within just…

密码学与安全 · 计算机科学 2024-09-16 Chenyu Zhang , Mingwang Hu , Wenhui Li , Lanjun Wang

Diffusion models, known for their powerful generative capabilities, play a crucial role in addressing real-world super-resolution challenges. However, these models often focus on improving local textures while neglecting the impacts of…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Chunyang Bi , Xin Luo , Sheng Shen , Mengxi Zhang , Huanjing Yue , Jingyu Yang

Recent advancements in text-to-image models, such as Stable Diffusion, show significant demographic biases. Existing de-biasing techniques rely heavily on additional training, which imposes high computational costs and risks of compromising…

人工智能 · 计算机科学 2025-03-28 Eunji Kim , Siwon Kim , Minjun Park , Rahim Entezari , Sungroh Yoon

Diffusion model (DM) has achieved SOTA performance by modeling the image synthesis process into a sequential application of a denoising network. However, different from image synthesis, image restoration (IR) has a strong constraint to…

计算机视觉与模式识别 · 计算机科学 2023-08-17 Bin Xia , Yulun Zhang , Shiyin Wang , Yitong Wang , Xinglong Wu , Yapeng Tian , Wenming Yang , Luc Van Gool

Modern diffusion models, particularly those utilizing a Transformer-based UNet for denoising, rely heavily on self-attention operations to manage complex spatial relationships, thus achieving impressive generation performance. However, this…

计算机视觉与模式识别 · 计算机科学 2024-10-18 Songhua Liu , Weihao Yu , Zhenxiong Tan , Xinchao Wang

Diffusion models have demonstrated exceptional performances in various fields of generative modeling, but suffer from slow sampling speed due to their iterative nature. While this issue is being addressed in continuous domains, discrete…

机器学习 · 计算机科学 2025-05-12 Satoshi Hayakawa , Yuhta Takida , Masaaki Imaizumi , Hiromi Wakaki , Yuki Mitsufuji

Guidance serves as a key concept in diffusion models, yet its effectiveness is often limited by the need for extra data annotation or classifier pretraining. That is why guidance was harnessed from self-supervised learning backbones, like…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Vincent Tao Hu , Yunlu Chen , Mathilde Caron , Yuki M. Asano , Cees G. M. Snoek , Bjorn Ommer

Significant strides have been made using large vision-language models, like Stable Diffusion (SD), for a variety of downstream tasks, including image editing, image correspondence, and 3D shape generation. Inspired by these advancements, we…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Aliasghar Khani , Saeid Asgari Taghanaki , Aditya Sanghi , Ali Mahdavi Amiri , Ghassan Hamarneh

Stable Diffusion (SD) has gained a lot of attention in recent years in the field of Generative AI thus helping in synthesizing medical imaging data with distinct features. The aim is to contribute to the ongoing effort focused on overcoming…

计算机视觉与模式识别 · 计算机科学 2024-02-13 Ayman Abaid , Muhammad Ali Farooq , Niamh Hynes , Peter Corcoran , Ihsan Ullah

The landscape of image generation has been forever changed by open vocabulary diffusion models. However, at their core these models use transformers, which makes generation slow. Better implementations to increase the throughput of these…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Daniel Bolya , Judy Hoffman