English
Related papers

Related papers: Zero-Shot Contrastive Loss for Text-Guided Diffusi…

200 papers

Recent advancements in large-scale text-to-image diffusion models have enabled many applications in image editing. However, none of these methods have been able to edit the layout of single existing images. To address this gap, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Zhiyuan Zhang , Zhitong Huang , Jing Liao

Zero-shot stance detection is challenging because it requires detecting the stance of previously unseen targets in the inference phase. The ability to learn transferable target-invariant features is critical for zero-shot stance detection.…

Computation and Language · Computer Science 2022-10-10 Xuechen Zhao , Jiaying Zou , Zhong Zhang , Feng Xie , Bin Zhou , Lei Tian

Generating realistic synthetic microscopy images is critical for training deep learning models in label-scarce environments, such as cell counting with many cells per image. However, traditional domain adaptation methods often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Mohammad Dehghanmanshadi , Wallapak Tavanapong

Robust invisible watermarking schemes aim to embed hidden information into images such that the watermark survives common manipulations. However, powerful diffusion-based image generation and editing techniques now pose a new threat to…

Cryptography and Security · Computer Science 2026-02-25 Fan Guo , Jiyu Kang , Qi Ming , Emily Davis , Finn Carter

Large-scale text-to-image diffusion models achieve unprecedented success in image generation and editing. However, how to extend such success to video editing is unclear. Recent initial attempts at video editing require significant…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Wen Wang , Yan Jiang , Kangyang Xie , Zide Liu , Hao Chen , Yue Cao , Xinlong Wang , Chunhua Shen

Recent advances in diffusion-based generative models have shown incredible promise for zero shot image-to-image translation and editing. Most of these approaches work by combining or replacing network-specific features used in the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Zeqi Gu , Ethan Yang , Abe Davis

Recent advances in large-scale text-to-image models have revolutionized creative fields by generating visually captivating outputs from textual prompts; however, while traditional photography offers precise control over camera settings to…

Graphics · Computer Science 2025-06-17 Armando Fortes , Tianyi Wei , Shangchen Zhou , Xingang Pan

Diffusion Models (DMs) have evolved into advanced image generation tools, especially for few-shot generation where a pretrained model is fine-tuned on a small set of images to capture a specific style or object. Despite their success,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Xiaoyu Wu , Yang Hua , Chumeng Liang , Jiaru Zhang , Hao Wang , Tao Song , Haibing Guan

Text-to-image diffusion models sometimes depict blended concepts in the generated images. One promising use case of this effect would be the nonword-to-image generation task which attempts to generate images intuitively imaginable from a…

Multimedia · Computer Science 2024-11-07 Chihaya Matsuhira , Marc A. Kastner , Takahiro Komamizu , Takatsugu Hirayama , Ichiro Ide

Recent advancements in text-guided diffusion models have unlocked powerful image manipulation capabilities. However, applying these methods to real images necessitates the inversion of the images into the domain of the pretrained diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Daniel Garibi , Or Patashnik , Andrey Voynov , Hadar Averbuch-Elor , Daniel Cohen-Or

The images produced by diffusion models can attain excellent perceptual quality. However, it is challenging for diffusion models to guarantee distortion, hence the integration of diffusion models and image compression models still needs…

Image and Video Processing · Electrical Eng. & Systems 2024-05-03 Yiyang Ma , Wenhan Yang , Jiaying Liu

Diffusion models have demonstrated their ability to generate diverse and high-quality images, sparking considerable interest in their potential for real image editing applications. However, existing diffusion-based approaches for local…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Wenjing Huang , Shikui Tu , Lei Xu

Recently, using diffusion models for zero-shot image restoration (IR) has become a new hot paradigm. This type of method only needs to use the pre-trained off-the-shelf diffusion models, without any finetuning, and can directly handle…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Yinhuai Wang , Jiwen Yu , Runyi Yu , Jian Zhang

Text-to-image diffusion models have achieved remarkable performance in image synthesis, while the text interface does not always provide fine-grained control over certain image factors. For instance, changing a single token in the text can…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Chen Wu , Fernando De la Torre

Zero-shot referring image segmentation is a challenging task because it aims to find an instance segmentation mask based on the given referring descriptions, without training on this type of paired data. Current zero-shot methods mainly…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Minheng Ni , Yabo Zhang , Kailai Feng , Xiaoming Li , Yiwen Guo , Wangmeng Zuo

Recent advances in diffusion models have significantly enhanced image generation capabilities. However, customizing these models with new classes often leads to unintended consequences that compromise their reliability. We introduce the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Héctor Laria , Alex Gomez-Villa , Kai Wang , Bogdan Raducanu , Joost van de Weijer

Recent advancements in text-to-image generative models have demonstrated a remarkable ability to capture a deep semantic understanding of images. In this work, we leverage this semantic knowledge to transfer the visual appearance between…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Yuval Alaluf , Daniel Garibi , Or Patashnik , Hadar Averbuch-Elor , Daniel Cohen-Or

Diffusion models have demonstrated remarkable performance in image generation, particularly within the domain of style transfer. Prevailing style transfer approaches typically leverage pre-trained diffusion models' robust feature extraction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yeqi He , Liang Li , Zhiwen Yang , Xichun Sheng , Zhidong Zhao , Chenggang Yan

Although diffusion models exhibit impressive generative capabilities, existing methods for stylized image generation based on these models often require textual inversion or fine-tuning with style images, which is time-consuming and limits…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Xin Ma , Yaohui Wang , Xinyuan Chen , Tien-Tsin Wong , Cunjian Chen

Restoring low-resolution text images presents a significant challenge, as it requires maintaining both the fidelity and stylistic realism of the text in restored images. Existing text image restoration methods often fall short in hard…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Chenglu Pan , Xiaogang Xu , Ganggui Ding , Yunke Zhang , Wenbo Li , Jiarong Xu , Qingbiao Wu