English
Related papers

Related papers: Style Transfer with Diffusion Models for Synthetic…

200 papers

As synthetic imagery is used more frequently in training deep models, it is important to understand how different synthesis techniques impact the performance of such models. In this work, we perform a thorough evaluation of the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Kristofer Schlachter , Connor DeFanti , Sebastian Herscher , Ken Perlin , Jonathan Tompson

Reusing pre-collected data from different domains is an appealing solution for decision-making tasks, especially when data in the target domain are limited. Existing cross-domain policy transfer methods mostly aim at learning domain…

Robotics · Computer Science 2026-03-10 Haoyi Niu , Qimao Chen , Tenglong Liu , Jianxiong Li , Guyue Zhou , Yi Zhang , Jianming Hu , Xianyuan Zhan

Deep learning models dealing with image understanding in real-world settings must be able to adapt to a wide variety of tasks across different domains. Domain adaptation and class incremental learning deal with domain and task variability…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Marco Toldo , Umberto Michieli , Pietro Zanuttigh

This paper introduces a novel synthetic dataset that captures urban scenes under a variety of weather conditions, providing pixel-perfect, ground-truth-aligned images to facilitate effective feature alignment across domains. Additionally,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Javier Montalvo , Roberto Alcover-Couso , Pablo Carballeira , Álvaro García-Martín , Juan C. SanMiguel , Marcos Escudero-Viñolo

Due to the high potential for abuse of GenAI systems, the task of detecting synthetic images has recently become of great interest to the research community. Unfortunately, existing image-space detectors quickly become obsolete as new…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 George Cazenavette , Avneesh Sud , Thomas Leung , Ben Usman

We show that diffusion models can achieve image sample quality superior to the current state-of-the-art generative models. We achieve this on unconditional image synthesis by finding a better architecture through a series of ablations. For…

Machine Learning · Computer Science 2021-06-02 Prafulla Dhariwal , Alex Nichol

Deep learning models in computational pathology often fail to generalize across cohorts and institutions due to domain shift. Existing approaches either fail to leverage unlabeled data from the target domain or rely on image-to-image…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Tengyue Zhang , Ruiwen Ding , Luoting Zhuang , Yuxiao Wu , Erika F. Rodriguez , William Hsu

Test-time adaptation (TTA) aims to improve the performance of source-domain pre-trained models on previously unseen, shifted target domains. Traditional TTA methods primarily adapt model weights based on target data streams, making model…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jiayi Guo , Junhao Zhao , Chaoqun Du , Yulin Wang , Chunjiang Ge , Zanlin Ni , Shiji Song , Humphrey Shi , Gao Huang

Semantic communications mark a paradigm shift from bit-accurate transmission toward meaning-centric communication, essential as wireless systems approach theoretical capacity limits. The emergence of generative AI has catalyzed generative…

Signal Processing · Electrical Eng. & Systems 2026-05-08 Hai-Long Qin , Jincheng Dai , Guo Lu , Shuo Shao , Sixian Wang , Tongda Xu , Wenjun Zhang , Ping Zhang , Khaled B. Letaief

The diffusion-based text-to-image model harbors immense potential in transferring reference style. However, current encoder-based approaches significantly impair the text controllability of text-to-image models while transferring styles. In…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Tianhao Qi , Shancheng Fang , Yanze Wu , Hongtao Xie , Jiawei Liu , Lang Chen , Qian He , Yongdong Zhang

Style transfer presents a significant challenge, primarily centered on identifying an appropriate style representation. Conventional methods employ style loss, derived from second-order statistics or contrastive learning, to constrain style…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Yingying Deng , Xiangyu He , Fan Tang , Weiming Dong

The issue of generative pretraining for vision models has persisted as a long-standing conundrum. At present, the text-to-image (T2I) diffusion model demonstrates remarkable proficiency in generating high-definition images matching textual…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Qiang Wan , Zilong Huang , Bingyi Kang , Jiashi Feng , Li Zhang

Deep learning has shown remarkable performance in medical image segmentation. However, despite its promise, deep learning has many challenges in practice due to its inability to effectively transition to unseen domains, caused by the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Dewei Hu , Hao Li , Han Liu , Jiacheng Wang , Xing Yao , Daiwei Lu , Ipek Oguz

Recently, the multimedia community has witnessed the rise of diffusion models trained on large-scale multi-modal data for visual content creation, particularly in the field of text-to-image generation. In this paper, we propose a new task…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Jingwen Chen , Yingwei Pan , Ting Yao , Tao Mei

Arbitrary style transfer aims to synthesize a content image with the style of an image to create a third image that has never been seen before. Recent arbitrary style transfer algorithms find it challenging to balance the content structure…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Dae Young Park , Kwang Hee Lee

The goal of style transfer is, given a content image and a style source, generating a new image preserving the content but with the artistic representation of the style source. Most of the state-of-the-art architectures use transformers or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Filippo Botti , Alex Ergasti , Leonardo Rossi , Tomaso Fontanini , Claudio Ferrari , Massimo Bertozzi , Andrea Prati

The pre-trained text-image discriminative models, such as CLIP, has been explored for open-vocabulary semantic segmentation with unsatisfactory results due to the loss of crucial localization information and awareness of object shapes.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Jinglong Wang , Xiawei Li , Jing Zhang , Qingyuan Xu , Qin Zhou , Qian Yu , Lu Sheng , Dong Xu

Controllable image synthesis with user scribbles has gained huge public interest with the recent advent of text-conditioned latent diffusion models. The user scribbles control the color composition while the text prompt provides control…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Jaskirat Singh , Stephen Gould , Liang Zheng

Cross-domain sentiment classification (CDSC) aims to use the transferable semantics learned from the source domain to predict the sentiment of reviews in the unlabeled target domain. Existing studies in this task attach more attention to…

Computation and Language · Computer Science 2022-05-19 Kai Zhang , Qi Liu , Zhenya Huang , Mingyue Cheng , Kun Zhang , Mengdi Zhang , Wei Wu , Enhong Chen

As Diffusion Models have shown promising performance, a lot of efforts have been made to improve the controllability of Diffusion Models. However, how to train Diffusion Models to have the disentangled latent spaces and how to naturally…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Wonwoong Cho , Hareesh Ravi , Midhun Harikumar , Vinh Khuc , Krishna Kumar Singh , Jingwan Lu , David I. Inouye , Ajinkya Kale