English
Related papers

Related papers: Style Transfer with Diffusion Models for Synthetic…

200 papers

Face stylization refers to the transformation of a face into a specific portrait style. However, current methods require the use of example-based adaptation approaches to fine-tune pre-trained generative models so that they demand lots of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Jin Liu , Huaibo Huang , Chao Jin , Ran He

Diffusion models, capable of high-quality image generation, receive unparalleled popularity for their ease of extension. Active users have created a massive collection of domain-specific diffusion models by fine-tuning base models on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Haoming Liu , Yuanhe Guo , Shengjie Wang , Hongyi Wen

Data scarcity in medical imaging poses significant challenges due to privacy concerns. Diffusion models, a recent generative modeling technique, offer a potential solution by generating synthetic and realistic data. However, questions…

Image and Video Processing · Electrical Eng. & Systems 2024-12-24 Abdullah al Nomaan Nafi , Md. Alamgir Hossain , Rakib Hossain Rifat , Md Mahabub Uz Zaman , Md Manjurul Ahsan , Shivakumar Raman

To overcome the domain gap between synthetic and real-world datasets, unsupervised domain adaptation methods have been proposed for semantic segmentation. Majority of the previous approaches have attempted to reduce the gap either at the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Tianyu Li , Subhankar Roy , Huayi Zhou , Hongtao Lu , Stephane Lathuiliere

In this paper, we present a novel paradigm to enhance the ability of object detector, e.g., expanding categories or improving detection performance, by training on synthetic dataset generated from diffusion models. Specifically, we…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Chengjian Feng , Yujie Zhong , Zequn Jie , Weidi Xie , Lin Ma

The absence of well-structured large datasets in medical computer vision results in decreased performance of automated systems and, especially, of deep learning models. Domain generalization techniques aim to approach unknown domains from a…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Nikolaos Spanos , Anastasios Arsenos , Paraskevi-Antonia Theofilou , Paraskevi Tzouveli , Athanasios Voulodimos , Stefanos Kollias

Text-to-image diffusion models excel at translating language prompts into photorealistic images by implicitly grounding textual concepts through their cross-modal attention mechanisms. Recent multi-modal diffusion transformers extend this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Chaehyun Kim , Heeseong Shin , Eunbeen Hong , Heeji Yoon , Anurag Arnab , Paul Hongsuck Seo , Sunghwan Hong , Seungryong Kim

Text-to-Image synthesis is the task of generating an image according to a specific text description. Generative Adversarial Networks have been considered the standard method for image synthesis virtually since their introduction. Denoising…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Konstantina Nikolaidou , George Retsinas , Vincent Christlein , Mathias Seuret , Giorgos Sfikas , Elisa Barney Smith , Hamam Mokayed , Marcus Liwicki

Continual Test-Time Adaptation (CTTA) enables pre-trained models to adapt to continuously evolving domains. Existing methods have improved robustness but typically rely on fixed or batch-level thresholds, which cannot account for varying…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Seunghwan Lee , Inyoung Jung , Hojoon Lee , Eunil Park , Sungeun Hong

In semantic image synthesis the state of the art is dominated by methods that use customized variants of the SPatially-Adaptive DE-normalization (SPADE) layers, which allow for good visual generation quality and editing versatility. By…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Tomaso Fontanini , Claudio Ferrari , Giuseppe Lisanti , Massimo Bertozzi , Andrea Prati

Text style transfer aims to alter the style of a sentence while preserving its content. Due to the lack of parallel corpora, most recent work focuses on unsupervised methods and often uses cycle construction to train models. Since cycle…

Computation and Language · Computer Science 2022-12-20 Kangchen Zhu , Zhiliang Tian , Ruifeng Luo , Xiaoguang Mao

Training a deep network to perform semantic segmentation requires large amounts of labeled data. To alleviate the manual effort of annotating real images, researchers have investigated the use of synthetic data, which can be labeled…

Computer Vision and Pattern Recognition · Computer Science 2018-07-18 Fatemeh Sadat Saleh , Mohammad Sadegh Aliakbarian , Mathieu Salzmann , Lars Petersson , Jose M. Alvarez

Text-to-image synthesis has achieved high-quality results with recent advances in diffusion models. However, text input alone has high spatial ambiguity and limited user controllability. Most existing methods allow spatial control through…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yuki Endo

Diffusion models, a specific type of generative model, have achieved unprecedented performance in recent years and consistently produce high-quality synthetic samples. A critical prerequisite for their notable success lies in the presence…

Machine Learning · Computer Science 2024-11-01 Yidong Ouyang , Liyan Xie , Hongyuan Zha , Guang Cheng

Domain Generalization techniques aim to enhance model robustness by simulating novel data distributions during training, typically through various augmentation or stylization strategies. However, these methods frequently suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Gustavo Adolfo Vargas Hakim , David Osowiechi , Moslem Yazdanpanah , Ismail Ben Ayed , Christian Desrosiers

Cross-modal garment synthesis and manipulation will significantly benefit the way fashion designers generate garments and modify their designs via flexible linguistic interfaces.Current approaches follow the general text-to-image paradigm…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Xujie Zhang , Binbin Yang , Michael C. Kampffmeyer , Wenqing Zhang , Shiyue Zhang , Guansong Lu , Liang Lin , Hang Xu , Xiaodan Liang

Image fusion aims to blend complementary information from multiple sensing modalities, yet existing approaches remain limited in robustness, adaptability, and controllability. Most current fusion networks are tailored to specific tasks and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jiayang Li , Chengjie Jiang , Junjun Jiang , Pengwei Liang , Jiayi Ma , Liqiang Nie

Test-time adaptation enables models to adapt to evolving domains. However, balancing the tradeoff between preserving knowledge and adapting to domain shifts remains challenging for model adaptation methods, since adapting to domain shifts…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Gabriel Tjio , Jie Zhang , Xulei Yang , Yun Xing , Nhat Chung , Xiaofeng Cao , Ivor W. Tsang , Chee Keong Kwoh , Qing Guo

A robust face recognition model must be trained using datasets that include a large number of subjects and numerous samples per subject under varying conditions (such as pose, expression, age, noise, and occlusion). Due to ethical and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Bernardo Biesseck , Pedro Vidal , Luiz Coelho , Roger Granada , David Menotti|

We present StyleClone, a method for training image-to-image translation networks to stylize faces in a specific style, even with limited style images. Our approach leverages textual inversion and diffusion-based guided image generation to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Neeraj Matiyali , Siddharth Srivastava , Gaurav Sharma