English
Related papers

Related papers: Learning Disentangled Prompts for Compositional Im…

200 papers

Generative Zero-Shot Learning (ZSL) methods synthesize class-related features based on predefined class semantic prototypes, showcasing superior performance. However, this feature generation paradigm falls short of providing interpretable…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Dingjie Fu , Wenjin Hou , Shiming Chen , Shuhuang Chen , Xinge You , Salman Khan , Fahad Shahbaz Khan

In the realm of image generation, creating customized images from visual prompt with additional textual instruction emerges as a promising endeavor. However, existing methods, both tuning-based and tuning-free, struggle with interpreting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Jing He , Haodong Li , Yongzhe Hu , Guibao Shen , Yingjie Cai , Weichao Qiu , Ying-Cong Chen

Obtaining a useful estimate of an object from highly incomplete imaging measurements remains a holy grail of imaging science. Deep learning methods have shown promise in learning object priors or constraints to improve the conditioning of…

Image and Video Processing · Electrical Eng. & Systems 2021-06-28 Varun A. Kelkar , Mark A. Anastasio

Contemporary deep learning architectures lack principled means for capturing and handling fundamental visual concepts, like objects, shapes, geometric transforms, and other higher-level structures. We propose a neurosymbolic architecture…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Krzysztof Krawiec , Antoni Nowinowski

Can a generative model be trained to produce images from a specific domain, guided by a text prompt only, without seeing any image? In other words: can an image generator be trained "blindly"? Leveraging the semantic power of large scale…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Rinon Gal , Or Patashnik , Haggai Maron , Gal Chechik , Daniel Cohen-Or

Domain Generalization (DG) is a fundamental challenge for machine learning models, which aims to improve model generalization on various domains. Previous methods focus on generating domain invariant features from various source domains.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Daoan Zhang , Mingkai Chen , Chenming Li , Lingyun Huang , Jianguo Zhang

Text-to-image diffusion models have shown impressive capabilities in generating realistic visuals from natural-language prompts, yet they often struggle with accurately binding attributes to corresponding objects, especially in prompts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Do Huu Dat , Nam Hyeonu , Po-Yuan Mao , Tae-Hyun Oh

Many methods of semantic image segmentation have borrowed the success of open compound domain adaptation. They minimize the style gap between the images of source and target domains, more easily predicting the accurate pseudo annotations…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Tingliang Feng , Hao Shi , Xueyang Liu , Wei Feng , Liang Wan , Yanlin Zhou , Di Lin

While originally designed for image generation, diffusion models have recently shown to provide excellent pretrained feature representations for semantic segmentation. Intrigued by this result, we set out to explore how well…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Rui Gong , Martin Danelljan , Han Sun , Julio Delgado Mangas , Luc Van Gool

Disentanglement of visual features of primitives (i.e., attributes and objects) has shown exceptional results in Compositional Zero-shot Learning (CZSL). However, due to the feature divergence of an attribute (resp. object) when combined…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Yuxia Geng , Runkai Zhu , Jiaoyan Chen , Jintai Chen , Xiang Chen , Zhuo Chen , Shuofei Qiao , Yuxiang Wang , Xiaoliang Xu , Sheng-Jun Huang

We introduce a segmentation-guided approach to synthesise images that integrate features from two distinct domains. Images synthesised by our dual-domain model belong to one domain within the semantic mask, and to another in the rest of the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Dena Bazazian , Andrew Calway , Dima Damen

Recently, CLIP-guided image synthesis has shown appealing performance on adapting a pre-trained source-domain generator to an unseen target domain. It does not require any target-domain samples but only the textual domain labels. The…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Jiayi Guo , Chaofei Wang , You Wu , Eric Zhang , Kai Wang , Xingqian Xu , Shiji Song , Humphrey Shi , Gao Huang

Recent generative models demonstrate impressive performance on synthesizing photographic images, which makes humans hardly to distinguish them from pristine ones, especially on realistic-looking synthetic facial images. Previous works…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Hao Wang , Cheng Deng , Zhidong Zhao

In zero-shot learning (ZSL), generative methods synthesize class-related sample features based on predefined semantic prototypes. They advance the ZSL performance by synthesizing unseen class sample features for better training the…

Machine Learning · Computer Science 2023-06-13 Shiming Chen , Wenjin Hou , Ziming Hong , Xiaohan Ding , Yibing Song , Xinge You , Tongliang Liu , Kun Zhang

For image generation with diffusion models (DMs), a negative prompt n can be used to complement the text prompt p, helping define properties not desired in the synthesized image. While this improves prompt adherence and image quality,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Alakh Desai , Nuno Vasconcelos

Contrastive language-image pretraining has shown great success in learning visual-textual joint representation from web-scale data, demonstrating remarkable "zero-shot" generalization ability for various image tasks. However, how to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Bolin Ni , Houwen Peng , Minghao Chen , Songyang Zhang , Gaofeng Meng , Jianlong Fu , Shiming Xiang , Haibin Ling

Data-Free Knowledge Distillation (DFKD) has shown great potential in creating a compact student model while alleviating the dependency on real training data by synthesizing surrogate data. However, prior arts are seldom discussed under…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yunyi Xuan , Weijie Chen , Shicai Yang , Di Xie , Luojun Lin , Yueting Zhuang

Large pre-trained vision-language models, such as CLIP, have shown remarkable generalization capabilities across various tasks when appropriate text prompts are provided. However, adapting these models to specific domains, like remote…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Qinglong Cao , Zhengqin Xu , Yuntian Chen , Chao Ma , Xiaokang Yang

Many methods have been proposed to solve the domain adaptation problem recently. However, the success of them implicitly funds on the assumption that the information of domains are fully transferrable. If the assumption is not satisfied,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Hoang Tran Vu , Ching-Chun Huang

Large-scale foundation models, such as CLIP, have demonstrated impressive zero-shot generalization performance on downstream tasks, leveraging well-designed language prompts. However, these prompt learning techniques often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Shirsha Bose , Ankit Jha , Enrico Fini , Mainak Singha , Elisa Ricci , Biplab Banerjee