English
Related papers

Related papers: Image-Based CLIP-Guided Essence Transfer

200 papers

Arbitrary style transfer holds widespread attention in research and boasts numerous practical applications. The existing methods, which either employ cross-attention to incorporate deep style attributes into content attributes or use…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Zhanjie Zhang , Jiakai Sun , Guangyuan Li , Lei Zhao , Quanwei Zhang , Zehua Lan , Haolin Yin , Wei Xing , Huaizhong Lin , Zhiwen Zuo

Recent feed-forward neural methods of arbitrary image style transfer mainly utilized encoded feature map upto its second-order statistics, i.e., linearly transformed the encoded feature map of a content image to have the same mean and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Jeong-Sik Lee , Hyun-Chul Choi

Style transfer usually refers to the task of applying color and texture information from a specific style image to a given content image while preserving the structure of the latter. Here we tackle the more generic problem of semantic style…

Computer Vision and Pattern Recognition · Computer Science 2018-07-11 Amélie Royer , Konstantinos Bousmalis , Stephan Gouws , Fred Bertsch , Inbar Mosseri , Forrester Cole , Kevin Murphy

Image to image translation is the problem of transferring an image from a source domain to a different (but related) target domain. We present a new unsupervised image to image translation technique that leverages the underlying semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Pravakar Roy , Nicolai Häni , Jun-Jee Chao , Volkan Isler

We present a simple but effective training-free approach for text-driven image-to-image translation based on a pretrained text-to-image diffusion model. Our goal is to generate an image that aligns with the target task while preserving the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Hyunsoo Lee , Minsoo Kang , Bohyung Han

In this work, we propose a Robust, Efficient, and Component-specific makeup transfer method (abbreviated as BeautyREC). A unique departure from prior methods that leverage global attention, simply concatenate features, or implicitly…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Qixin Yan , Chunle Guo , Jixin Zhao , Yuekun Dai , Chen Change Loy , Chongyi Li

We propose a novel architecture for GAN inversion, which we call Feature-Style encoder. The style encoder is key for the manipulation of the obtained latent codes, while the feature encoder is crucial for optimal image reconstruction. Our…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Xu Yao , Alasdair Newson , Yann Gousseau , Pierre Hellier

Text-guided medical segmentation enhances segmentation accuracy by utilizing clinical reports as auxiliary information. However, existing methods typically rely on unaligned image and text encoders, which necessitate complex interaction…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Gaoren Lin , Huangxuan Zhao , Yuan Xiong , Lefei Zhang , Bo Du , Wentao Zhu

While existing makeup style transfer models perform an image synthesis whose results cannot be explicitly controlled, the ability to modify makeup color continuously is a desirable property for virtual try-on applications. We propose a new…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Robin Kips , Pietro Gori , Matthieu Perrot , Isabelle Bloch

Transformer-based CLIP models are widely used for text-image probing and feature extraction, making it relevant to understand the internal mechanisms behind their predictions. While recent works show that Sparse Autoencoders (SAEs) yield…

Machine Learning · Computer Science 2025-05-27 Maximilian Dreyer , Lorenz Hufe , Jim Berend , Thomas Wiegand , Sebastian Lapuschkin , Wojciech Samek

To meet the women appearance needs, we present a novel virtual experience approach of facial makeup transfer, developed into windows platform application software. The makeup effects could present on the user's input image in real time,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-09 Xin Jin , Rui Han , Ning Ning , Xiaodong Li , Xiaokun Zhang

Artistic style transfer has long been possible with the advancements of convolution- and transformer-based neural networks. Most algorithms apply the artistic style transfer to the whole image, but individual users may only need to apply a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Seyed Hadi Seyed , Ayberk Cansever , David Hart

Recent advances in style and appearance transfer are impressive, but most methods isolate global style and local appearance transfer, neglecting semantic correspondence. Additionally, image and video tasks are typically handled in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Huiang He , Minghui Hu , Chuanxia Zheng , Chaoyue Wang , Tat-Jen Cham

Style transfer, a pivotal task in image processing, synthesizes visually compelling images by seamlessly blending realistic content with artistic styles, enabling applications in photo editing and creative design. While mainstream…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yingying Deng , Xiangyu He , Fan Tang , Weiming Dong , Xucheng Yin

Despite the advancements in diffusion-based image style transfer, existing methods are commonly limited by 1) semantic gap: the style reference could miss proper content semantics, causing uncontrollable stylization; 2) reliance on extra…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Boyu He , Yunfan Ye , Chang Liu , Weishang Wu , Fang Liu , Zhiping Cai

Neural style transfer has been demonstrated to be powerful in creating artistic image with help of Convolutional Neural Networks (CNN). However, there is still lack of computational analysis of perceptual components of the artistic style.…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Minchao Li , Shikui Tu , Lei Xu

Token merging can effectively accelerate various vision systems by processing groups of similar tokens only once and sharing the results across them. However, existing token grouping methods are often ad hoc and random, disregarding the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Haoyu Wu , Jingyi Xu , Hieu Le , Dimitris Samaras

Computing the gradient of an image is a common step in computer vision pipelines. The image gradient quantifies the magnitude and direction of edges in an image and is used in creating features for downstream machine learning tasks.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-20 Shouvik Mani

Artistic text style transfer is the task of migrating the style from a source image to the target text to create artistic typography. Recent style transfer methods have considered texture control to enhance usability. However, controlling…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Shuai Yang , Zhangyang Wang , Zhaowen Wang , Ning Xu , Jiaying Liu , Zongming Guo

Recent text-to-image generation methods provide a simple yet exciting conversion capability between text and image domains. While these methods have incrementally improved the generated image fidelity and text relevancy, several pivotal…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Oran Gafni , Adam Polyak , Oron Ashual , Shelly Sheynin , Devi Parikh , Yaniv Taigman