English
Related papers

Related papers: Image-Based CLIP-Guided Essence Transfer

200 papers

Diffusion models have become prominent in creating high-quality images. However, unlike GAN models celebrated for their ability to edit images in a disentangled manner, diffusion-based text-to-image models struggle to achieve the same level…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Hidir Yesiltepe , Yusuf Dalva , Pinar Yanardag

Discovering meaningful directions in the latent space of GANs to manipulate semantic attributes typically requires large amounts of labeled data. Recent work aims to overcome this limitation by leveraging the power of Contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Umut Kocasari , Alara Dirik , Mert Tiftikci , Pinar Yanardag

Text-to-image diffusion models have shown remarkable capabilities of generating high-quality images closely aligned with textual inputs. However, the effectiveness of text guidance heavily relies on the CLIP text encoder, which is trained…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Zexi Jia , Chuanwei Huang , Hongyan Fei , Yeshuang Zhu , Zhiqiang Yuan , Jinchao Zhang , Jie Zhou

Image-to-image translation aims to learn a mapping between a source and a target domain, enabling tasks such as style transfer, appearance transformation, and domain adaptation. In this work, we explore a diffusion-based framework for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Qiang Zhu , Kuan Lu , Menghao Huo , Yuxiao Li

This paper proposes a novel knowledge-Base (KB) assisted semantic communication framework for image transmission. At the receiver, a Facebook AI Similarity Search (FAISS) based vector database is constructed by extracting semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Chongyang Li , Yanmei He , Tianqian Zhang , Mingjian He , Shouyin Liu

High quality facial image editing is a challenging problem in the movie post-production industry, requiring a high degree of control and identity preservation. Previous works that attempt to tackle this problem may suffer from the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Xu Yao , Alasdair Newson , Yann Gousseau , Pierre Hellier

CLIPStyler demonstrated image style transfer with realistic textures using only the style text description (instead of requiring a reference style image). However, the ground semantics of objects in style transfer output is lost due to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Chanda G Kamra , Indra Deep Mastan , Debayan Gupta

Diffusion models have emerged as the leading approach for style transfer, yet they struggle with photo-realistic transfers, often producing painting-like results or missing detailed stylistic elements. Current methods inadequately address…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Luan Thanh Trinh , Kenji Doi , Atsuki Osanai

Improper exposure often leads to severe loss of details, color distortion, and reduced contrast. Exposure correction still faces two critical challenges: (1) the ignorance of object-wise regional semantic information causes the color shift…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Puzhen Wu , Han Weng , Quan Zheng , Yi Zhan , Hewei Wang , Yiming Li , Jiahui Han , Rui Xu

The objective of stylized speech-driven facial animation is to create animations that encapsulate specific emotional expressions. Existing methods often depend on pre-established emotional labels or facial expression templates, which may…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Yicheng Zhong , Huawei Wei , Peiji Yang , Zhisheng Wang

Image attribute transfer aims to change an input image to a target one with expected attributes, which has received significant attention in recent years. However, most of the existing methods lack the ability to de-correlate the target…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 De Xie , Muli Yang , Cheng Deng , Wei Liu , Dacheng Tao

Multi-domain image-to-image translation re quires grounding semantic differences ex pressed in natural language prompts into corresponding visual transformations, while preserving unrelated structural and seman tic content. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Jongwon Ryu , Joonhyung Park , Jaeho Han , Yeong-Seok Kim , Hye-rin Kim , Sunjae Yoon , Junyeong Kim

Content and style (C-S) disentanglement is a fundamental problem and critical challenge of style transfer. Existing approaches based on explicit definitions (e.g., Gram matrix) or implicit learning (e.g., GANs) are neither interpretable nor…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Zhizhong Wang , Lei Zhao , Wei Xing

We propose StyleBank, which is composed of multiple convolution filter banks and each filter bank explicitly represents one style, for neural image style transfer. To transfer an image to a specific style, the corresponding filter bank is…

Computer Vision and Pattern Recognition · Computer Science 2017-03-29 Dongdong Chen , Lu Yuan , Jing Liao , Nenghai Yu , Gang Hua

Text-to-image diffusion models have remarkably excelled in producing diverse, high-quality, and photo-realistic images. This advancement has spurred a growing interest in incorporating specific identities into generated content. Most…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaoming Li , Xinyu Hou , Chen Change Loy

Artistic style transfer is an image synthesis problem where the content of an image is reproduced with the style of another. Recent works show that a visually appealing style transfer can be achieved by using the hidden activations of a…

Computer Vision and Pattern Recognition · Computer Science 2016-12-14 Tian Qi Chen , Mark Schmidt

Large-scale text-to-image generative models have been a revolutionary breakthrough in the evolution of generative AI, allowing us to synthesize diverse images that convey highly complex visual concepts. However, a pivotal challenge in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Narek Tumanyan , Michal Geyer , Shai Bagon , Tali Dekel

In recent years, language-driven artistic style transfer has emerged as a new type of style transfer technique, eliminating the need for a reference style image by using natural language descriptions of the style. The first model to achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Ananda Padhmanabhan Suresh , Sanjana Jain , Pavit Noinongyao , Ankush Ganguly , Ukrit Watchareeruetai , Aubin Samacoits

Image style transfer occupies an important place in both computer graphics and computer vision. However, most current methods require reference to stylized images and cannot individually stylize specific objects. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Junhao Chen , Peng Rong , Jingbo Sun , Chao Li , Xiang Li , Hongwu Lv

Generating images that fit a given text description using machine learning has improved greatly with the release of technologies such as the CLIP image-text encoder model; however, current methods lack artistic control of the style of image…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Peter Schaldenbrand , Zhixuan Liu , Jean Oh