English
Related papers

Related papers: Controllable Style Transfer via Test-time Training…

200 papers

We propose symmetric power transformation to enhance the capacity of Implicit Neural Representation~(INR) from the perspective of data transformation. Unlike prior work utilizing random permutation or index rearrangement, our method…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Weixiang Zhang , Shuzhao Xie , Chengwei Ren , Shijia Ge , Mingzi Wang , Zhi Wang

In this paper, we introduce MRStyle, a comprehensive framework that enables color style transfer using multi-modality reference, including image and text. To achieve a unified style feature space for both modalities, we first develop a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Jiancheng Huang , Yu Gao , Zequn Jie , Yujie Zhong , Xintong Han , Lin Ma

Previous works on neural text-to-speech (TTS) have been addressed on limited speed in training and inference time, robustness for difficult synthesis conditions, expressiveness, and controllability. Although several approaches resolve some…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-28 Keon Lee , Kyumin Park , Daeyoung Kim

We present a novel framework, Localized Image Stylization with Audio (LISA) which performs audio-driven localized image stylization. Sound often provides information about the specific context of the scene and is closely related to a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Seung Hyun Lee , Chanyoung Kim , Wonmin Byeon , Sang Ho Yoon , Jinkyu Kim , Sangpil Kim

We present a training-free framework for continuous and controllable image editing at test time for text-conditioned generative models. In contrast to prior approaches that rely on additional training or manual user intervention, we find…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Yigit Ekin , Yossi Gandelsman

The Fast Style Transfer methods have been recently proposed to transfer a photograph to an artistic style in real-time. This task involves controlling the stroke size in the stylized results, which remains an open challenge. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Yongcheng Jing , Yang Liu , Yezhou Yang , Zunlei Feng , Yizhou Yu , Dacheng Tao , Mingli Song

We build on the Visual Autoregressive Modeling (VAR) framework and formulate style transfer as conditional discrete sequence modeling in a learned latent space. Images are decomposed into multi-scale representations and tokenized into…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Liqi Jing , Dingming Zhang , Peinian Li , Lichen Zhu , Yang Xu , Hanyu Xing

In most cases, the lack of parallel corpora makes it impossible to directly train supervised models for the text style transfer task. In this paper, we explore training algorithms that instead optimize reward functions that explicitly…

Computation and Language · Computer Science 2021-05-14 Yixin Liu , Graham Neubig , John Wieting

We propose StyleBank, which is composed of multiple convolution filter banks and each filter bank explicitly represents one style, for neural image style transfer. To transfer an image to a specific style, the corresponding filter bank is…

Computer Vision and Pattern Recognition · Computer Science 2017-03-29 Dongdong Chen , Lu Yuan , Jing Liao , Nenghai Yu , Gang Hua

Deep Learning in Image Registration (DLIR) methods have been tremendously successful in image registration due to their speed and ability to incorporate weak label supervision at training time. However, existing DLIR methods forego many of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Rohit Jena , Pratik Chaudhari , James C. Gee

In recent years, language-driven artistic style transfer has emerged as a new type of style transfer technique, eliminating the need for a reference style image by using natural language descriptions of the style. The first model to achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Ananda Padhmanabhan Suresh , Sanjana Jain , Pavit Noinongyao , Ankush Ganguly , Ukrit Watchareeruetai , Aubin Samacoits

This paper creates a novel method of deep neural style transfer by generating style images from freeform user text input. The language model and style transfer model form a seamless pipeline that can create output images with similar losses…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Tejas Santanam , Mengyang Liu , Jiangyue Yu , Zhaodong Yang

Despite the remarkable progress of image captioning, existing captioners typically lack the controllable capability to generate desired image captions, e.g., describing the image in a rough or detailed manner, in a factual or emotional…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Ning Wang , Jiahao Xie , Jihao Wu , Mingbo Jia , Linlin Li

We consider image transformation problems, where an input image is transformed into an output image. Recent methods for such problems typically train feed-forward convolutional neural networks using a \emph{per-pixel} loss between the…

Computer Vision and Pattern Recognition · Computer Science 2016-03-29 Justin Johnson , Alexandre Alahi , Li Fei-Fei

Transferring artistic styles onto everyday photographs has become an extremely popular task in both academia and industry. Recently, offline training has replaced on-line iterative optimization, enabling nearly real-time stylization. When…

Computer Vision and Pattern Recognition · Computer Science 2017-12-01 Xin Wang , Geoffrey Oxholm , Da Zhang , Yuan-Fang Wang

Iterative linear quadratic regulator (iLQR) has gained wide popularity in addressing trajectory optimization problems with nonlinear system models. However, as a model-based shooting method, it relies heavily on an accurate system model to…

Machine Learning · Computer Science 2022-09-16 Zilong Cheng , Yulin Li , Kai Chen , Jun Ma , Tong Heng Lee

Style transfer aims to transfer arbitrary visual styles to content images. We explore algorithms adapted from two papers that try to solve the problem of style transfer while generalizing on unseen styles or compromised visual quality.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Somshubra Majumdar , Amlaan Bhoi , Ganesh Jagadeesan

Stylized view generation of scenes captured casually using a camera has received much attention recently. The geometry and appearance of the scene are typically captured as neural point sets or neural radiance fields in the previous work.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Rahul Goel , Sirikonda Dhawal , Saurabh Saini , P. J. Narayanan

This research presents a new parametric style transfer framework specifically designed for curve-based design sketches. In this research, traditional challenges faced by neural style transfer methods in handling binary sketch…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Yu-hsuan Chen , Levent Burak Kara , Jonathan Cagan

Efficient and fast reconstruction of anatomical structures plays a crucial role in clinical practice. Minimizing retrieval and processing times not only potentially enhances swift response and decision-making in critical scenarios but also…