English
Related papers

Related papers: Computationally Efficient Approaches for Image Sty…

200 papers

We address the problem of style transfer between two photos and propose a new way to preserve photorealism. Using the single pair of photos available as input, we train a pair of deep convolution networks (convnets), each of which transfers…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Xu Yao , Gilles Puy , Patrick Pérez

This paper introduces a novel method by reshuffling deep features (i.e., permuting the spacial locations of a feature map) of the style image for arbitrary style transfer. We theoretically prove that our new style loss based on reshuffle…

Computer Vision and Pattern Recognition · Computer Science 2018-06-21 Shuyang Gu , Congliang Chen , Jing Liao , Lu Yuan

Text-based style transfer is a newly-emerging research topic that uses text information instead of style image to guide the transfer process, significantly extending the application scenario of style transfer. However, previous methods…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Yunpeng Bai , Jiayue Liu , Chao Dong , Chun Yuan

We consider image transformation problems, where an input image is transformed into an output image. Recent methods for such problems typically train feed-forward convolutional neural networks using a \emph{per-pixel} loss between the…

Computer Vision and Pattern Recognition · Computer Science 2016-03-29 Justin Johnson , Alexandre Alahi , Li Fei-Fei

Hardware acceleration for dilated and transposed convolution enables real time execution of related tasks like segmentation, but current designs are specific for these convolutional types or suffer from complex control for reconfigurable…

Hardware Architecture · Computer Science 2022-05-05 Kuo-Wei Chang , Tian-Sheuan Chang

Universal style transfer aims to transfer arbitrary visual styles to content images. Existing feed-forward based methods, while enjoying the inference efficiency, are mainly limited by inability of generalizing to unseen styles or…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Yijun Li , Chen Fang , Jimei Yang , Zhaowen Wang , Xin Lu , Ming-Hsuan Yang

A popular series of style transfer methods apply a style to a content image by controlling mean and covariance of values in early layers of a feature stack. This is insufficient for transferring styles that have strong structure across…

Computer Vision and Pattern Recognition · Computer Science 2018-01-09 Mao-Chuang Yeh , Shuai Tang

Transposed convolution is crucial for generating high-resolution outputs, yet has received little attention compared to convolution layers. In this work we revisit transposed convolution and introduce a novel layer that allows us to place…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Stefano B. Blumberg , Daniele Raví , Mou-Cheng Xu , Matteo Figini , Iasonas Kokkinos , Daniel C. Alexander

Convolutional sparse coding improves on the standard sparse approximation by incorporating a global shift-invariant model. The most efficient convolutional sparse coding methods are based on the alternating direction method of multipliers…

Machine Learning · Computer Science 2022-02-09 Farshad G. Veshki , Sergiy A. Vorobyov

This paper considers a convolutional neural network transformation that reduces computation complexity and thus speedups neural network processing. Usage of convolutional neural networks (CNN) is the standard approach to image recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Elena Limonova , Alexander Sheshkus , Dmitry Nikolaev

Arbitrary style transfer is an important problem in computer vision that aims to transfer style patterns from an arbitrary style image to a given content image. However, current methods either rely on slow iterative optimization or fast…

Computer Vision and Pattern Recognition · Computer Science 2020-12-25 Suryabhan Singh Hada , Miguel Á. Carreira-Perpiñán

Video frame interpolation is an increasingly important research task with several key industrial applications in the video coding, broadcast and production sectors. Recently, transformers have been introduced to the field resulting in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Issa Khalifeh , Luka Murn , Marta Mrak , Ebroul Izquierdo

In this work, we tackle model efficiency by exploiting redundancy in the \textit{implicit structure} of the building blocks of convolutional neural networks. We start our analysis by introducing a general definition of Composite Kernel…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Yash Bhalgat , Yizhe Zhang , Jamie Lin , Fatih Porikli

Dilated Convolutions have been shown to be highly useful for the task of image segmentation. By introducing gaps into convolutional filters, they enable the use of larger receptive fields without increasing the original kernel size. Even…

Computer Vision and Pattern Recognition · Computer Science 2019-03-20 Thomas Ziegler , Manuel Fritsche , Lorenz Kuhn , Konstantin Donhauser

We present StyleBlit---an efficient example-based style transfer algorithm that can deliver high-quality stylized renderings in real-time on a single-core CPU. Our technique is especially suitable for style transfer applications that use…

Graphics · Computer Science 2018-07-10 Daniel Sýkora , Ondřej Jamriška , Jingwan Lu , Eli Shechtman

This paper focuses on latent representations that could effectively decompose different aspects of textual information. Using a framework of style transfer for texts, we propose several empirical methods to assess information decomposition…

Computation and Language · Computer Science 2022-11-15 Ivan P. Yamshchikov , Viacheslav Shibaev , Aleksander Nagaev , Jürgen Jost , Alexey Tikhonov

Universal Neural Style Transfer (NST) methods are capable of performing style transfer of arbitrary styles in a style-agnostic manner via feature transforms in (almost) real-time. Even though their unimodal parametric style modeling…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Paraskevas Pegios , Nikolaos Passalis , Anastasios Tefas

Recent work has shown impressive success in transferring painterly style to images. These approaches, however, fall short of photorealistic style transfer. Even when both the input and reference images are photographs, the output still…

Computer Vision and Pattern Recognition · Computer Science 2017-09-29 Roey Mechrez , Eli Shechtman , Lihi Zelnik-Manor

Style transfer aims to render an image with the artistic features of a style image, while maintaining the original structure. Various methods have been put forward for this task, but some challenges still exist. For instance, it is…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Sizhe Zheng , Pan Gao , Peng Zhou , Jie Qin

Depthwise separable convolutions reduce the number of parameters and computation used in convolutional operations while increasing representational efficiency. They have been shown to be successful in image classification models, both in…

Computation and Language · Computer Science 2017-06-19 Lukasz Kaiser , Aidan N. Gomez , Francois Chollet