English
Related papers

Related papers: Characterizing and Improving Stability in Neural S…

200 papers

Image stylization has seen significant advancement and widespread interest over the years, leading to the development of a multitude of techniques. Extending these stylization techniques, such as Neural Style Transfer (NST), to videos is…

Graphics · Computer Science 2023-07-03 Sumit Shekhar , Max Reimann , Moritz Hilscher , Amir Semmo , Jürgen Döllner , Matthias Trapp

Training a feed-forward network for fast neural style transfer of images is proven to be successful. However, the naive extension to process video frame by frame is prone to producing flickering results. We propose the first end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2017-03-29 Dongdong Chen , Jing Liao , Lu Yuan , Nenghai Yu , Gang Hua

When trying to independently apply image-trained algorithms to successive frames in videos, noxious flickering tends to appear. State-of-the-art post-processing techniques that aim at fostering temporal consistency, generate other temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Hugo Thimonier , Julien Despois , Robin Kips , Matthieu Perrot

Recently, methods have been proposed that perform texture synthesis and style transfer by using convolutional neural networks (e.g. Gatys et al. [2015,2016]). These methods are exciting because they can in some cases create results with…

Graphics · Computer Science 2017-02-09 Eric Risser , Pierre Wilmot , Connelly Barnes

Image style transfer models based on convolutional neural networks usually suffer from high temporal inconsistency when applied to videos. Some video style transfer models have been proposed to improve temporal consistency, yet they fail to…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Chang Gao , Derun Gu , Fangjun Zhang , Yizhou Yu

When applied sequentially to video, frame-based networks often exhibit temporal inconsistency - for example, outputs that flicker between frames. This problem is amplified when the network inputs contain time-varying corruptions. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Matthew Dutson , Nathan Labiosa , Yin Li , Mohit Gupta

Photorealistic style transfer aims to transfer the artistic style of an image onto an input image or video while keeping photorealism. In this paper, we think it's the summary statistics matching scheme in existing algorithms that leads to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Xiaowen Qiu , Ruize Xu , Boan He , Yingtao Zhang , Wenqiang Zhang , Weifeng Ge

Video color style transfer aims to transform the color style of an original video by using a reference style image. Most existing methods employ neural networks, which come with challenges like opaque transfer processes and limited user…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Xintao Jiang , Yaosen Chen , Siqin Zhang , Wei Wang , Xuming Wen

Style transfer is a problem of rendering a content image in the style of another style image. A natural and common practical task in applications of style transfer is to adjust the strength of stylization. Algorithm of Gatys et al. (2016)…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Victor Kitov

A popular series of style transfer methods apply a style to a content image by controlling mean and covariance of values in early layers of a feature stack. This is insufficient for transferring styles that have strong structure across…

Computer Vision and Pattern Recognition · Computer Science 2018-01-09 Mao-Chuang Yeh , Shuai Tang

Style transfer aims to combine the content of one image with the artistic style of another. It was discovered that lower levels of convolutional networks captured style information, while higher levels captures content information. The…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Michael Maring , Kaustav Chakraborty

We address the problem of style transfer between two photos and propose a new way to preserve photorealism. Using the single pair of photos available as input, we train a pair of deep convolution networks (convnets), each of which transfers…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Xu Yao , Gilles Puy , Patrick Pérez

Neural style transfer is a powerful computer vision technique that can incorporate the artistic "style" of one image to the "content" of another. The underlying theory behind the approach relies on the assumption that the style of an image…

Machine Learning · Computer Science 2022-09-26 Yousef El-Laham , Svitlana Vyetrenko

An assumption widely used in recent neural style transfer methods is that image styles can be described by global statics of deep features like Gram or covariance matrices. Alternative approaches have represented styles by decomposing them…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Yulun Zhang , Chen Fang , Yilin Wang , Zhaowen Wang , Zhe Lin , Yun Fu , Jimei Yang

Neural Style Transfer has recently demonstrated very exciting results which catches eyes in both academia and industry. Despite the amazing results, the principle of neural style transfer, especially why the Gram matrices could represent…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Yanghao Li , Naiyan Wang , Jiaying Liu , Xiaodi Hou

Image style transfer aims to manipulate the appearance of a source image, or "content" image, to share similar texture and colors of a target "style" image. Ideally, the style transfer manipulation should also preserve the semantic content…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Mahmoud Afifi , Abdullah Abuolaim , Mostafa Hussien , Marcus A. Brubaker , Michael S. Brown

Video style transfer techniques inspire many exciting applications on mobile devices. However, their efficiency and stability are still far from satisfactory. To boost the transfer stability across frames, optical flow is widely adopted,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Xinghao Chen , Yiman Zhang , Yunhe Wang , Han Shu , Chunjing Xu , Chang Xu

Recurrent models are a popular choice for video enhancement tasks such as video denoising or super-resolution. In this work, we focus on their stability as dynamical systems and show that they tend to fail catastrophically at inference time…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Thomas Tanay , Aivar Sootla , Matteo Maggioni , Puneet K. Dokania , Philip Torr , Ales Leonardis , Gregory Slabaugh

Arbitrary style transfer is an important problem in computer vision that aims to transfer style patterns from an arbitrary style image to a given content image. However, current methods either rely on slow iterative optimization or fast…

Computer Vision and Pattern Recognition · Computer Science 2020-12-25 Suryabhan Singh Hada , Miguel Á. Carreira-Perpiñán

Neural style transfer draws researchers' attention, but the interest focuses on bitmap images. Various models have been developed for bitmap image generation both online and offline with arbitrary and pre-trained styles. However, the style…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Valeria Efimova , Artyom Chebykin , Ivan Jarsky , Evgenii Prosvirnin , Andrey Filchenkov
‹ Prev 1 2 3 10 Next ›