English
Related papers

Related papers: Characterizing and Improving Stability in Neural S…

200 papers

Neural Style Transfer (NST) is the field of study applying neural techniques to modify the artistic appearance of a content image to match the style of a reference style image. Traditionally, NST methods have focused on texture-based image…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Dan Ruta , Gemma Canet Tarrés , Andrew Gilbert , Eli Shechtman , Nicholas Kolkin , John Collomosse

This note presents an extension to the neural artistic style transfer algorithm (Gatys et al.). The original algorithm transforms an image to have the style of another given image. For example, a photograph can be transformed to have the…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Leon A. Gatys , Matthias Bethge , Aaron Hertzmann , Eli Shechtman

Style transfer aims to transfer arbitrary visual styles to content images. We explore algorithms adapted from two papers that try to solve the problem of style transfer while generalizing on unseen styles or compromised visual quality.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Somshubra Majumdar , Amlaan Bhoi , Ganesh Jagadeesan

Video stabilization technique is essential for most hand-held captured videos due to high-frequency shakes. Several 2D-, 2.5D- and 3D-based stabilization techniques are well studied, but to our knowledge, no solutions based on deep neural…

Graphics · Computer Science 2018-02-23 Miao Wang , Guo-Ye Yang , Jin-Kun Lin , Ariel Shamir , Song-Hai Zhang , Shao-Ping Lu , Shi-Min Hu

With the development of the convolutional neural network, image style transfer has drawn increasing attention. However, most existing approaches adopt a global feature transformation to transfer style patterns into content images (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Jianbo Wang , Huan Yang , Jianlong Fu , Toshihiko Yamasaki , Baining Guo

Temporally consistent dense video annotations are scarce and hard to collect. In contrast, image segmentation datasets (and pre-trained models) are ubiquitous, and easier to label for any novel task. In this paper, we introduce a method to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Aharon Azulay , Tavi Halperin , Orestis Vantzos , Nadav Borenstein , Ofir Bibi

State-of-the-art parametric and non-parametric style transfer approaches are prone to either distorted local style patterns due to global statistics alignment, or unpleasing artifacts resulting from patch mismatching. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Yongcheng Jing , Yining Mao , Yiding Yang , Yibing Zhan , Mingli Song , Xinchao Wang , Dacheng Tao

Stability of recurrent models is closely linked with trainability, generalizability and in some applications, safety. Methods that train stable recurrent neural networks, however, do so at a significant cost to expressibility. We propose an…

Machine Learning · Computer Science 2019-12-24 Max Revay , Ian R. Manchester

Artistic style transfer is an image synthesis problem where the content of an image is reproduced with the style of another. Recent works show that a visually appealing style transfer can be achieved by using the hidden activations of a…

Computer Vision and Pattern Recognition · Computer Science 2016-12-14 Tian Qi Chen , Mark Schmidt

Style transfer is a technique for combining two images based on the activations and feature statistics in a deep learning neural network architecture. This paper studies the analogous task in the audio domain and takes a critical look at…

Sound · Computer Science 2020-08-10 M. Huzaifah , L. Wyse

Style transfer is a problem of rendering image with some content in the style of another image, for example a family photo in the style of a painting of some famous artist. The drawback of classical style transfer algorithm is that it…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Alexey Schekalev , Victor Kitov

The inverse problem of backward diffusion is known to be ill-posed and highly unstable. Backward diffusion processes appear naturally in image enhancement and deblurring applications. It is therefore greatly desirable to establish a…

Numerical Analysis · Mathematics 2020-06-18 Leif Bergerhoff , Marcelo Cárdenas , Joachim Weickert , Martin Welk

The solution of linear inverse problems arising, for example, in signal and image processing is a challenging problem since the ill-conditioning amplifies, in the solution, the noise present in the data. Recently introduced algorithms based…

Numerical Analysis · Mathematics 2024-02-08 Davide Evangelista , James Nagy , Elena Morotti , Elena Loli Piccolomini

Using image models naively for solving inverse video problems often suffers from flickering, texture-sticking, and temporal inconsistency in generated videos. To tackle these problems, in this paper, we view frames as continuous functions…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Giannis Daras , Weili Nie , Karsten Kreis , Alex Dimakis , Morteza Mardani , Nikola Borislavov Kovachki , Arash Vahdat

Video style transfer aims to alter the style of a video while preserving its content. Previous methods often struggle with content leakage and style misalignment, particularly when using image-driven approaches that aim to transfer precise…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jiang Lin , Zili Yi

Image style transfer is a challenging task in computational vision. Existing algorithms transfer the color and texture of style images by controlling the neural network's feature layers. However, they fail to control the strength of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Junjie Kang , Jinsong Wu , Shiqi Jiang

The works of Gatys et al. demonstrated the capability of Convolutional Neural Networks (CNNs) in creating artistic style images. This process of transferring content images in different styles is called Neural Style Transfer (NST). In this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Xiangtian Li , Han Cao , Zhaoyang Zhang , Jiacheng Hu , Yuhui Jin , Zihao Zhao

Arbitrary style transfer holds widespread attention in research and boasts numerous practical applications. The existing methods, which either employ cross-attention to incorporate deep style attributes into content attributes or use…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Zhanjie Zhang , Jiakai Sun , Guangyuan Li , Lei Zhao , Quanwei Zhang , Zehua Lan , Haolin Yin , Wei Xing , Huaizhong Lin , Zhiwen Zuo

In recent years, arbitrary image style transfer has attracted more and more attention. Given a pair of content and style images, a stylized one is hoped that retains the content from the former while catching style patterns from the latter.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Chiyu Zhang , Jun Yang , Zaiyan Dai , Peng Cao

Style control has been popular in video generation models. Existing methods often generate videos far from the given style, cause content leakage, and struggle to transfer one video to the desired style. Our first observation is that the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Zixuan Ye , Huijuan Huang , Xintao Wang , Pengfei Wan , Di Zhang , Wenhan Luo