English
Related papers

Related papers: Neural Style Transfer for Audio Spectograms

200 papers

Designing fonts requires a great deal of time and effort. It requires professional skills, such as sketching, vectorizing, and image editing. Additionally, each letter has to be designed individually. In this paper, we will introduce a…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Gantugs Atarsaikhan , Brian Kenji Iwana , Seiichi Uchida

We explore the method of style transfer presented in the article "A Neural Algorithm of Artistic Style" by Leon A. Gatys, Alexander S. Ecker and Matthias Bethge (arXiv:1508.06576). We first demonstrate the power of the suggested style space…

Computer Vision and Pattern Recognition · Computer Science 2016-03-15 Yaroslav Nikulin , Roman Novak

Deep generative models are now able to synthesize high-quality audio signals, shifting the critical aspect in their development from audio quality to control capabilities. Although text-to-music generation is getting largely adopted by the…

Sound · Computer Science 2024-08-02 Nils Demerlé , Philippe Esling , Guillaume Doras , David Genova

Manually re-drawing an image in a certain artistic style takes a professional artist a long time. Doing this for a video sequence single-handedly is beyond imagination. We present two computational approaches that transfer the style from…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Manuel Ruder , Alexey Dosovitskiy , Thomas Brox

Style transfer aims to transfer arbitrary visual styles to content images. We explore algorithms adapted from two papers that try to solve the problem of style transfer while generalizing on unseen styles or compromised visual quality.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Somshubra Majumdar , Amlaan Bhoi , Ganesh Jagadeesan

The well-known technique outlined in the paper of Leon A. Gatys et al., A Neural Algorithm of Artistic Style, has become a trending topic both in academic literature and industrial applications. Neural Style Transfer (NST) constitutes an…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Maria Karatzoglidi , Georgios Felekis , Eleni Charou

This paper creates a novel method of deep neural style transfer by generating style images from freeform user text input. The language model and style transfer model form a seamless pipeline that can create output images with similar losses…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Tejas Santanam , Mengyang Liu , Jiangyue Yu , Zhaodong Yang

Art is a variety of human activities that include the production of visual, auditory, or performing objects that express the creativity, creative concepts, or technological abilities of the artist, intended primarily for their beauty or…

Computers and Society · Computer Science 2021-05-17 Amogh G. Warkhandkar , Omkar B. Bhambure

In this paper, we propose a model to perform style transfer of speech to singing voice. Contrary to the previous signal processing-based methods, which require high-quality singing templates or phoneme synchronization, we explore a…

Sound · Computer Science 2022-08-29 Shrutina Agarwal , Sriram Ganapathy , Naoya Takahashi

Neural Style Transfer has shown very exciting results enabling new forms of image manipulation. Here we extend the existing method to introduce control over spatial location, colour information and across spatial scale. We demonstrate how…

Computer Vision and Pattern Recognition · Computer Science 2017-05-12 Leon A. Gatys , Alexander S. Ecker , Matthias Bethge , Aaron Hertzmann , Eli Shechtman

A neural artistic style transformation (NST) model can modify the appearance of a simple image by adding the style of a famous image. Even though the transformed images do not look precisely like artworks by the same artist of the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 P. N. Deelaka

This paper introduces a novel method by reshuffling deep features (i.e., permuting the spacial locations of a feature map) of the style image for arbitrary style transfer. We theoretically prove that our new style loss based on reshuffle…

Computer Vision and Pattern Recognition · Computer Science 2018-06-21 Shuyang Gu , Congliang Chen , Jing Liao , Lu Yuan

We introduce a new audio processing technique that increases the sampling rate of signals such as speech or music using deep convolutional neural networks. Our model is trained on pairs of low and high-quality audio examples; at test-time,…

Sound · Computer Science 2017-08-03 Volodymyr Kuleshov , S. Zayd Enam , Stefano Ermon

Audio-driven talking head animation is a challenging research topic with many real-world applications. Recent works have focused on creating photo-realistic 2D animation, while learning different talking or singing styles remains an open…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Trong-Thang Pham , Nhat Le , Tuong Do , Hung Nguyen , Erman Tjiputra , Quang D. Tran , Anh Nguyen

Style transfer is the task of rephrasing the text to contain specific stylistic properties without changing the intent or affect within the context. This paper introduces a new method for automatic style transfer. We first learn a latent…

Computation and Language · Computer Science 2018-05-25 Shrimai Prabhumoye , Yulia Tsvetkov , Ruslan Salakhutdinov , Alan W Black

Spectrograms are 2D representations of sound that look very different from the images found in our visual world. And natural images, when played as spectrograms, make unnatural sounds. In this paper, we show that it is possible to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Ziyang Chen , Daniel Geng , Andrew Owens

Neural style transfer is a powerful computer vision technique that can incorporate the artistic "style" of one image to the "content" of another. The underlying theory behind the approach relies on the assumption that the style of an image…

Machine Learning · Computer Science 2022-09-26 Yousef El-Laham , Svitlana Vyetrenko

Audio production style transfer is the task of processing an input to impart stylistic elements from a reference recording. Existing approaches often train a neural network to estimate control parameters for a set of audio effects. However,…

Transfer learning is critical for efficient information transfer across multiple related learning problems. A simple, yet effective transfer learning approach utilizes deep neural networks trained on a large-scale task for feature…

Sound · Computer Science 2021-06-23 Anurag Kumar , Yun Wang , Vamsi Krishna Ithapu , Christian Fuegen

Music sentiment transfer is a completely novel task. Sentiment transfer is a natural evolution of the heavily-studied style transfer task, as sentiment transfer is rooted in applying the sentiment of a source to be the new sentiment for a…

Sound · Computer Science 2021-10-13 Miles Sigel , Michael Zhou , Jiebo Luo