English
Related papers

Related papers: Neural Style Transfer for Audio Spectograms

200 papers

On a constant quest for inspiration, designers can become more effective with tools that facilitate their creative process and let them overcome design fixation. This paper explores the practicality of applying neural style transfer as an…

Computers and Society · Computer Science 2018-05-29 Chaehan So

This paper proposes a new method to interpolate between two audio signals. As an interpolation parameter is changed, the pitches in one signal slide to the pitches in the other, producing a portamento, or musical glide. The assignment of…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-18 Trevor Henderson , Justin Solomon

Inspired by recent work on neural network image generation which rely on backpropagation towards the network inputs, we present a proof-of-concept system for speech texture synthesis and voice conversion based on two mechanisms: approximate…

Sound · Computer Science 2018-03-09 Jan Chorowski , Ron J. Weiss , Rif A. Saurous , Samy Bengio

Style transfer is the task of reproducing the semantic contents of a source image in the artistic style of a second target image. In this paper, we present NeAT, a new state-of-the art feed-forward style transfer method. We re-formulate…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Dan Ruta , Andrew Gilbert , John Collomosse , Eli Shechtman , Nicholas Kolkin

We present an end-to-end method for transforming audio from one style to another. For the case of speech, by conditioning on speaker identities, we can train a single model to transform words spoken by multiple people into multiple target…

Sound · Computer Science 2018-06-08 Albert Haque , Michelle Guo , Prateek Verma

Convolutional Neural Networks have been highly successful in performing a host of computer vision tasks such as object recognition, object detection, image segmentation and texture synthesis. In 2015, Gatys et. al [7] show how the style of…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Prutha Date , Ashwinkumar Ganesan , Tim Oates

Universal style transfer tries to explicitly minimize the losses in feature space, thus it does not require training on any pre-defined styles. It usually uses different layers of VGG network as the encoders and trains several decoders to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-15 Ming Lu , Hao Zhao , Anbang Yao , Yurong Chen , Feng Xu , Li Zhang

End-to-end neural TTS training has shown improved performance in speech style transfer. However, the improvement is still limited by the training data in both target styles and speakers. Inadequate style transfer performance occurs when the…

Sound · Computer Science 2021-06-21 Xiaochun An , Frank K. Soong , Lei Xie

Universal Neural Style Transfer (NST) methods are capable of performing style transfer of arbitrary styles in a style-agnostic manner via feature transforms in (almost) real-time. Even though their unimodal parametric style modeling…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Paraskevas Pegios , Nikolaos Passalis , Anastasios Tefas

Sound modelling is the process of developing algorithms that generate sound under parametric control. There are a few distinct approaches that have been developed historically including modelling the physics of sound production and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-26 M. Huzaifah , L. Wyse

Music style transfer blends source structure with reference style to enable personalized music creation. However, existing zero-shot methods often struggle to capture fine-grained audio nuances, relying on coarse text descriptions or…

Sound · Computer Science 2026-05-14 Heehwan Wang , Joonwoo Kwon , Sooyoung Kim , Jungwoo Seo , Shinjae Yoo , Yuewei Lin , Jiook Cha

Language style transferring rephrases text with specific stylistic attributes while preserving the original attribute-independent content. One main challenge in learning a style transfer system is a lack of parallel data where the source…

Computation and Language · Computer Science 2018-08-27 Zhirui Zhang , Shuo Ren , Shujie Liu , Jianyong Wang , Peng Chen , Mu Li , Ming Zhou , Enhong Chen

Transfer learning is a crucial concept within deep learning that allows artificial neural networks to benefit from a large pre-training data basis when confronted with a task of limited data. Despite its ubiquitous use and clear benefits,…

Machine Learning · Computer Science 2026-05-20 Manuel Milling , Andreas Triantafyllopoulos , Alexander Gebhard , Simon Rampp , Björn W. Schuller

Making decorated logos requires image editing skills, without sufficient skills, it could be a time-consuming task. While there are many on-line web services to make new logos, they have limited designs and duplicates can be made. We…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Gantugs Atarsaikhan , Brian Kenji Iwana , Seiichi Uchida

Arbitrary style transfer is an important problem in computer vision that aims to transfer style patterns from an arbitrary style image to a given content image. However, current methods either rely on slow iterative optimization or fast…

Computer Vision and Pattern Recognition · Computer Science 2020-12-25 Suryabhan Singh Hada , Miguel Á. Carreira-Perpiñán

Timbre transfer techniques aim at converting the sound of a musical piece generated by one instrument into the same one as if it was played by another instrument, while maintaining as much as possible the content in terms of musical…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-31 Luca Comanducci , Fabio Antonacci , Augusto Sarti

We propose a new technique for visual attribute transfer across images that may have very different appearance but have perceptually similar semantic structure. By visual attribute transfer, we mean transfer of visual information (such as…

Computer Vision and Pattern Recognition · Computer Science 2017-06-07 Jing Liao , Yuan Yao , Lu Yuan , Gang Hua , Sing Bing Kang

Audio domain transfer is the process of modifying audio signals to match characteristics of a different domain, while retaining the original content. This paper investigates the potential of Gaussian Flow Bridges, an emerging approach in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-31 Eloi Moliner , Sebastian Braun , Hannes Gamper

Recent feed-forward neural methods of arbitrary image style transfer mainly utilized encoded feature map upto its second-order statistics, i.e., linearly transformed the encoded feature map of a content image to have the same mean and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Jeong-Sik Lee , Hyun-Chul Choi

How can we edit or transform the geometric or color property of a point cloud? In this study, we propose a neural style transfer method for point clouds which allows us to transfer the style of geometry or color from one point cloud either…

Computer Vision and Pattern Recognition · Computer Science 2019-03-15 Xu Cao , Weimin Wang , Katashi Nagao