English
Related papers

Related papers: Audio style transfer

200 papers

Transfer learning is a crucial concept within deep learning that allows artificial neural networks to benefit from a large pre-training data basis when confronted with a task of limited data. Despite its ubiquitous use and clear benefits,…

Machine Learning · Computer Science 2026-05-20 Manuel Milling , Andreas Triantafyllopoulos , Alexander Gebhard , Simon Rampp , Björn W. Schuller

Neural Style Transfer (NST) is the field of study applying neural techniques to modify the artistic appearance of a content image to match the style of a reference style image. Traditionally, NST methods have focused on texture-based image…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Dan Ruta , Gemma Canet Tarrés , Andrew Gilbert , Eli Shechtman , Nicholas Kolkin , John Collomosse

We study transfer learning in convolutional network architectures applied to the task of recognizing audio, such as environmental sound events and speech commands. Our key finding is that not only is it possible to transfer representations…

Sound · Computer Science 2017-10-24 Brian McMahan , Delip Rao

Text style transfer is an important task in natural language generation, which aims to control certain attributes in the generated text, such as politeness, emotion, humor, and many others. It has a long history in the field of natural…

Computation and Language · Computer Science 2021-12-20 Di Jin , Zhijing Jin , Zhiting Hu , Olga Vechtomova , Rada Mihalcea

While many recent any-to-any voice conversion models succeed in transferring some target speech's style information to the converted speech, they still lack the ability to faithfully reproduce the speaking style of the target speaker. In…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-18 Hyungseob Lim , Kyungguen Byun , Sunkuk Moon , Erik Visser

We present a novel algorithm for transferring artistic styles of semantically meaningful local regions of an image onto local regions of a target video while preserving its photorealism. Local regions may be selected either fully…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Xide Xia , Tianfan Xue , Wei-sheng Lai , Zheng Sun , Abby Chang , Brian Kulis , Jiawen Chen

Recent text-to-image diffusion models generate high-quality images but struggle to learn new, personalized styles, which limits the creation of unique style templates. In style-driven generation, users typically supply reference images…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Jooyoung Choi , Chaehun Shin , Yeongtak Oh , Heeseung Kim , Jungbeom Lee , Sungroh Yoon

Negative transfer in training of acoustic models for automatic speech recognition has been reported in several contexts such as domain change or speaker characteristics. This paper proposes a novel technique to overcome negative transfer by…

Machine Learning · Computer Science 2015-09-18 Mortaza Doulaty , Oscar Saz , Thomas Hain

Deep generative models are now able to synthesize high-quality audio signals, shifting the critical aspect in their development from audio quality to control capabilities. Although text-to-music generation is getting largely adopted by the…

Sound · Computer Science 2024-08-02 Nils Demerlé , Philippe Esling , Guillaume Doras , David Genova

Style transfer is an important problem in natural language processing (NLP). However, the progress in language style transfer is lagged behind other domains, such as computer vision, mainly because of the lack of parallel data and principle…

Computation and Language · Computer Science 2017-11-28 Zhenxin Fu , Xiaoye Tan , Nanyun Peng , Dongyan Zhao , Rui Yan

The works of Gatys et al. demonstrated the capability of Convolutional Neural Networks (CNNs) in creating artistic style images. This process of transferring content images in different styles is called Neural Style Transfer (NST). In this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Xiangtian Li , Han Cao , Zhaoyang Zhang , Jiacheng Hu , Yuhui Jin , Zihao Zhao

Attribute-controlled text rewriting, also known as text style-transfer, has a crucial role in regulating attributes and biases of textual training data and a machine generated text. In this work we present SimpleStyle, a minimalist yet…

Computation and Language · Computer Science 2022-12-23 Elron Bandel , Yoav Katz , Noam Slonim , Liat Ein-Dor

Transferring artistic styles onto everyday photographs has become an extremely popular task in both academia and industry. Recently, offline training has replaced on-line iterative optimization, enabling nearly real-time stylization. When…

Computer Vision and Pattern Recognition · Computer Science 2017-12-01 Xin Wang , Geoffrey Oxholm , Da Zhang , Yuan-Fang Wang

We introduce a new audio processing technique that increases the sampling rate of signals such as speech or music using deep convolutional neural networks. Our model is trained on pairs of low and high-quality audio examples; at test-time,…

Sound · Computer Science 2017-08-03 Volodymyr Kuleshov , S. Zayd Enam , Stefano Ermon

These days deep learning is the fastest-growing area in the field of Machine Learning. Convolutional Neural Networks are currently the main tool used for image analysis and classification purposes. Although great achievements and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Agnieszka Mikołajczyk , Michał Grochowski

This paper presents an automatic image synthesis method to transfer the style of an example image to a content image. When standard neural style transfer approaches are used, the textures and colours in different semantic regions of the…

Computer Vision and Pattern Recognition · Computer Science 2017-09-01 Huihuang Zhao , Paul L. Rosin , Yu-Kun Lai

Style transfer aims to combine the content of one image with the artistic style of another. It was discovered that lower levels of convolutional networks captured style information, while higher levels captures content information. The…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Michael Maring , Kaustav Chakraborty

Text style transfer involves rewriting the content of a source sentence in a target style. Despite there being a number of style tasks with available data, there has been limited systematic discussion of how text style datasets relate to…

Computation and Language · Computer Science 2021-08-19 Stephanie Schoch , Wanyu Du , Yangfeng Ji

We study the merit of transfer learning for two sound recognition problems, i.e., audio tagging and sound event detection. Employing feature fusion, we adapt a baseline system utilizing only spectral acoustic inputs to also make use of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-27 Wim Boes , Hugo Van hamme

Artistic style transfer is the problem of synthesizing an image with content similar to a given image and style similar to another. Although recent feed-forward neural networks can generate stylized images in real-time, these models produce…

Computer Vision and Pattern Recognition · Computer Science 2018-11-22 Mohammad Babaeizadeh , Golnaz Ghiasi