English
Related papers

Related papers: Self-Supervised VQ-VAE for One-Shot Music Style Tr…

200 papers

Deep learning researches on the transformation problems for image and text have raised great attention. However, present methods for music feature transfer using neural networks are far from practical application. In this paper, we initiate…

Sound · Computer Science 2021-08-05 Xutan Peng , Chen Li , Zhi Cai , Faqiang Shi , Yidan Liu , Jianxin Li

Manually re-drawing an image in a certain artistic style takes a professional artist a long time. Doing this for a video sequence single-handedly is beyond imagination. We present two computational approaches that transfer the style from…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Manuel Ruder , Alexey Dosovitskiy , Thomas Brox

We contribute an unsupervised method that effectively learns disentangled content and style representations from sequences of observations. Unlike most disentanglement algorithms that rely on domain-specific labels or knowledge, our method…

Machine Learning · Computer Science 2025-03-18 Yuxuan Wu , Ziyu Wang , Bhiksha Raj , Gus Xia

Timbre transfer aims to modify the timbral identity of a musical recording while preserving the original melody and rhythm. While single-instrument timbre transfer has made substantial progress, existing approaches to multi-instrument…

Sound · Computer Science 2026-05-12 Leduo Chen , Junchuan Zhao , Shengchen Li

We propose an end-to-end music mixing style transfer system that converts the mixing style of an input multitrack to that of a reference song. This is achieved with an encoder pre-trained with a contrastive objective to extract only audio…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-12 Junghyun Koo , Marco A. Martínez-Ramírez , Wei-Hsiang Liao , Stefan Uhlich , Kyogu Lee , Yuki Mitsufuji

We study the problem of cross-lingual voice conversion in non-parallel speech corpora and one-shot learning setting. Most prior work require either parallel speech corpora or enough amount of training data from a target speaker. However, we…

Sound · Computer Science 2018-08-17 Seyed Hamidreza Mohammadi , Taehwan Kim

We propose a model to estimate the fundamental frequency in monophonic audio, often referred to as pitch estimation. We acknowledge the fact that obtaining ground truth annotations at the required temporal and frequency resolution is a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-07 Beat Gfeller , Christian Frank , Dominik Roblek , Matt Sharifi , Marco Tagliasacchi , Mihajlo Velimirović

We present a framework that can impose the audio effects and production style from one recording to another by example with the goal of simplifying the audio production process. We train a deep neural network to analyze an input recording…

Sound · Computer Science 2022-07-19 Christian J. Steinmetz , Nicholas J. Bryan , Joshua D. Reiss

In this position paper, we frame the field of Visual Musicology by providing an overview of well-established musicological sub-domains and their corresponding analytic and visualization tasks. To foster collaborative, interdisciplinary…

Human-Computer Interaction · Computer Science 2019-08-29 Matthias Miller , Hanna Schäfer , Matthias Kraus , Marc Leman , Daniel Keim , Mennatallah El-Assady

Variational Autoencoders(VAEs) have already achieved great results on image generation and recently made promising progress on music generation. However, the generation process is still quite difficult to control in the sense that the…

Sound · Computer Science 2019-04-19 Ruihan Yang , Tianyao Chen , Yiyi Zhang , Gus Xia

The research in Deep Learning applications in sound and music computing have gathered an interest in the recent years; however, there is still a missing link between these new technologies and on how they can be incorporated into real-world…

Sound · Computer Science 2023-06-21 Kıvanç Tatar , Kelsey Cotton , Daniel Bisig

Traditional studies on voice conversion (VC) have made progress with parallel training data and known speakers. Good voice conversion quality is obtained by exploring better alignment modules or expressive mapping functions. In this study,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-01 Jiachen Lian , Chunlei Zhang , Dong Yu

Deep generative models such as Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) have recently been applied to style and domain transfer for images, and in the case of VAEs, music. GAN-based models employing several…

Sound · Computer Science 2018-09-21 Gino Brunner , Yuyi Wang , Roger Wattenhofer , Sumu Zhao

While unsupervised variational autoencoders (VAE) have become a powerful tool in neuroimage analysis, their application to supervised learning is under-explored. We aim to close this gap by proposing a unified probabilistic model for…

Machine Learning · Computer Science 2019-07-15 Qingyu Zhao , Ehsan Adeli , Nicolas Honnorat , Tuo Leng , Kilian M. Pohl

We aim at the problem named One-Shot Unsupervised Domain Adaptation. Unlike traditional Unsupervised Domain Adaptation, it assumes that only one unlabeled target sample can be available when learning to adapt. This setting is realistic but…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Yawei Luo , Ping Liu , Tao Guan , Junqing Yu , Yi Yang

Vector-Quantized Variational Autoencoders (VQ-VAE)[1] provide an unsupervised model for learning discrete representations by combining vector quantization and autoencoders. In this paper, we study the use of VQ-VAE for representation…

Image and Video Processing · Electrical Eng. & Systems 2019-03-05 Hanwei Wu , Markus Flierl

Transferring the style from one image onto another is a popular and widely studied task in computer vision. Yet, style transfer in the 3D setting remains a largely unexplored problem. To our knowledge, we propose the first learning-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Mattia Segu , Margarita Grinvald , Roland Siegwart , Federico Tombari

Language style transferring rephrases text with specific stylistic attributes while preserving the original attribute-independent content. One main challenge in learning a style transfer system is a lack of parallel data where the source…

Computation and Language · Computer Science 2018-08-27 Zhirui Zhang , Shuo Ren , Shujie Liu , Jianyong Wang , Peng Chen , Mu Li , Ming Zhou , Enhong Chen

Despite the progress made in the style transfer task, most previous work focus on transferring only relatively simple features like color or texture, while missing more abstract concepts such as overall art expression or painter-specific…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Zipeng Xu , Enver Sangineto , Nicu Sebe

Deep learning, even if it is very successful nowadays, traditionally needs very large amounts of labeled data to perform excellent on the classification task. In an attempt to solve this problem, the one-shot learning paradigm, which makes…

Computer Vision and Pattern Recognition · Computer Science 2018-04-23 Decebal Constantin Mocanu , Elena Mocanu