English
Related papers

Related papers: A Style Transfer Approach to Source Separation

200 papers

Though convolutional neural networks (CNNs) have demonstrated remarkable ability in learning discriminative features, they often generalize poorly to unseen domains. Domain generalization aims to address this problem by learning from a set…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Kaiyang Zhou , Yongxin Yang , Yu Qiao , Tao Xiang

Artistic style transfer is the problem of synthesizing an image with content similar to a given image and style similar to another. Although recent feed-forward neural networks can generate stylized images in real-time, these models produce…

Computer Vision and Pattern Recognition · Computer Science 2018-11-22 Mohammad Babaeizadeh , Golnaz Ghiasi

In this work, we tackle the challenging problem of arbitrary image style transfer using a novel style feature representation learning method. A suitable style representation, as a key component in image stylization tasks, is essential to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Yuxin Zhang , Fan Tang , Weiming Dong , Haibin Huang , Chongyang Ma , Tong-Yee Lee , Changsheng Xu

Music source separation has been a popular topic in signal processing for decades, not only because of its technical difficulty, but also due to its importance to many commercial applications, such as automatic karoake and remixing. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-23 Yuzhou Liu , Balaji Thoshkahna , Ali Milani , Trausti Kristjansson

I developed a neural audio codec model based on the residual quantized variational autoencoder architecture. I train the model on the Slakh2100 dataset, a standard dataset for musical source separation, composed of multi-track audio. The…

Sound · Computer Science 2024-08-14 Leonardo Berti

Arbitrary style transfer is a significant topic with research value and application prospect. A desired style transfer, given a content image and referenced style painting, would render the content image with the color tone and vivid stroke…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Yingying Deng , Fan Tang , Weiming Dong , Wen Sun , Feiyue Huang , Changsheng Xu

Traditional source separation approaches train deep neural network models end-to-end with all the data available at once by minimizing the empirical risk on the whole training set. On the inference side, after training the model, the user…

Arbitrary Style Transfer is a technique used to produce a new image from two images: a content image, and a style image. The newly produced image is unseen and is generated from the algorithm itself. Balancing the structure and style…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Weiting Li , Rahul Vyas , Ramya Sree Penta

Weak-strong consistency learning strategies are widely employed in semi-supervised medical image segmentation to train models by leveraging limited labeled data and enforcing weak-to-strong consistency. However, existing methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Chaowei Chen , Xiang Zhang , Honglie Guo , Shunfang Wang

Standard supervised machine learning assumes that the distribution of the source samples used to train an algorithm is the same as the one of the target samples on which it is supposed to make predictions. However, as any data scientist…

Machine Learning · Computer Science 2020-02-12 Pirmin Lemberger , Ivan Panico

Deep learning models dealing with image understanding in real-world settings must be able to adapt to a wide variety of tasks across different domains. Domain adaptation and class incremental learning deal with domain and task variability…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Marco Toldo , Umberto Michieli , Pietro Zanuttigh

With the recent advancements of data driven approaches using deep neural networks, music source separation has been formulated as an instrument-specific supervised problem. While existing deep learning models implicitly absorb the spatial…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-16 Darius Petermann , Minje Kim

We address the problem of acoustic source separation in a deep learning framework we call "deep clustering." Rather than directly estimating signals or masking functions, we train a deep network to produce spectrogram embeddings that are…

Neural and Evolutionary Computing · Computer Science 2015-08-19 John R. Hershey , Zhuo Chen , Jonathan Le Roux , Shinji Watanabe

Controllable generative sequence models with the capability to extract and replicate the style of specific examples enable many applications, including narrating audiobooks in different voices, auto-completing and auto-correcting written…

Machine Learning · Computer Science 2022-07-04 Jen-Hao Rick Chang , Ashish Shrivastava , Hema Swetha Koppula , Xiaoshuai Zhang , Oncel Tuzel

Transfer learning has emerged as a powerful methodology for adapting pre-trained deep neural networks on image recognition tasks to new domains. This process consists of taking a neural network pre-trained on a large feature-rich source…

Machine Learning · Computer Science 2021-04-27 Francisco Utrera , Evan Kravitz , N. Benjamin Erichson , Rajiv Khanna , Michael W. Mahoney

Sequence-to-sequence learning with neural networks has become the de facto standard for sequence prediction tasks. This approach typically models the local distribution over the next word with a powerful neural network that can condition on…

Computation and Language · Computer Science 2021-11-17 Yoon Kim

The idea of style transfer has largely only been explored in image-based tasks, which we attribute in part to the specific nature of loss functions used for style transfer. We propose a general formulation of style transfer as an extension…

Machine Learning · Computer Science 2017-05-09 Muthuraman Chidambaram , Yanjun Qi

Modern NLP defines the task of style transfer as modifying the style of a given sentence without appreciably changing its semantics, which implies that the outputs of style transfer systems should be paraphrases of their inputs. However,…

Computation and Language · Computer Science 2020-10-13 Kalpesh Krishna , John Wieting , Mohit Iyyer

Transferring the style from one image onto another is a popular and widely studied task in computer vision. Yet, style transfer in the 3D setting remains a largely unexplored problem. To our knowledge, we propose the first learning-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Mattia Segu , Margarita Grinvald , Roland Siegwart , Federico Tombari

An increasing number of people in the world today speak a mixed-language as a result of being multilingual. However, building a speech recognition system for code-switching remains difficult due to the availability of limited resources and…

Computation and Language · Computer Science 2020-04-30 Genta Indra Winata , Samuel Cahyawijaya , Zhaojiang Lin , Zihan Liu , Peng Xu , Pascale Fung