English
Related papers

Related papers: Audio style transfer

200 papers

A crucial aspect for the successful deployment of audio-based models "in-the-wild" is the robustness to the transformations introduced by heterogeneous acquisition conditions. In this work, we propose a method to perform one-shot microphone…

Sound · Computer Science 2020-10-20 Zalán Borsos , Yunpeng Li , Beat Gfeller , Marco Tagliasacchi

Universal style transfer is an image editing task that renders an input content image using the visual style of arbitrary reference images, including both artistic and photorealistic stylization. Given a pair of images as the source of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-09 Jie An , Haoyi Xiong , Jiebo Luo , Jun Huan , Jinwen Ma

We present HyperNST; a neural style transfer (NST) technique for the artistic stylization of images, based on Hyper-networks and the StyleGAN2 architecture. Our contribution is a novel method for inducing style transfer parameterized by a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Dan Ruta , Andrew Gilbert , Saeid Motiian , Baldo Faieta , Zhe Lin , John Collomosse

Style transfer involves transferring the style from a reference image to the content of a target image. Recent advancements in LoRA-based (Low-Rank Adaptation) methods have shown promise in effectively capturing the style of a single image.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Bolin Chen , Baoquan Zhao , Haoran Xie , Yi Cai , Qing Li , Xudong Mao

The problem of audio-to-audio (A2A) style transfer involves replacing the style features of the source audio with those from the target audio while preserving the content related attributes of the source audio. In this paper, we propose an…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-10 Soumya Dutta , Sriram Ganapathy

Recent research has investigated the shape and texture biases of deep neural networks (DNNs) in image classification which influence their generalization capabilities and robustness. It has been shown that, in comparison to regular DNN…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Ben Hamscher , Edgar Heinert , Annika Mütze , Kira Maag , Matthias Rottmann

Artistic style transfer aims to use a style image and a content image to synthesize a target image that retains the same artistic expression as the style image while preserving the basic content of the content image. Many recently proposed…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Kunxiao Liu , Guowu Yuan , Hao Wu , Wenhua Qian

Image style transfer occupies an important place in both computer graphics and computer vision. However, most current methods require reference to stylized images and cannot individually stylize specific objects. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Junhao Chen , Peng Rong , Jingbo Sun , Chao Li , Xiang Li , Hongwu Lv

Numerous recent techniques for text style transfer characterize their approaches as variants of reinforcement learning and preference optimization. In this work, we consider the relationship between these approaches and a class of…

Computation and Language · Computer Science 2024-07-30 Shuai Liu , Jonathan May

Video color style transfer aims to transform the color style of an original video by using a reference style image. Most existing methods employ neural networks, which come with challenges like opaque transfer processes and limited user…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Xintao Jiang , Yaosen Chen , Siqin Zhang , Wei Wang , Xuming Wen

Style transfer is a problem of rendering image with some content in the style of another image, for example a family photo in the style of a painting of some famous artist. The drawback of classical style transfer algorithm is that it…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Alexey Schekalev , Victor Kitov

Style transfer aims to render the content of a given image in the graphical/artistic style of another image. The fundamental concept underlying NeuralStyle Transfer (NST) is to interpret style as a distribution in the feature space of a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-15 Nikolai Kalischek , Jan Dirk Wegner , Konrad Schindler

Training neural networks for source separation involves presenting a mixture recording at the input of the network and updating network parameters in order to produce an output that resembles the clean source. Consequently, supervised…

Sound · Computer Science 2019-05-10 Shrikant Venkataramani , Efthymios Tzinis , Paris Smaragdis

One-shot style transfer is a challenging task, since training on one utterance makes model extremely easy to over-fit to training data and causes low speaker similarity and lack of expressiveness. In this paper, we build on the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-22 Zhichao Wang , Qicong Xie , Tao Li , Hongqiang Du , Lei Xie , Pengcheng Zhu , Mengxiao Bi

Universal style transfer aims to transfer arbitrary visual styles to content images. Existing feed-forward based methods, while enjoying the inference efficiency, are mainly limited by inability of generalizing to unseen styles or…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Yijun Li , Chen Fang , Jimei Yang , Zhaowen Wang , Xin Lu , Ming-Hsuan Yang

Current mainstream audio generation methods primarily rely on simple text prompts, often failing to capture the nuanced details necessary for multi-style audio generation. To address this limitation, the Sound Event Enhanced Prompt Adapter…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-17 Chenxu Xiong , Ruibo Fu , Shuchen Shi , Zhengqi Wen , Jianhua Tao , Tao Wang , Chenxing Li , Chunyu Qiang , Yuankun Xie , Xin Qi , Guanjun Li , Zizheng Yang

The seminal work of Gatys et al. demonstrated the power of Convolutional Neural Networks (CNNs) in creating artistic imagery by separating and recombining image content and style. This process of using CNNs to render a content image in…

Computer Vision and Pattern Recognition · Computer Science 2018-10-31 Yongcheng Jing , Yezhou Yang , Zunlei Feng , Jingwen Ye , Yizhou Yu , Mingli Song

Recently, style transfer has received a lot of attention. While much of this research has aimed at speeding up processing, the approaches are still lacking from a principled, art historical standpoint: a style is more than just a single…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Artsiom Sanakoyeu , Dmytro Kotovenko , Sabine Lang , Björn Ommer

In this work we propose approaches to effectively transfer knowledge from weakly labeled web audio data. We first describe a convolutional neural network (CNN) based framework for sound event detection and classification using weakly…

Sound · Computer Science 2018-09-10 Anurag Kumar , Maksim Khadkevich , Christian Fugen

Universal Neural Style Transfer (NST) methods are capable of performing style transfer of arbitrary styles in a style-agnostic manner via feature transforms in (almost) real-time. Even though their unimodal parametric style modeling…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Paraskevas Pegios , Nikolaos Passalis , Anastasios Tefas