English
Related papers

Related papers: Guitar Tone Morphing by Diffusion-based Model

200 papers

Removing audio effects from electric guitar recordings makes it easier for post-production and sound editing. An audio distortion recovery model not only improves the clarity of the guitar sounds but also opens up new opportunities for…

Sound · Computer Science 2024-07-24 Ying-Shuo Lee , Yueh-Po Peng , Jui-Te Wu , Ming Cheng , Li Su , Yi-Hsuan Yang

This letter introduces an innovative method to enhance the quality of audio time stretching by precisely decomposing a sound into sines, transients, and noise and by improving the processing of the latter component. While there are…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-25 Eloi Moliner , Leonardo Fierro , Alec Wright , Matti Hämäläinen , Vesa Välimäki

We present the Melody-Guided Music Generation (MG2) model, a novel approach using melody to guide the text-to-music generation that, despite a simple method and limited resources, achieves excellent performance. Specifically, we first align…

Sound · Computer Science 2024-12-31 Shaopeng Wei , Manzhen Wei , Haoyu Wang , Yu Zhao , Gang Kou

As diffusion-based deep generative models gain prevalence, researchers are actively investigating their potential applications across various domains, including music synthesis and style alteration. Within this work, we are interested in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Teysir Baoueb , Xiaoyu Bie , Hicham Janati , Gael Richard

Given the recent advances in music source separation and automatic mixing, removing audio effects in music tracks is a meaningful step toward developing an automated remixing system. This paper focuses on removing distortion audio effects…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-14 Johannes Imort , Giorgio Fabbro , Marco A. Martínez Ramírez , Stefan Uhlich , Yuichiro Koyama , Yuki Mitsufuji

This paper introduces a novel data-driven strategy for synthesizing gramophone noise audio textures. A diffusion probabilistic model is applied to generate highly realistic quasiperiodic noises. The proposed model is designed to generate…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-01 Eloi Moliner , Vesa Välimäki

Data augmentation in feature space is effective to increase data diversity. Previous methods assume that different classes have the same covariance in their feature distributions. Thus, feature transform between different classes is…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Yuke Zhu , Yan Bai , Yichen Wei

Music editing primarily entails the modification of instrument tracks or remixing in the whole, which offers a novel reinterpretation of the original piece through a series of operations. These music processing methods hold immense…

Sound · Computer Science 2023-12-13 Bing Han , Junyu Dai , Weituo Hao , Xinyan He , Dong Guo , Jitong Chen , Yuxuan Wang , Yanmin Qian , Xuchen Song

Morphing is a long-standing problem in vision and computer graphics, requiring a time-dependent warping for feature alignment and a blending for smooth interpolation. Recently, multilayer perceptrons (MLPs) have been explored as implicit…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Arthur Bizzi , Matias Grynberg , Vitor Matias , Daniel Perazzo , João Paulo Lima , Luiz Velho , Nuno Gonçalves , João Pereira , Guilherme Schardong , Tiago Novello

The numerical simulation of electromagnetic transients in fusion devices is essential for analyzing plasma stability and disruptive events. However, it remains computationally demanding due to the large-scale dense systems arising from…

Numerical Analysis · Mathematics 2026-05-28 Salvatore Ventre

We demonstrate how conditional generation from diffusion models can be used to tackle a variety of realistic tasks in the production of music in 44.1kHz stereo audio with sampling-time guidance. The scenarios we consider include…

Sound · Computer Science 2023-12-06 Mark Levy , Bruno Di Giorgi , Floris Weers , Angelos Katharopoulos , Tom Nickson

Modeling the natural contour of fundamental frequency (F0) plays a critical role in music audio synthesis. However, transcribing and managing multiple F0 contours in polyphonic music is challenging, and explicit F0 contour modeling has not…

Sound · Computer Science 2025-02-05 Daewoong Kim , Hao-Wen Dong , Dasaem Jeong

Recent advancements in deep generative models present new opportunities for music production but also pose challenges, such as high computational demands and limited audio quality. Moreover, current systems frequently rely solely on text…

Sound · Computer Science 2024-10-31 Javier Nistal , Marco Pasini , Cyran Aouameur , Maarten Grachten , Stefan Lattner

This paper explores a variety of models for frame-based music transcription, with an emphasis on the methods needed to reach state-of-the-art on human recordings. The translation-invariant network discussed in this paper, which combines a…

Machine Learning · Statistics 2017-11-15 John Thickstun , Zaid Harchaoui , Dean Foster , Sham M. Kakade

Machine learning techniques have proved useful for classifying and analyzing audio content. However, recent methods typically rely on abstract and high-dimensional representations that are difficult to interpret. Inspired by…

More music foundation models are recently being released, promising a general, mostly task independent encoding of musical information. Common ways of adapting music foundation models to downstream tasks are probing and fine-tuning. These…

Sound · Computer Science 2024-12-02 Yiwei Ding , Alexander Lerch

Instrumental playing techniques such as vibratos, glissandos, and trills often denote musical expressivity, both in classical and folk contexts. However, most existing approaches to music similarity retrieval fail to describe timbre beyond…

The aim of this article is to introduce a new methodology for constructing morphings between shapes that have identical topology. The morphings are obtained by deforming a reference shape, through the resolution of a sequence of linear…

Numerical Analysis · Mathematics 2025-02-04 Abbas Kabalan , Fabien Casenave , Felipe Bordeu , Virginie Ehrlacher , Alexandre Ern

Music evokes emotion in many people. We introduce a novel way to manipulate the emotional content of a song using AI tools. Our goal is to achieve the desired emotion while leaving the original melody as intact as possible. For this, we…

Sound · Computer Science 2024-06-14 Adel N. Abdalla , Jared Osborne , Razvan Andonie

In this article, we investigate the notion of model-based deep learning in the realm of music information research (MIR). Loosely speaking, we refer to the term model-based deep learning for approaches that combine traditional…

Signal Processing · Electrical Eng. & Systems 2024-06-18 Gael Richard , Vincent Lostanlen , Yi-Hsuan Yang , Meinard Müller