English
Related papers

Related papers: Deep generative models for musical audio synthesis

200 papers

A new framework is presented for generating musical audio using autoencoder neural networks. With the presented framework, called network modulation synthesis, users can create synthesis architectures and use novel generative algorithms to…

Sound · Computer Science 2025-09-30 Jeremy Hyrkas

Recent advances in singing voice synthesis (SVS) have attracted substantial attention from both academia and industry. With the advent of large language models and novel generative paradigms, producing controllable, high-fidelity singing…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-22 Changhao Pan , Dongyu Yao , Yu Zhang , Wenxiang Guo , Jingyu Lu , Zhiyuan Zhu , Zhou Zhao

The use of deep learning to solve problems in literary arts has been a recent trend that has gained a lot of attention and automated generation of music has been an active area. This project deals with the generation of music using raw…

Sound · Computer Science 2016-12-16 Vasanth Kalingeri , Srikanth Grandhe

Deep generative models produce data according to a learned representation, e.g. diffusion models, through a process of approximation computing possible samples. Approximation can be understood as reconstruction and the large datasets used…

Human-Computer Interaction · Computer Science 2023-09-25 Luís Arandas , Mick Grierson , Miguel Carvalhais

Deep learning has revolutionised synthetic speech quality. However, it has thus far delivered little value to the speech science community. The new methods do not meet the controllability demands that practitioners in this area require…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-03 Gustavo Teodoro Döhler Beck , Ulme Wennberg , Zofia Malisz , Gustav Eje Henter

Automated design synthesis has the potential to revolutionize the modern engineering design process and improve access to highly optimized and customized products across countless industries. Successfully adapting generative Machine…

Machine Learning · Computer Science 2022-03-18 Lyle Regenwetter , Amin Heyrani Nobari , Faez Ahmed

Recent years have seen considerable advances in audio synthesis with deep generative models. However, the state-of-the-art is very difficult to quantify; different studies often use different evaluation methodologies and different metrics…

Sound · Computer Science 2022-09-02 Ashvala Vinay , Alexander Lerch

The term "differentiable digital signal processing" describes a family of techniques in which loss function gradients are backpropagated through digital signal processors, facilitating their integration into neural networks. This article…

Sound · Computer Science 2023-08-30 Ben Hayes , Jordie Shier , György Fazekas , Andrew McPherson , Charalampos Saitis

Generating a complex work of art such as a musical composition requires exhibiting true creativity that depends on a variety of factors that are related to the hierarchy of musical language. Music generation have been faced with Algorithmic…

Sound · Computer Science 2021-09-08 Carlos Hernandez-Olivan , Jose R. Beltran

Modelling musical structure is vital yet challenging for artificial intelligence systems that generate symbolic music compositions. This literature review dissects the evolution of techniques for incorporating coherent structure, from…

Sound · Computer Science 2024-03-14 Keshav Bhandari , Simon Colton

The current wave of deep learning (the hyper-vitamined return of artificial neural networks) applies not only to traditional statistical machine learning tasks: prediction and classification (e.g., for weather prediction and pattern…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-07 Jean-Pierre Briot

Deep generative models are now able to synthesize high-quality audio signals, shifting the critical aspect in their development from audio quality to control capabilities. Although text-to-music generation is getting largely adopted by the…

Sound · Computer Science 2024-08-02 Nils Demerlé , Philippe Esling , Guillaume Doras , David Genova

With the development of deep learning and artificial intelligence, audio synthesis has a pivotal role in the area of machine learning and shows strong applicability in the industry. Meanwhile, significant efforts have been dedicated by…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-03 Zhaofeng Shi

Existing automatic music generation approaches that feature deep learning can be broadly classified into two types: raw audio models and symbolic models. Symbolic models, which train and generate at the note level, are currently the more…

Sound · Computer Science 2018-06-27 Rachel Manzelli , Vijay Thakkar , Ali Siahkamari , Brian Kulis

Recent advancements in deep generative modeling make it possible to learn prior distributions from complex data that subsequently can be used for Bayesian inference. However, we find that distributions learned by deep generative models for…

Machine Learning · Computer Science 2020-11-04 Maurice Frank , Maximilian Ilse

Pattern formation of sound is predicted in a driven resonator where subharmonic generation takes place. A model allowing for diffraction of the fields (large-aspect ratio limit) is derived by means of the multiple scale expansions…

Pattern Formation and Solitons · Physics 2009-11-11 Isabel Perez-Arjona , Victor J. Sanchez-Morcillo

Machine learning techniques have proved useful for classifying and analyzing audio content. However, recent methods typically rely on abstract and high-dimensional representations that are difficult to interpret. Inspired by…

Modulations are a critical part of sound design and music production, enabling the creation of complex and evolving audio. Modern synthesizers provide envelopes, low frequency oscillators (LFOs), and more parameter automation tools that…

Sound · Computer Science 2025-10-08 Christopher Mitcheltree , Hao Hao Tan , Joshua D. Reiss

Separating the individual elements in a musical mixture is an essential process for music analysis and practice. While this is generally addressed using neural networks optimized to mask or transform the time-frequency representation of a…

Sound · Computer Science 2025-11-27 Genís Plaja-Roglans , Yun-Ning Hung , Xavier Serra , Igor Pereira

The field of speech processing has undergone a transformative shift with the advent of deep learning. The use of multiple processing layers has enabled the creation of models capable of extracting intricate features from speech data. This…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-31 Ambuj Mehrish , Navonil Majumder , Rishabh Bhardwaj , Rada Mihalcea , Soujanya Poria