中文
相关论文

相关论文: Conditioning Deep Generative Raw Audio Models for …

200 篇论文

One key step in audio signal processing is to transform the raw signal into representations that are efficient for encoding the original information. Traditionally, people transform the audio into spectral representations, as a function of…

声音 · 计算机科学 2016-11-30 Shuhui Qu , Juncheng Li , Wei Dai , Samarjit Das

A new architecture of an artificial neural network that helps to generate longer melodic patterns is introduced alongside with methods for post-generation filtering. The proposed approach called variational autoencoder supported by history…

声音 · 计算机科学 2021-05-21 Ivan P. Yamshchikov , Alexey Tikhonov

Music has the power to evoke intense emotional experiences and regulate the mood of an individual. With the advent of online streaming services, research in music recommendation services has seen tremendous progress. Modern methods…

多媒体 · 计算机科学 2021-10-05 Kunal Vaswani , Yudhik Agrawal , Vinoo Alluri

In this paper, we propose a novel score-base generative model for unconditional raw audio synthesis. Our proposal builds upon the latest developments on diffusion process modeling with stochastic differential equations, which already…

声音 · 计算机科学 2021-06-15 Simon Rouard , Gaëtan Hadjeres

We present JASCO, a temporally controlled text-to-music generation model utilizing both symbolic and audio-based conditions. JASCO can generate high-quality music samples conditioned on global text descriptions along with fine-grained local…

声音 · 计算机科学 2024-06-18 Or Tal , Alon Ziv , Itai Gat , Felix Kreuk , Yossi Adi

Evaluating generative models remains a fundamental challenge, particularly when the goal is to reflect human preferences. In this paper, we use music generation as a case study to investigate the gap between automatic evaluation metrics and…

音频与语音处理 · 电气工程与系统科学 2025-05-01 Huan Zhang , Jinhua Liang , Huy Phan , Wenwu Wang , Emmanouil Benetos

The recent surge in popularity of diffusion models for image generation has brought new attention to the potential of these models in other areas of media generation. One area that has yet to be fully explored is the application of…

声音 · 计算机科学 2023-02-01 Flavio Schneider

In this work, we provide a comprehensive survey of AI music generation tools, including both research projects and commercialized applications. To conduct our analysis, we classified music generation approaches into three categories:…

声音 · 计算机科学 2023-08-28 Yueyue Zhu , Jared Baca , Banafsheh Rekabdar , Reza Rawassizadeh

Automatic transcription of acoustic guitar fingerpicking performances remains a challenging task due to the scarcity of labeled training data and legal constraints connected with musical recordings. This work investigates a procedural data…

声音 · 计算机科学 2025-08-12 Sebastian Murgul , Michael Heizmann

In recent years, text-to-audio systems have achieved remarkable success, enabling the generation of complete audio segments directly from text descriptions. While these systems also facilitate music creation, the element of human creativity…

声音 · 计算机科学 2025-04-15 Weixuan Yuan , Qadeer Khan , Vladimir Golkov

We introduce Schr\"odingeRNN, a quantum inspired generative model for raw audio. Audio data is wave-like and is sampled from a continuous signal. Although generative modelling of raw audio has made great strides lately, relational inductive…

声音 · 计算机科学 2019-11-28 Beñat Mencia Uranga , Austen Lamacraft

Attention-based Transformer models have been increasingly employed for automatic music generation. To condition the generation process of such a model with a user-specified sequence, a popular approach is to take that conditioning sequence…

声音 · 计算机科学 2022-03-22 Yi-Jen Shih , Shih-Lun Wu , Frank Zalkow , Meinard Müller , Yi-Hsuan Yang

Generating realistic audio effects for movies and other media is a challenging task that is accomplished today primarily through physical techniques known as Foley art. Foley artists create sounds with common objects (e.g., boxing gloves,…

声音 · 计算机科学 2023-08-25 Matthew Martel , Jackson Wagner

We propose a deep generative approach to sampling from a conditional distribution based on a unified formulation of conditional distribution and generalized nonparametric regression function using the noise-outsourcing lemma. The proposed…

统计理论 · 数学 2021-10-22 Xingyu Zhou , Yuling Jiao , Jin Liu , Jian Huang

A key aspect of machine learning models lies in their ability to learn efficient intermediate features. However, the input representation plays a crucial role in this process, and polyphonic musical scores remain a particularly complex type…

机器学习 · 计算机科学 2021-09-09 Mathieu Prang , Philippe Esling

Neural networks and deep learning are often deployed for the sake of the most comprehensive music generation with as little involvement as possible from the human musician. Implementations in aid of, or being a tool for, music practitioners…

声音 · 计算机科学 2024-05-14 Alex Wastnidge

Audio-based generative models for music have seen great strides recently, but so far have not managed to produce full-length music tracks with coherent musical structure from text prompts. We show that by training a generative model on long…

声音 · 计算机科学 2024-07-30 Zach Evans , Julian D. Parker , CJ Carr , Zack Zukowski , Josiah Taylor , Jordi Pons

Generative AI has been transforming the way we interact with technology and consume content. In the next decade, AI technology will reshape how we create audio content in various media, including music, theater, films, games, podcasts, and…

声音 · 计算机科学 2024-11-25 Hao-Wen Dong

Developing generative models to create or conditionally create symbolic music presents unique challenges due to the combination of limited data availability and the need for high precision in note pitch. To address these challenges, we…

声音 · 计算机科学 2025-06-09 Tingyu Zhu , Haoyu Liu , Ziyu Wang , Zhimin Jiang , Zeyu Zheng

At present, neural network models show powerful sequence prediction ability and are used in many automatic composition models. In comparison, the way humans compose music is very different from it. Composers usually start by creating…

声音 · 计算机科学 2024-10-18 Yutian Wang , Wanyin Yang , Zhenrong Dai , Yilong Zhang , Kun Zhao , Hui Wang