English
Related papers

Related papers: MidiNet: A Convolutional Generative Adversarial Ne…

200 papers

Music generation with the aid of computers has been recently grabbed the attention of many scientists in the area of artificial intelligence. Deep learning techniques have evolved sequence production methods for this purpose. Yet, a…

Neural and Evolutionary Computing · Computer Science 2020-04-09 Majid Farzaneh , Rahil Mahdian Toroghi

In recent years, generative adversarial networks (GANs) have made significant progress in generating audio sequences. However, these models typically rely on bandwidth-limited mel-spectrograms, which constrain the resolution of generated…

Sound · Computer Science 2025-05-15 Zeeshan Ahmad , Shudi Bao , Meng Chen

This paper proposes a novel model for video generation and especially makes the attempt to deal with the problem of video generation from text descriptions, i.e., synthesizing realistic videos conditioned on given texts. Existing video…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Hongyuan Yu , Yan Huang , Lihong Pi , Liang Wang

We propose Parallel WaveGAN, a distillation-free, fast, and small-footprint waveform generation method using a generative adversarial network. In the proposed method, a non-autoregressive WaveNet is trained by jointly optimizing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-07 Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

We present a hybrid neural network and rule-based system that generates pop music. Music produced by pure rule-based systems often sounds mechanical. Music produced by machine learning sounds better, but still lacks hierarchical temporal…

Sound · Computer Science 2017-10-09 Yifei Teng , An Zhao , Camille Goudeseune

This paper proposes a machine learning approach for classifying classical and new Egyptian music by composer and generating new similar music. The proposed system utilizes a convolutional neural network (CNN) for classification and a CNN…

Synthetic creation of drum sounds (e.g., in drum machines) is commonly performed using analog or digital synthesis, allowing a musician to sculpt the desired timbre modifying various parameters. Typically, such parameters control low-level…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-29 J. Nistal , S. Lattner , G. Richard

Conditional music generation offers significant advantages in terms of user convenience and control, presenting great potential in AI-generated content research. However, building conditional generative systems for multitrack popular songs…

Sound · Computer Science 2025-10-27 Jing Luo , Xinyu Yang , Dorien Herremans

This study proposes a system designed to enumerate the process of collaborative composition among humans, using automatic music composition technology. By integrating multiple Recurrent Neural Network (RNN) models, the system provides an…

Sound · Computer Science 2024-03-07 So Hirawata , Noriko Otani

The intelligibility of speech severely degrades in the presence of environmental noise and reverberation. In this paper, we propose a novel deep learning based system for modifying the speech signal to increase its intelligibility under the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Haoyu Li , Junichi Yamagishi

This paper is about creating digital musical instruments where a predictive neural network model is integrated into the interactive system. Rather than predicting symbolic music (e.g., MIDI notes), we suggest that predicting future control…

Sound · Computer Science 2019-04-11 Charles P Martin , Jim Torresen

This work presents a generative neural network that's able to generate expressive piano performance in MIDI format. The musical expressivity is reflected by vivid micro-timing, rich polyphonic texture, varied dynamics, and the sustain pedal…

Sound · Computer Science 2024-12-17 Jingwei Liu

One way to interpret trained deep neural networks (DNNs) is by inspecting characteristics that neurons in the model respond to, such as by iteratively optimising the model input (e.g., an image) to maximally activate specific neurons.…

Machine Learning · Computer Science 2019-07-02 Saumitra Mishra , Daniel Stoller , Emmanouil Benetos , Bob L. Sturm , Simon Dixon

This paper presents a deep reinforcement learning algorithm for online accompaniment generation, with potential for real-time interactive human-machine duet improvisation. Different from offline music generation and harmonization, online…

Machine Learning · Computer Science 2020-02-11 Nan Jiang , Sheng Jin , Zhiyao Duan , Changshui Zhang

Generative models have thrived in computer vision, enabling unprecedented image processes. Yet the results in audio remain less advanced. Our project targets real-time sound synthesis from a reduced set of high-level parameters, including…

Sound · Computer Science 2019-06-25 Adrien Bitton , Philippe Esling , Antoine Caillon , Martin Fouilleul

The human ability to track musical downbeats is robust to changes in tempo, and it extends to tempi never previously encountered. We propose a deterministic time-warping operation that enables this skill in a convolutional neural network…

Sound · Computer Science 2021-02-05 Bruno Di Giorgi , Matthias Mauch , Mark Levy

Recent advances in deep learning have expanded possibilities to generate music, but generating a customizable full piece of music with consistent long-term structure remains a challenge. This paper introduces MusicFrameworks, a hierarchical…

Sound · Computer Science 2021-09-03 Shuqi Dai , Zeyu Jin , Celso Gomes , Roger B. Dannenberg

The creation of long melody sequences requires effective expression of coherent musical structure. However, there is no clear representation of musical structure. Recent works on music generation have suggested various approaches to deal…

Sound · Computer Science 2021-11-04 Yi Zou , Pei Zou , Yi Zhao , Kaixiang Zhang , Ran Zhang , Xiaorui Wang

We propose a novel system that takes as an input body movements of a musician playing a musical instrument and generates music in an unsupervised setting. Learning to generate multi-instrumental music from videos without labeling the…

Sound · Computer Science 2020-12-08 Kun Su , Xiulong Liu , Eli Shlizerman

In the generator of typical Generative Adversarial Networks (GANs), a noise is inputted to generate fake samples via a series of convolutional operations. However, current noise generation models merely relies on the information from the…

Machine Learning · Computer Science 2020-05-15 Shaoning Zeng , Bob Zhang