English
Related papers

Related papers: Encoding Musical Style with Transformer Autoencode…

200 papers

This paper presents an integrated system that transforms symbolic music scores into expressive piano performance audio. By combining a Transformer-based Expressive Performance Rendering (EPR) model with a fine-tuned neural MIDI synthesiser,…

Sound · Computer Science 2025-01-20 Jingjing Tang , Erica Cooper , Xin Wang , Junichi Yamagishi , George Fazekas

In the manufacturing process, sensor data collected from equipment is crucial for building predictive models to manage processes and improve productivity. However, in the field, it is challenging to gather sufficient data to build robust…

Machine Learning · Computer Science 2024-07-10 Gyeong Taek Lee , Oh-Ran Kwon

We analyze the training of a two-layer autoencoder used to parameterize a flow-based generative model for sampling from a high-dimensional Gaussian mixture. Previous work shows that the phase where the relative probability between the modes…

Machine Learning · Computer Science 2025-02-11 Santiago Aranguri , Francesco Insulla

Symbolic music representation is a fundamental challenge in computational musicology. While grid-based representations effectively preserve pitch-time spatial correspondence, their inherent data sparsity leads to low encoding efficiency.…

Sound · Computer Science 2026-01-29 Lekai Qian , Haoyu Gu , Dehan Li , Boyu Cao , Qi Liu

How to generate summaries of different styles without requiring corpora in the target styles, or training separate models? We present two novel methods that can be deployed during summary decoding on any pre-trained Transformer-based…

Computation and Language · Computer Science 2021-04-06 Shuyang Cao , Lu Wang

We introduce a state-of-the-art real-time, high-fidelity, audio codec leveraging neural networks. It consists in a streaming encoder-decoder architecture with quantized latent space trained in an end-to-end fashion. We simplify and speed-up…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-25 Alexandre Défossez , Jade Copet , Gabriel Synnaeve , Yossi Adi

Many of the music generation systems based on neural networks are fully autonomous and do not offer control over the generation process. In this research, we present a controllable music generation system in terms of tonal tension. We…

Sound · Computer Science 2020-10-15 Rui Guo , Ivor Simpson , Thor Magnusson , Chris Kiefer , Dorien Herremans

In this paper, we present a novel architecture to realize fine-grained style control on the transformer-based text-to-speech synthesis (TransformerTTS). Specifically, we model the speaking style by extracting a time sequence of local style…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-18 Li-Wei Chen , Alexander Rudnicky

We present an end-to-end system for musical key estimation, based on a convolutional neural network. The proposed system not only out-performs existing key estimation methods proposed in the academic literature; it is also capable of…

Machine Learning · Computer Science 2017-06-12 Filip Korzeniowski , Gerhard Widmer

This paper studies composer style classification of piano sheet music images. Previous approaches to the composer classification task have been limited by a scarcity of data. We address this issue in two ways: (1) we recast the problem to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 TJ Tsai , Kevin Ji

Supervised training of abstractive language generation models results in learning conditional probabilities over language sequences based on the supervised training signal. When the training signal contains a variety of writing styles, such…

Computation and Language · Computer Science 2018-04-12 Ye Zhang , Nan Ding , Radu Soricut

This paper describes a data-driven framework to parse musical sequences into dependency trees, which are hierarchical structures used in music cognition research and music analysis. The parsing involves two steps. First, the input sequence…

Sound · Computer Science 2023-06-30 Francesco Foscarin , Daniel Harasim , Gerhard Widmer

Recurrent auto-encoder model summarises sequential data through an encoder structure into a fixed-length vector and then reconstructs the original sequence through the decoder structure. The summarised vector can be used to represent time…

Machine Learning · Computer Science 2025-10-16 Timothy Wong , Zhiyuan Luo

Recently, a variety of acoustic tasks and related applications arised. For many acoustic tasks, the labeled data size may be limited. To handle this problem, we propose an unsupervised pre-training method using Transformer based encoder to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Ruixiong Zhang , Haiwei Wu , Wubo Li , Dongwei Jiang , Wei Zou , Xiangang Li

Deep generative models have become increasingly effective at producing realistic images from randomly sampled seeds, but using such models for controllable manipulation of existing images remains challenging. We propose the Swapping…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Taesung Park , Jun-Yan Zhu , Oliver Wang , Jingwan Lu , Eli Shechtman , Alexei A. Efros , Richard Zhang

We study the capabilities of generative autoregressive transformer models trained on large amounts of symbolic solo-piano transcriptions. After first pretraining on approximately 60,000 hours of music, we use a comparatively smaller,…

Sound · Computer Science 2025-07-01 Louis Bradshaw , Honglu Fan , Alexander Spangher , Stella Biderman , Simon Colton

We investigate applying audio manipulations using pretrained neural network-based autoencoders as an alternative to traditional signal processing methods, since the former may provide greater semantic or perceptual organization. To…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-11 Scott H. Hawley , Christian J. Steinmetz

We present PECMAE, an interpretable model for music audio classification based on prototype learning. Our model is based on a previous method, APNet, which jointly learns an autoencoder and a prototypical network. Instead, we propose to…

We introduce the Latent Fourier Transform (LatentFT), a framework that provides novel frequency-domain controls for generative music models. LatentFT combines a diffusion autoencoder with a latent-space Fourier transform to separate musical…

Sound · Computer Science 2026-04-21 Mason Wang , Cheng-Zhi Anna Huang

World modelling, i.e. building a representation of the rules that govern the world so as to predict its evolution, is an essential ability for any agent interacting with the physical world. Recent applications of the Transformer…

Machine Learning · Computer Science 2024-05-31 Francesco Petri , Luigi Asprino , Aldo Gangemi