English
Related papers

Related papers: Nested Music Transformer: Sequentially Decoding Co…

200 papers

Recently, multi-instrument music generation has become a hot topic. Different from single-instrument generation, multi-instrument generation needs to consider inter-track harmony besides intra-track coherence. This is usually achieved by…

Sound · Computer Science 2023-05-29 Xipin Wei , Junhui Chen , Zirui Zheng , Li Guo , Lantian Li , Dong Wang

A representation technique that allows encoding music in a way that contains musical meaning would improve the results of any model trained for computer music tasks like generation of melodies and harmonies of better quality. The field of…

Computation and Language · Computer Science 2020-05-20 Sebastian Garcia-Valencia

We introduce the Normalized Matching Transformer (NMT), a deep learning approach for efficient and accurate sparse semantic keypoint matching between image pairs. NMT consists of a strong visual backbone, geometric feature refinement via…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Abtin Pourhadi , Paul Swoboda

Symbolic music is widely used in various deep learning tasks, including generation, transcription, synthesis, and Music Information Retrieval (MIR). It is mostly employed with discrete models like Transformers, which require music to be…

Sound · Computer Science 2023-10-13 Nathan Fradet , Nicolas Gutowski , Fabien Chhel , Jean-Pierre Briot

Attention-based Transformer models have been increasingly employed for automatic music generation. To condition the generation process of such a model with a user-specified sequence, a popular approach is to take that conditioning sequence…

Sound · Computer Science 2022-03-22 Yi-Jen Shih , Shih-Lun Wu , Frank Zalkow , Meinard Müller , Yi-Hsuan Yang

Neural machine translation (NMT) models are typically trained with fixed-size input and output vocabularies, which creates an important bottleneck on their accuracy and generalization capability. As a solution, various studies proposed…

Computation and Language · Computer Science 2018-05-08 Duygu Ataman , Marcello Federico

Subword tokenization has been widely successful in text-based natural language processing (NLP) tasks with Transformer-based models. As Transformer models become increasingly popular in symbolic music-related studies, it is imperative to…

Sound · Computer Science 2023-04-26 Adarsh Kumar , Pedro Sarmento

Neural machine translation (NMT) typically adopts the encoder-decoder framework. A good understanding of the characteristics and functionalities of the encoder and decoder can help to explain the pros and cons of the framework, and design…

Computation and Language · Computer Science 2019-08-20 Tianyu He , Xu Tan , Tao Qin

Symbolic melodies generation is one of the essential tasks for automatic music generation. Recently, models based on neural networks have had a significant influence on generating symbolic melodies. However, the musical context structure is…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-08 Jin Li , Haibin Liu , Nan Yan , Lan Wang

The system presented here shows the feasibility of modeling the knowledge involved in a complex musical activity by integrating sub-symbolic and symbolic processes. This research focuses on the question of whether there is any advantage in…

Artificial Intelligence · Computer Science 2007-05-23 Claudia V. Goldman , Dan Gang , Jeffrey S. Rosenschein , Daniel Lehmann

In this paper, we explore the tokenized representation of musical scores using the Transformer model to automatically generate musical scores. Thus far, sequence models have yielded fruitful results with note-level (MIDI-equivalent)…

Sound · Computer Science 2021-12-02 Masahiro Suzuki

We present Music Tagging Transformer that is trained with a semi-supervised approach. The proposed model captures local acoustic characteristics in shallow convolutional layers, then temporally summarizes the sequence of the extracted…

Sound · Computer Science 2021-11-29 Minz Won , Keunwoo Choi , Xavier Serra

We investigate two specific manifestations of compositionality in Neural Machine Translation (NMT) : (1) Productivity - the ability of the model to extend its predictions beyond the observed length in training data and (2) Systematicity -…

Computation and Language · Computer Science 2019-12-17 Vikas Raunak , Vaibhav Kumar , Florian Metze

Machine learning techniques, such as Transformers and Long Short-Term Memory (LSTM) networks, play a crucial role in Symbolic Music Generation (SMG). Existing literature indicates a difference between LSTMs and Transformers regarding their…

Machine Learning · Computer Science 2026-03-24 Soudeep Ghoshal , Sandipan Chakraborty , Pradipto Chowdhury , Himanshu Buckchash

Modern neural machine translation (NMT) models have achieved competitive performance in standard benchmarks. However, they have recently been shown to suffer limitation in compositional generalization, failing to effectively learn the…

Computation and Language · Computer Science 2022-10-14 Yongjing Yin , Yafu Li , Fandong Meng , Jie Zhou , Yue Zhang

State-of-the-art end-to-end Optical Music Recognition (OMR) has, to date, primarily been carried out using monophonic transcription techniques to handle complex score layouts, such as polyphony, often by resorting to simplifications or…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Antonio Ríos-Vila , Jorge Calvo-Zaragoza , Thierry Paquet

Research on style transfer and domain translation has clearly demonstrated the ability of deep learning-based algorithms to manipulate images in terms of artistic style. More recently, several attempts have been made to extend such…

Sound · Computer Science 2021-06-11 Ondřej Cífka , Umut Şimşekli , Gaël Richard

Automatic Music Transcription (AMT) converts audio recordings into symbolic musical representations. Training deep neural networks (DNNs) for AMT typically requires strongly aligned training pairs with precise frame-level annotations. Since…

Sound · Computer Science 2025-11-19 Jonathan Yaffe , Ben Maman , Meinard Müller , Amit H. Bermano

Music generated by deep learning methods often suffers from a lack of coherence and long-term organization. Yet, multi-scale hierarchical structure is a distinctive feature of music signals. To leverage this information, we propose a…

Sound · Computer Science 2024-02-29 Manvi Agarwal , Changhong Wang , Gaël Richard

At present, neural network-based models, including transformers, struggle to generate memorable and readily comprehensible music from unified and repetitive musical material due to a lack of understanding of musical structure. Consequently,…

Sound · Computer Science 2026-01-21 Shangxuan Luo , Joshua Reiss