English
Related papers

Related papers: Data Melodification FM: Where Musical Rhetoric Mee…

200 papers

Recent music generation methods based on transformers have a context window of up to a minute. The music generated by these methods is largely unstructured beyond the context window. With a longer context window, learning long-scale…

Sound · Computer Science 2024-10-08 Lilac Atassi

The potential of synthetic data in text-to-speech (TTS) model training has gained increasing attention, yet its rationality and effectiveness require systematic validation. In this study, we systematically investigate the feasibility of…

Sound · Computer Science 2025-12-22 Tingxiao Zhou , Leying Zhang , Zhengyang Chen , Yanmin Qian

Current research in robotic sounds generally focuses on either masking the consequential sound produced by the robot or on sonifying data about the robot to create a synthetic robot sound. We propose to capture, modify, and utilise rather…

Human-Computer Interaction · Computer Science 2024-04-23 Stine S. Johansen , Yanto Browning , Anthony Brumpton , Jared Donovan , Markus Rittenbruch

Enhancing the ability of Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) to interpret sheet music is a crucial step toward building AI musicians. However, current research lacks both evaluation benchmarks and…

Computation and Language · Computer Science 2025-09-29 Zhilin Wang , Zhe Yang , Yun Luo , Yafu Li , Xiaoye Qu , Ziqian Qiao , Haoran Zhang , Runzhe Zhan , Derek F. Wong , Jizhe Zhou , Yu Cheng

Word embedding has become an essential means for text-based information retrieval. Typically, word embeddings are learned from large quantities of general and unstructured text data. However, in the domain of music, the word embedding may…

Sound · Computer Science 2024-04-24 SeungHeon Doh , Jongpil Lee , Dasaem Jeong , Juhan Nam

Symbolic music research plays a crucial role in music-related machine learning, but MIDI data can be complex for those without musical expertise. To address this issue, we present MidiTok Visualizer, a web application designed to facilitate…

Subword tokenization has been widely successful in text-based natural language processing (NLP) tasks with Transformer-based models. As Transformer models become increasingly popular in symbolic music-related studies, it is imperative to…

Sound · Computer Science 2023-04-26 Adarsh Kumar , Pedro Sarmento

The Mozart effect refers to scientific data on short-term improvement on certain mental tasks after listening to Mozart, and also to its popularized version that listening to Mozart makes you smarter (Tomatis, 1991; Wikipedia, 2012). Does…

Neurons and Cognition · Quantitative Biology 2012-09-19 Leonid Perlovsky , Arnaud Cabanac , Marie-Claude Bonniot-Cabanac , Michel Cabanac

Melody reduction, as an abstract representation of musical compositions, serves not only as a tool for music analysis but also as an intermediate representation for structured music generation. Prior computational theories, such as the…

Sound · Computer Science 2025-08-05 Ziyu Wang , Yuxuan Wu , Roger B. Dannenberg , Gus Xia

This work was developed aiming to employ Statistical techniques to the field of Music Emotion Recognition, a well-recognized area within the Signal Processing world, but hardly explored from the statistical point of view. Here, we opened…

Machine Learning · Statistics 2021-07-13 Nathalie Deziderio , Hugo Tremonte de Carvalho

Sequential modelling entails making sense of sequential data, which naturally occurs in a wide array of domains. One example is systems that interact with users, log user actions and behaviour, and make recommendations of items of potential…

Information Retrieval · Computer Science 2021-09-15 Christian Hansen

Voice conversion aims to transform source speech into a different target voice. However, typical voice conversion systems do not account for rhythm, which is an important factor in the perception of speaker identity. To bridge this gap, we…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-13 Benjamin van Niekerk , Marc-André Carbonneau , Herman Kamper

Leveraging the compositional nature of our world to expedite learning and facilitate generalization is a hallmark of human perception. In machine learning, on the other hand, achieving compositional generalization has proven to be an…

Machine Learning · Computer Science 2023-07-13 Thaddäus Wiedemer , Prasanna Mayilvahanan , Matthias Bethge , Wieland Brendel

At present, neural network models show powerful sequence prediction ability and are used in many automatic composition models. In comparison, the way humans compose music is very different from it. Composers usually start by creating…

Sound · Computer Science 2024-10-18 Yutian Wang , Wanyin Yang , Zhenrong Dai , Yilong Zhang , Kun Zhao , Hui Wang

We study the effect of memory on synchronization of identical chaotic systems driven by common external noises. Our examples show that while in general synchronization transition becomes more difficult to meet when memory range increases,…

Chaotic Dynamics · Physics 2009-11-11 Rafael Morgado , Michal Ciesla , Lech Longa , Fernando A. Oliveira

Despite its potential, AI advances in music education are hindered by proprietary systems that limit the democratization of technology in this domain. In particular, AI-driven music difficulty adjustment is especially promising, as…

Sound · Computer Science 2025-11-25 Pedro Ramoneda , Emilia Parada-Cabaleiro , Dasaem Jeong , Xavier Serra

Embodied cognition states that semantics is encoded in the brain as firing patterns of neural circuits, which are learned according to the statistical structure of human multimodal experience. However, each human brain is idiosyncratically…

Neurons and Cognition · Quantitative Biology 2019-06-28 Francisco Afonso Raposo , David Martins de Matos , Ricardo Ribeiro

Human usually composes music by organizing elements according to the musical form to express music ideas. However, for neural network-based music generation, it is difficult to do so due to the lack of labelled data on musical form. In this…

Sound · Computer Science 2022-08-31 Peiling Lu , Xu Tan , Botao Yu , Tao Qin , Sheng Zhao , Tie-Yan Liu

Could we automatically derive the score of a piano accompaniment based on the audio of a pop song? This is the audio-to-symbolic arrangement problem we tackle in this paper. A good arrangement model should not only consider the audio…

Sound · Computer Science 2022-02-23 Ziyu Wang , Dejing Xu , Gus Xia , Ying Shan

With the growing popularity of code-mixed data, there is an increasing need for better handling of this type of data, which poses a number of challenges, such as dealing with spelling variations, multiple languages, different scripts, and a…

Computation and Language · Computer Science 2023-10-30 Mamta , Zishan Ahmad , Asif Ekbal