English
Related papers

Related papers: The GigaMIDI Dataset with Features for Expressive …

200 papers

While piano music has become a significant area of study in Music Information Retrieval (MIR), there is a notable lack of datasets for piano solo music with text labels. To address this gap, we present PIAST (PIano dataset with Audio,…

Sound · Computer Science 2024-11-08 Hayeon Bang , Eunjin Choi , Megan Finch , Seungheon Doh , Seolhee Lee , Gyeong-Hoon Lee , Juhan Nam

In cross-modal music processing, translation between visual, auditory, and semantic content opens up new possibilities as well as challenges. The construction of such a transformative scheme depends upon a benchmark corpus with a…

Understanding the interaction between different drugs (drug-drug interaction or DDI) is critical for ensuring patient safety and optimizing therapeutic outcomes. Existing DDI datasets primarily focus on textual information, overlooking…

Machine Learning · Computer Science 2025-06-03 Tung-Lam Ngo , Ba-Hoang Tran , Duy-Cat Can , Trung-Hieu Do , Oliver Y. Chén , Hoang-Quynh Le

The Music Emotion Recognition (MER) field has seen steady developments in recent years, with contributions from feature engineering, machine learning, and deep learning. The landscape has also shifted from audio-centric systems to bimodal…

Dance-driven music generation aims to generate musical pieces conditioned on dance videos. Previous works focus on monophonic or raw audio generation, while the multi-instruments scenario is under-explored. The challenges associated with…

Multimedia · Computer Science 2024-02-28 Bo Han , Yuheng Li , Yixuan Shen , Yi Ren , Feilin Han

Multi-modal deep learning techniques for matching free-form text with music have shown promising results in the field of Music Information Retrieval (MIR). Prior work is often based on large proprietary data while publicly available…

Computation and Language · Computer Science 2024-04-18 Benno Weck , Holger Kirchhoff , Peter Grosche , Xavier Serra

We propose MelodySim, a melody-aware music similarity model and dataset for plagiarism detection. First, we introduce a novel method to construct a dataset focused on melodic similarity. By augmenting Slakh2100, an existing MIDI dataset, we…

Sound · Computer Science 2025-11-20 Tongyu Lu , Charlotta-Marlena Geist , Jan Melechovsky , Abhinaba Roy , Dorien Herremans

Multimodal intent recognition (MIR) seeks to accurately interpret user intentions by integrating verbal and non-verbal information across video, audio and text modalities. While existing approaches prioritize text analysis, they often…

Multimedia · Computer Science 2025-06-13 Weiyin Gong , Kai Zhang , Yanghai Zhang , Qi Liu , Xinjie Sun , Junyu Lu , Linbo Zhu

In this paper, we propose Emotionally paired Music and Image Dataset (EMID), a novel dataset designed for the emotional matching of music and images, to facilitate auditory-visual cross-modal tasks such as generation and retrieval. Unlike…

Multimedia · Computer Science 2024-08-12 Jialing Zou , Jiahao Mei , Guangze Ye , Tianyu Huai , Qiwei Shen , Daoguo Dong

In this document, we introduce a new dataset designed for training machine learning models of symbolic music data. Five datasets are provided, one of which is from a newly collected corpus of 20K midi files. We describe our preprocessing…

Sound · Computer Science 2016-06-09 Christian Walder

We present the IRMA Dataset (Iranian Radif MIDI Audio), a multi-level, open-access corpus designed for the computational study of Iranian classical music, with a particular emphasis on the radif, a structured repertoire of modal-melodic…

Sound · Computer Science 2025-08-28 Sepideh Shafiei , Shapour Hakam

Multimodal Information Retrieval has made significant progress in recent years, leveraging the increasingly strong multimodal abilities of deep pre-trained models to represent information across modalities. Music Information Retrieval…

Information Retrieval · Computer Science 2026-02-13 Benjamin Clavié , Atoof Shakir , Jonah Turner , Sean Lee , Aamir Shakir , Makoto P. Kato

Originating in the Renaissance and burgeoning in the digital era, tablatures are a commonly used music notation system which provides explicit representations of instrument fingerings rather than pitches. GuitarPro has established itself as…

Sound · Computer Science 2021-08-02 Pedro Sarmento , Adarsh Kumar , CJ Carr , Zack Zukowski , Mathieu Barthet , Yi-Hsuan Yang

Beat tracking in musical performance MIDI is a challenging and important task for notation-level music transcription and rhythmical analysis, yet existing methods primarily focus on audio-based approaches. This paper proposes an end-to-end…

Sound · Computer Science 2025-07-02 Sebastian Murgul , Michael Heizmann

The multimodal nature of music performance has driven increasing interest in data beyond the audio domain within the music information retrieval (MIR) community. This paper introduces PianoVAM, a comprehensive piano performance dataset that…

Sound · Computer Science 2025-09-11 Yonghyun Kim , Junhyung Park , Joonhyung Bae , Kirak Kim , Taegyun Kwon , Alexander Lerch , Juhan Nam

Multimodal music emotion recognition (MMER) is an emerging discipline in music information retrieval that has experienced a surge in interest in recent years. This survey provides a comprehensive overview of the current state-of-the-art in…

Multimedia · Computer Science 2025-04-29 Rashini Liyanarachchi , Aditya Joshi , Erik Meijering

A curated dataset of Guitar Pro tablature files (.gp5 format), tailored for tasks involving guitar music generation, sequence modeling, and performance-aware learning is provided. The dataset is derived from MIDI notes in MAESTRO and…

Sound · Computer Science 2025-07-28 Vishakh Begari

Music Information Retrieval (MIR) has seen a recent surge in deep learning-based approaches, which often involve encoding symbolic music (i.e., music represented in terms of discrete note events) in an image-like or language like fashion.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-12 Huan Zhang , Emmanouil Karystinaios , Simon Dixon , Gerhard Widmer , Carlos Eduardo Cancino-Chacón

Recent progress in music generation has been remarkably advanced by the state-of-the-art MusicLM, which comprises a hierarchy of three LMs, respectively, for semantic, coarse acoustic, and fine acoustic modelings. Yet, sampling with the…

This paper introduces HarmonySet, a comprehensive dataset designed to advance video-music understanding. HarmonySet consists of 48,328 diverse video-music pairs, annotated with detailed information on rhythmic synchronization, emotional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Zitang Zhou , Ke Mei , Yu Lu , Tianyi Wang , Fengyun Rao