English
Related papers

Related papers: Score-informed Music Source Separation: Improving …

200 papers

This paper addresses the challenge of speaker separation, which remains an active research topic despite the promising results achieved in recent years. These results, however, often degrade in real recording conditions due to the presence…

Sound · Computer Science 2024-11-14 Rawad Melhem , Assef Jafar , Oumayma Al Dakkak

Music source separation has been intensively studied in the last decade and tremendous progress with the advent of deep learning could be observed. Evaluation campaigns such as MIREX or SiSEC connected state-of-the-art models and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-24 Yuki Mitsufuji , Giorgio Fabbro , Stefan Uhlich , Fabian-Robert Stöter , Alexandre Défossez , Minseok Kim , Woosung Choi , Chin-Yun Yu , Kin-Wai Cheuk

This paper presents a novel method for extracting the vocal track from a musical mixture. The musical mixture consists of a singing voice and a backing track which may comprise of various instruments. We use a convolutional network with…

Sound · Computer Science 2020-02-13 Pritish Chandna , Merlijn Blaauw , Jordi Bonada , Emilia Gomez

We introduce a film score generation framework to harmonize visual pixels and music melodies utilizing a latent diffusion model. Our framework processes film clips as input and generates music that aligns with a general theme while offering…

Multimedia · Computer Science 2024-11-13 F. Qi , L. Ni , C. Xu

This paper addresses the problem of sheet-image-based on-line audio-to-score alignment also known as score following. Drawing inspiration from object detection, a conditional neural network architecture is proposed that directly predicts…

Sound · Computer Science 2021-05-11 Florian Henkel , Gerhard Widmer

The advancement of machine learning in audio analysis has opened new possibilities for technology-enhanced music education. This paper introduces a framework for automatic singing mistake detection in the context of music pedagogy,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-09 Sumit Kumar , Suraj Jaiswal , Parampreet Singh , Vipul Arora

Music similarity is an essential aspect of music retrieval, recommendation systems, and music analysis. Moreover, similarity is of vital interest for music experts, as it allows studying analogies and influences among composers and…

Sound · Computer Science 2023-06-22 Andrea Poltronieri

Music scores are written representations of music and contain rich information about musical components. The visual information on music scores includes notes, rests, staff lines, clefs, dynamics, and articulations. This visual information…

Multimedia · Computer Science 2024-06-18 Yuheng Lin , Zheqi Dai , Qiuqiang Kong

Cinematic audio source separation is a relatively new subtask of audio source separation, with the aim of extracting the dialogue, music, and effects stems from their mixture. In this work, we developed a model generalizing the Bandsplit…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-27 Karn N. Watcharasupat , Chih-Wei Wu , Yiwei Ding , Iroro Orife , Aaron J. Hipple , Phillip A. Williams , Scott Kramer , Alexander Lerch , William Wolcott

This thesis develops a Transformer model based on Whisper, which extracts melodies and chords from music audio and records them into ABC notation. A comprehensive data processing workflow is customized for ABC notation, including data…

Sound · Computer Science 2024-10-23 Hongyao Zhang , Bohang Sun

The representation of basic elements of music in terms of discrete audio signals is often used in software for musical creation and design. Nevertheless, there is no unified approach that relates these elements to the discrete samples of…

Supervised deep learning methods for performing audio source separation can be very effective in domains where there is a large amount of training data. While some music domains have enough data suitable for training a separation system,…

Sound · Computer Science 2020-10-27 Andreas Bugler , Bryan Pardo , Prem Seetharaman

Mixing style transfer automates the generation of a multitrack mix for a given set of tracks by inferring production attributes from a reference song. However, existing systems for mixing style transfer are limited in that they often…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-15 Soumya Sai Vanka , Christian Steinmetz , Jean-Baptiste Rolland , Joshua Reiss , George Fazekas

Systems for synthesizer sound matching, which automatically set the parameters of a synthesizer to emulate an input sound, have the potential to make the process of synthesizer programming faster and easier for novice and experienced…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-24 Fred Bruford , Frederik Blang , Shahan Nercessian

A flexible recommendation and retrieval system requires music similarity in terms of multiple partial elements of musical pieces to allow users to select the element they want to focus on. A method for music similarity learning using…

Sound · Computer Science 2025-07-18 Yuka Hashizume , Li Li , Atsushi Miyashita , Tomoki Toda

We introduce a dataset for facilitating audio-visual analysis of music performances. The dataset comprises 44 simple multi-instrument classical music pieces assembled from coordinated but separately recorded performances of individual…

Multimedia · Computer Science 2018-08-09 Bochen Li , Xinzhao Liu , Karthik Dinesh , Zhiyao Duan , Gaurav Sharma

We propose a novel approach for the automatic equalization of individual musical instrument tracks. Our method begins by identifying the instrument present within a source recording in order to choose its corresponding ideal spectrum as a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-24 Florian Mockenhaupt , Joscha Simon Rieber , Shahan Nercessian

This paper describes a method for decomposing steady-state instrument data into excitation and formant filter components. The input data, taken from several series of recordings of acoustical instruments is analyzed in the frequency domain,…

Sound · Computer Science 2007-05-23 Ilia Bisnovatyi , Michael J. O'Donnell

Multi-Source Diffusion Models (MSDM) allow for compositional musical generation tasks: generating a set of coherent sources, creating accompaniments, and performing source separation. Despite their versatility, they require estimating the…

Sound · Computer Science 2024-03-19 Emilian Postolache , Giorgio Mariani , Luca Cosmo , Emmanouil Benetos , Emanuele Rodolà

We propose an end-to-end music mixing style transfer system that converts the mixing style of an input multitrack to that of a reference song. This is achieved with an encoder pre-trained with a contrastive objective to extract only audio…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-12 Junghyun Koo , Marco A. Martínez-Ramírez , Wei-Hsiang Liao , Stefan Uhlich , Kyogu Lee , Yuki Mitsufuji