English
Related papers

Related papers: Musical Voice Separation as Link Prediction: Model…

200 papers

Music creation is typically composed of two parts: composing the musical score, and then performing the score with instruments to make sounds. While recent work has made much progress in automatic music generation in the symbolic domain,…

Sound · Computer Science 2018-11-13 Bryan Wang , Yi-Hsuan Yang

We present a method for simultaneously localizing multiple sound sources within a visual scene. This task requires a model to both group a sound mixture into individual sources, and to associate them with a visual signal. Our method jointly…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Xixi Hu , Ziyang Chen , Andrew Owens

This work addresses the problem of multichannel source separation combining two powerful approaches, multichannel spectral factorization with recent monophonic deep-learning (DL) based spectrum inference. Individual source spectra at…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-04 Antonio J. Muñoz-Montoro , Julio J. Carabias-Orti , Archontis Politis , Konstantinos Drossos

Music Structure Analysis is an open research task in Music Information Retrieval (MIR). In the past, there have been several works that attempt to segment music into the audio and symbolic domains, however, the identification and…

Sound · Computer Science 2023-03-27 Carlos Hernandez-Olivan , Sonia Rubio Llamas , Jose R. Beltran

Musical (MSS) source separation of western popular music using non-causal deep learning can be very effective. In contrast, MSS for classical music is an unsolved problem. Classical ensembles are harder to separate than popular music…

Tracking beats of singing voices without the presence of musical accompaniment can find many applications in music production, automatic song arrangement, and social media interaction. Its main challenge is the lack of strong rhythmic and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-01 Mojtaba Heydari , Zhiyao Duan

Multi-label image classification is a prediction task that aims to identify more than one label from a given image. This paper considers the semantic consistency of the latent space between the visual patch and linguistic label domains and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Miaoge Li , Dongsheng Wang , Xinyang Liu , Zequn Zeng , Ruiying Lu , Bo Chen , Mingyuan Zhou

Automatic Music Transcription (AMT), inferring musical notes from raw audio, is a challenging task at the core of music understanding. Unlike Automatic Speech Recognition (ASR), which typically focuses on the words of a single speaker, AMT…

Sound · Computer Science 2022-03-16 Josh Gardner , Ian Simon , Ethan Manilow , Curtis Hawthorne , Jesse Engel

Modelling temporal networks for dynamic link prediction of new nodes has many real-world applications, such as providing relevant item recommendations to new customers in recommender systems and suggesting appropriate posts to new users on…

Machine Learning · Computer Science 2023-10-17 Xiaobo Zhu , Yan Wu , Qinhu Zhang , Zhanheng Chen , Ying He

We propose a simple discrete time semi-supervised graph embedding approach to link prediction in dynamic networks. The learned embedding reflects information from both the temporal and cross-sectional network structures, which is performed…

Machine Learning · Statistics 2016-10-17 Ryohei Hisano

Fundamental frequency (f0) estimation from polyphonic music includes the tasks of multiple-f0, melody, vocal, and bass line estimation. Historically these problems have been approached separately, and only recently, using learning-based…

Sound · Computer Science 2018-09-05 Rachel M. Bittner , Brian McFee , Juan P. Bello

We propose a generative framework for multi-track music source separation (MSS) that reformulates the task as conditional discrete token generation. Unlike conventional approaches that directly estimate continuous signals in the time or…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-20 Pengbo Lyu , Xiangyu Zhao , Chengwei Liu , Haoyin Yan , Xiaotao Liang , Hongyu Wang , Shaofei Xue

Music similarity search is useful for a variety of creative tasks such as replacing one music recording with another recording with a similar "feel", a common task in video editing. For this task, it is typically necessary to define a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-14 Jongpil Lee , Nicholas J. Bryan , Justin Salamon , Zeyu Jin , Juhan Nam

Automatic Music Transcription (AMT) has been recognized as a key enabling technology with a wide range of applications. Given the task's complexity, best results have typically been reported for systems focusing on specific settings, e.g.…

Supervised deep learning approaches to underdetermined audio source separation achieve state-of-the-art performance but require a dataset of mixtures along with their corresponding isolated source signals. Such datasets can be extremely…

Comprehensive understanding of dynamic scenes is a critical prerequisite for intelligent robots to autonomously operate in their environment. Research in this domain, which encompasses diverse perception problems, has primarily been focused…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Juana Valeria Hurtado , Rohit Mohan , Wolfram Burgard , Abhinav Valada

Separation of multiple singing voices into each voice is a rarely studied area in music source separation research. The absence of a benchmark dataset has hindered its progress. In this paper, we present an evaluation dataset and provide…

Sound · Computer Science 2023-05-05 Chang-Bin Jeon , Hyeongi Moon , Keunwoo Choi , Ben Sangbae Chon , Kyogu Lee

This paper presents a novel supervised approach to detecting the chorus segments in popular music. Traditional approaches to this task are mostly unsupervised, with pipelines designed to target some quality that is assumed to define…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-22 Ju-Chiang Wang , Jordan B. L. Smith , Jitong Chen , Xuchen Song , Yuxuan Wang

Representation learning focused on disentangling the underlying factors of variation in given data has become an important area of research in machine learning. However, most of the studies in this area have relied on datasets from the…

Machine Learning · Computer Science 2020-07-31 Ashis Pati , Siddharth Gururani , Alexander Lerch

Modeling various aspects that make a music piece unique is a challenging task, requiring the combination of multiple sources of information. Deep learning is commonly used to obtain representations using various sources of information, such…

Sound · Computer Science 2021-04-05 Andres Ferraro , Xavier Favory , Konstantinos Drossos , Yuntae Kim , Dmitry Bogdanov