English
Related papers

Related papers: A Deep Learning Based Analysis-Synthesis Framework…

200 papers

Music segmentation refers to the dual problem of identifying boundaries between, and labeling, distinct music segments, e.g., the chorus, verse, bridge etc. in popular music. The performance of a range of music segmentation algorithms has…

Sound · Computer Science 2021-08-31 Matthew C. McCallum

Thanks to developments in machine learning techniques, it has become possible to synthesize high-quality singing voices of a single singer. An open multispeaker singing-voice corpus would further accelerate the research in singing-voice…

Sound · Computer Science 2020-01-22 Hiroki Tamaru , Shinnosuke Takamichi , Naoko Tanji , Hiroshi Saruwatari

The shuffle mode, where songs are played in a randomized order that is decided upon for all tracks at once, is widely found and known to exist in music player systems. There are only few music enthusiasts who use this mode since it either…

Information Retrieval · Computer Science 2019-09-09 Rushin Gindra , Srushti Kotak , Asmita Natekar , Grishma Sharma

Singing voice separation based on deep learning relies on the usage of time-frequency masking. In many cases the masking process is not a learnable function or is not encapsulated into the deep learning optimization. Consequently, most of…

The dichotic method of hearing sound adapts in the region of musical harmony. The algorithm of the separation of the being dissonant voices into several separate groups is proposed. For an increase in the pleasantness of chords the…

Sound · Computer Science 2024-05-09 Vadim R. Madgazin

State of the art music recommender systems mainly rely on either matrix factorization-based collaborative filtering approaches or deep learning architectures. Deep learning models usually use metadata for content-based filtering or predict…

Information Retrieval · Computer Science 2019-12-20 Khalil Damak , Olfa Nasraoui

Speech separation refers to extracting each individual speech source in a given mixed signal. Recent advancements in speech separation and ongoing research in this area, have made these approaches as promising techniques for pre-processing…

Machine Learning · Computer Science 2019-12-18 Fahimeh Bahmaninezhad , Shi-Xiong Zhang , Yong Xu , Meng Yu , John H. L. Hansen , Dong Yu

Conventional music structure analysis algorithms aim to divide a song into segments and to group them with abstract labels (e.g., 'A', 'B', and 'C'). However, explicitly identifying the function of each segment (e.g., 'verse' or 'chorus')…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-31 Ju-Chiang Wang , Yun-Ning Hung , Jordan B. L. Smith

Existing singing voice synthesis (SVS) models largely rely on fine-grained, phoneme-level durations, which limits their practical application. These methods overlook the complementary role of visual information in duration prediction.To…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-30 Ke Gu , Zhicong Wu , Peng Bai , Sitong Qiao , Zhiqi Jiang , Junchen Lu , Xiaodong Shi , Xinyuan Qian

Dancing to music is an instinctive move by humans. Learning to model the music-to-dance generation process is, however, a challenging problem. It requires significant efforts to measure the correlation between music and dance as one needs…

Computer Vision and Pattern Recognition · Computer Science 2019-11-06 Hsin-Ying Lee , Xiaodong Yang , Ming-Yu Liu , Ting-Chun Wang , Yu-Ding Lu , Ming-Hsuan Yang , Jan Kautz

The problem of pitch tracking has been extensively studied in the speech research community. The goal of this paper is to investigate how these techniques should be adapted to singing voice analysis, and to provide a comparative evaluation…

Sound · Computer Science 2020-01-01 Onur Babacan , Thomas Drugman , Nicolas d'Alessandro , Nathalie Henrich , Thierry Dutoit

Various applications of voice synthesis have been developed independently despite the fact that they generate "voice" as output in common. In addition, the majority of voice synthesis models currently rely on annotated audio data, but it is…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-31 Rongjie Huang , Chunlei Zhang , Yongqi Wang , Dongchao Yang , Luping Liu , Zhenhui Ye , Ziyue Jiang , Chao Weng , Zhou Zhao , Dong Yu

Creating lyrics and melodies for the vocal track in a symbolic format, known as song composition, demands expert musical knowledge of melody, an advanced understanding of lyrics, and precise alignment between them. Despite achievements in…

Sound · Computer Science 2025-06-03 Shuangrui Ding , Zihan Liu , Xiaoyi Dong , Pan Zhang , Rui Qian , Junhao Huang , Conghui He , Dahua Lin , Jiaqi Wang

Music mixing traditionally involves recording instruments in the form of clean, individual tracks and blending them into a final mixture using audio effects and expert knowledge (e.g., a mixing engineer). The automation of music production…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-30 Marco A. Martínez-Ramírez , Wei-Hsiang Liao , Giorgio Fabbro , Stefan Uhlich , Chihiro Nagashima , Yuki Mitsufuji

Deep clustering is a deep neural network-based speech separation algorithm that first trains the mixed component of signals with high-dimensional embeddings, and then uses a clustering algorithm to separate each mixture of sources. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2019-01-16 Soyeon Choe , Soo-Whan Chung , Youna Ji , Hong-Goo Kang

Conventional vocoders are commonly used as analysis tools to provide interpretable features for downstream tasks such as speech synthesis and voice conversion. They are built under certain assumptions about the signals following signal…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-14 Sergey Nikonorov , Berrak Sisman , Mingyang Zhang , Haizhou Li

We present a deep neural network based singing voice synthesizer, inspired by the Deep Convolutions Generative Adversarial Networks (DCGAN) architecture and optimized using the Wasserstein-GAN algorithm. We use vocoder parameters for…

Sound · Computer Science 2020-02-13 Pritish Chandna , Merlijn Blaauw , Jordi Bonada , Emilia Gomez

Choral music separation refers to the task of extracting tracks of voice parts (e.g., soprano, alto, tenor, and bass) from mixed audio. The lack of datasets has impeded research on this topic as previous work has only been able to train and…

We propose a novel unsupervised singing voice detection method which use single-channel Blind Audio Source Separation (BASS) algorithm as a preliminary step. To reach this goal, we investigate three promising BASS approaches which operate…

Sound · Computer Science 2018-05-04 Dominique Fourer , Geoffroy Peeters

Vocal education in the music field is difficult to quantify due to the individual differences in singers' voices and the different quantitative criteria of singing techniques. Deep learning has great potential to be applied in music…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-01 Zhenyi Hou , Xu Zhao , Kejie Ye , Xinyu Sheng , Shanggerile Jiang , Jiajing Xia , Yitao Zhang , Chenxi Ban , Daijun Luo , Jiaxing Chen , Yan Zou , Yuchao Feng , Guangyu Fan , Xin Yuan