English
Related papers

Related papers: Deep Autotuner: a Pitch Correcting Network for Sin…

200 papers

Pitch shifting has been an essential feature in singing voice production. However, conventional signal processing approaches exhibit well known trade offs such as formant shifts and robotic coloration that becomes more severe at larger…

Sound · Computer Science 2026-01-16 Yunyi Liu , Taketo Akama

We propose a model to estimate the fundamental frequency in monophonic audio, often referred to as pitch estimation. We acknowledge the fact that obtaining ground truth annotations at the required temporal and frequency resolution is a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-07 Beat Gfeller , Christian Frank , Dominik Roblek , Matt Sharifi , Marco Tagliasacchi , Mihajlo Velimirović

Music has the power to evoke intense emotional experiences and regulate the mood of an individual. With the advent of online streaming services, research in music recommendation services has seen tremendous progress. Modern methods…

Multimedia · Computer Science 2021-10-05 Kunal Vaswani , Yudhik Agrawal , Vinoo Alluri

The Complete Vocal Technique (CVT) is a school of singing developed in the past decades by Cathrin Sadolin et al.. CVT groups the use of the voice into so called vocal modes, namely Neutral, Curbing, Overdrive and Edge. Knowledge of the…

Sound · Computer Science 2026-04-30 Reemt Hinrichs , Sonja Stephan , Alexander Lange , Jörn Ostermann

In this paper, we focus on singing techniques within the scope of music information retrieval research. We investigate how singers use singing techniques using real-world recordings of famous solo singers in Japanese popular music songs…

Sound · Computer Science 2022-11-17 Yuya Yamamoto , Juhan Nam , Hiroko Terasawa

Automatic Pitch Correction (APC) enhances vocal recordings by aligning pitch deviations with intended musical notes. However, existing APC systems either rely on reference pitches, which limits practical applicability, or employ simple…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-29 Sungjae Kim , Kihyun Na , Jinyoung Choi , Injung Kim

Phonation mode is an essential characteristic of singing style as well as an important expression of performance. It can be classified into four categories, called neutral, breathy, pressed and flow. Previous studies used voice quality…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-20 Xiaoheng Sun , Yiliang Jiang , Wei Li

Singing voice beat tracking is a challenging task, due to the lack of musical accompaniment that often contains robust rhythmic and harmonic patterns, something most existing beat tracking systems utilize and can be essential for estimating…

Sound · Computer Science 2025-03-14 Jiajun Deng , Yaolong Ju , Jing Yang , Simon Lui , Xunying Liu

Multi-pitch estimation is a decades-long research problem involving the detection of pitch activity associated with concurrent musical events within multi-instrument mixtures. Supervised learning techniques have demonstrated solid…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-27 Frank Cwitkowitz , Zhiyao Duan

Existing pitch curve generators face two main challenges: they often neglect singer-specific expressiveness, reducing their ability to capture individual singing styles. And they are typically developed as auxiliary modules for specific…

We propose a flexible framework that deals with both singer conversion and singers vocal technique conversion. The proposed model is trained on non-parallel corpora, accommodates many-to-many conversion, and leverages recent advances of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-26 Yin-Jyun Luo , Chin-Chen Hsu , Kat Agres , Dorien Herremans

Transfer learning, which allows a source task to affect the inductive bias of the target task, is widely used in computer vision. The typical way of conducting transfer learning with deep neural networks is to fine-tune a model pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Yunhui Guo , Honghui Shi , Abhishek Kumar , Kristen Grauman , Tajana Rosing , Rogerio Feris

This paper presents a computational methodology for analyzing intonation and deriving tuning systems in microtonal oral traditions, utilizing pitch histograms, Dynamic Time Warping (DTW), and optimization techniques, with a case study on a…

Sound · Computer Science 2025-08-29 Sepideh Shafiei , Shapour Hakam

Recently deep neural networks have been successfully used for various classification tasks, especially for problems with massive perfectly labeled training data. However, it is often costly to have large-scale credible labels in real-world…

Machine Learning · Computer Science 2019-01-15 Mingxiao An , Yongzhou Chen , Qi Liu , Chuanren Liu , Guangyi Lv , Fangzhao Wu , Jianhui Ma

In this paper, we propose a model to perform style transfer of speech to singing voice. Contrary to the previous signal processing-based methods, which require high-quality singing templates or phoneme synchronization, we explore a…

Sound · Computer Science 2022-08-29 Shrutina Agarwal , Sriram Ganapathy , Naoya Takahashi

Deep neural networks often develop spurious bias, reliance on correlations between non-essential features and classes for predictions. For example, a model may identify objects based on frequently co-occurring backgrounds rather than…

Machine Learning · Computer Science 2025-06-02 Guangtao Zheng , Wenqian Ye , Aidong Zhang

Many audio processing tasks require perceptual assessment. The ``gold standard`` of obtaining human judgments is time-consuming, expensive, and cannot be used as an optimization criterion. On the other hand, automated metrics are efficient…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Pranay Manocha , Adam Finkelstein , Richard Zhang , Nicholas J. Bryan , Gautham J. Mysore , Zeyu Jin

Fake audio attack becomes a major threat to the speaker verification system. Although current detection approaches have achieved promising results on dataset-specific scenarios, they encounter difficulties on unseen spoofing data.…

Sound · Computer Science 2022-07-12 Haoxin Ma , Jiangyan Yi , Jianhua Tao , Ye Bai , Zhengkun Tian , Chenglong Wang

Transfer learning enables solving a specific task having limited data by using the pre-trained deep networks trained on large-scale datasets. Typically, while transferring the learned knowledge from source task to the target task, the last…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 S. H. Shabbeer Basha , Sravan Kumar Vinakota , Viswanath Pulabaigari , Snehasis Mukherjee , Shiv Ram Dubey

Singing voice transcription converts recorded singing audio to musical notation. Sound contamination (such as accompaniment) and lack of annotated data make singing voice transcription an extremely difficult task. We take two approaches to…

Sound · Computer Science 2023-04-25 Xiangming Gu , Wei Zeng , Jianan Zhang , Longshen Ou , Ye Wang