中文
相关论文

相关论文: Sequence-to-sequence Singing Voice Synthesis with …

200 篇论文

Singing voice conversion is a task to convert a song sang by a source singer to the voice of a target singer. In this paper, we propose using a parallel data free, many-to-one voice conversion technique on singing voices. A phonetic…

音频与语音处理 · 电气工程与系统科学 2019-03-12 Xin Chen , Wei Chu , Jinxi Guo , Ning Xu

Learning-based Text To Speech systems have the potential to generalize from one speaker to the next and thus require a relatively short sample of any new voice. However, this promise is currently largely unrealized. We present a method that…

机器学习 · 计算机科学 2018-02-21 Eliya Nachmani , Adam Polyak , Yaniv Taigman , Lior Wolf

The state of the art in music source separation employs neural networks trained in a supervised fashion on multi-track databases to estimate the sources from a given mixture. With only few datasets available, often extensive data…

机器学习 · 计算机科学 2018-04-09 Daniel Stoller , Sebastian Ewert , Simon Dixon

Deep learning models are becoming predominant in many fields of machine learning. Text-to-Speech (TTS), the process of synthesizing artificial speech from text, is no exception. To this end, a deep neural network is usually trained using a…

声音 · 计算机科学 2021-02-11 Giuseppe Ruggiero , Enrico Zovato , Luigi Di Caro , Vincent Pollet

Recent publications on automatic-speech-recognition (ASR) have a strong focus on attention encoder-decoder (AED) architectures which tend to suffer from over-fitting in low resource scenarios. One solution to tackle this issue is to…

计算与语言 · 计算机科学 2021-07-14 Nick Rossenbach , Mohammad Zeineldeen , Benedikt Hilmes , Ralf Schlüter , Hermann Ney

Discrete speech representation learning has recently attracted increasing interest in both acoustic and semantic modeling. Existing approaches typically encode 16 kHz waveforms into discrete tokens at a rate of 25 or 50 tokens per second.…

计算与语言 · 计算机科学 2025-09-03 Jialong Zuo , Guangyan Zhang , Minghui Fang , Shengpeng Ji , Xiaoqi Jiao , Jingyu Li , Yiwen Guo , Zhou Zhao

The S{\o}rensen--Dice Coefficient has recently seen rising popularity as a loss function (also known as Dice loss) due to its robustness in tasks where the number of negative samples significantly exceeds that of positive samples, such as…

音频与语音处理 · 电气工程与系统科学 2021-10-05 Karn N. Watcharasupat , Thi Ngoc Tho Nguyen , Ngoc Khanh Nguyen , Zhen Jian Lee , Douglas L. Jones , Woon Seng Gan

Advances in automatic speaker verification (ASV) promote research into the formulation of spoofing detection systems for real-world applications. The performance of ASV systems can be degraded severely by multiple types of spoofing attacks,…

声音 · 计算机科学 2024-08-27 Zhenyu Wang , John H. L. Hansen

In this paper we propose modifications to the neural network framework, AutoVC for the task of singing technique conversion. This includes utilising a pretrained singing technique encoder which extracts technique information, upon which a…

声音 · 计算机科学 2021-11-18 Brendan O'Connor , Simon Dixon , George Fazekas

Generative models have long been the dominant approach for speech recognition. The success of these models however relies on the use of sophisticated recipes and complicated machinery that is not easily accessible to non-practitioners.…

计算与语言 · 计算机科学 2017-06-21 Chung-Cheng Chiu , Dieterich Lawson , Yuping Luo , George Tucker , Kevin Swersky , Ilya Sutskever , Navdeep Jaitly

In this paper, we present Period Singer, a novel end-to-end singing voice synthesis (SVS) model that utilizes variational inference for periodic and aperiodic components, aimed at producing natural-sounding waveforms. Recent end-to-end SVS…

音频与语音处理 · 电气工程与系统科学 2024-09-12 Taewoo Kim , Choongsang Cho , Young Han Lee

Expressive neural text-to-speech (TTS) systems incorporate a style encoder to learn a latent embedding as the style information. However, this embedding process may encode redundant textual information. This phenomenon is called content…

声音 · 计算机科学 2021-08-05 Xudong Dai , Cheng Gong , Longbiao Wang , Kaili Zhang

Data augmentation is an inexpensive way to increase training data diversity and is commonly achieved via transformations of existing data. For tasks such as classification, there is a good case for learning representations of the data that…

声音 · 计算机科学 2021-04-20 Turab Iqbal , Karim Helwani , Arvindh Krishnaswamy , Wenwu Wang

State of the art speech enhancement (SE) models achieve strong performance on neurotypical speech, but their effectiveness is substantially reduced for pathological speech. In this paper, we investigate strategies to address this gap for…

音频与语音处理 · 电气工程与系统科学 2025-09-24 Mingchi Hou , Ante Jukic , Ina Kodrasi

Learning emotion embedding from reference audio is a straightforward approach for multi-emotion speech synthesis in encoder-decoder systems. But how to get better emotion embedding and how to inject it into TTS acoustic model more…

声音 · 计算机科学 2022-01-31 Fengyu Yang , Jian Luan , Yujun Wang

Sound matching algorithms seek to approximate a target waveform by parametric audio synthesis. Deep neural networks have achieved promising results in matching sustained harmonic tones. However, the task is more challenging when targets are…

声音 · 计算机科学 2023-03-14 Han Han , Vincent Lostanlen , Mathieu Lagrange

This paper leverages the graph-to-sequence method in neural text-to-speech (GraphTTS), which maps the graph embedding of the input sequence to spectrograms. The graphical inputs consist of node and edge representations constructed from…

音频与语音处理 · 电气工程与系统科学 2020-03-05 Aolan Sun , Jianzong Wang , Ning Cheng , Huayi Peng , Zhen Zeng , Jing Xiao

This paper presents ByteSing, a Chinese singing voice synthesis (SVS) system based on duration allocated Tacotron-like acoustic models and WaveRNN neural vocoders. Different from the conventional SVS models, the proposed ByteSing employs…

音频与语音处理 · 电气工程与系统科学 2021-01-26 Yu Gu , Xiang Yin , Yonghui Rao , Yuan Wan , Benlai Tang , Yang Zhang , Jitong Chen , Yuxuan Wang , Zejun Ma

In this paper, we focus on improving the performance of the text-dependent speaker verification system in the scenario of limited training data. The speaker verification system deep learning based text-dependent generally needs a large…

声音 · 计算机科学 2020-11-24 Xiaoyi Qin , Yaogen Yang , Lin Yang , Xuyang Wang , Junjie Wang , Ming Li

The challenges facing speech recognition systems, such as variations in pronunciations, adverse audio conditions, and the scarcity of labeled data, emphasize the necessity for a post-processing step that corrects recurring errors. Previous…

计算与语言 · 计算机科学 2023-10-18 Tomer Wullach , Shlomo E. Chazan