English
Related papers

Related papers: Synthetic Speech Classification: IEEE Signal Proce…

200 papers

In this paper, we develop a deep learning based semantic communication system for speech transmission, named DeepSC-ST. We take the speech recognition and speech synthesis as the transmission tasks of the communication system, respectively.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-03 Zhenzi Weng , Zhijin Qin , Xiaoming Tao , Chengkang Pan , Guangyi Liu , Geoffrey Ye Li

In this project, we aim to build a Text-to-Speech system able to produce speech with a controllable emotional expressiveness. We propose a methodology for solving this problem in three main steps. The first is the collection of emotional…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-08 Noé Tits

In recent years, neural network based methods for multi-speaker text-to-speech synthesis (TTS) have made significant progress. However, the current speaker encoder models used in these methods still cannot capture enough speaker…

Sound · Computer Science 2022-03-29 Jinlong Xue , Yayue Deng , Yichen Han , Ya Li , Jianqing Sun , Jiaen Liang

This paper presents a method for selecting appropriate synthetic speech samples from a given large text-to-speech (TTS) dataset as supplementary training data for an automatic speech recognition (ASR) model. We trained a neural network,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-05 Shuo Liu , Leda Sarı , Chunyang Wu , Gil Keren , Yuan Shangguan , Jay Mahadeokar , Ozlem Kalinli

This paper proposes a zero-shot text-to-speech (TTS) conditioned by a self-supervised speech-representation model acquired through self-supervised learning (SSL). Conventional methods with embedding vectors from x-vector or global style…

Sound · Computer Science 2023-12-19 Kenichi Fujita , Takanori Ashihara , Hiroki Kanagawa , Takafumi Moriya , Yusuke Ijima

In speech recognition problems, data scarcity often poses an issue due to the willingness of humans to provide large amounts of data for learning and classification. In this work, we take a set of 5 spoken Harvard sentences from 7 subjects…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-06 Jordan J. Bird , Diego R. Faria , Anikó Ekárt , Cristiano Premebida , Pedro P. S. Ayrosa

This paper introduces the ZevoMOS entry to the main track of the VoiceMOS Challenge 2022. The ZevoMOS submission is based on a two-step finetuning of pretrained self-supervised learning (SSL) speech models. The first step uses a task of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-16 Adriana Stan

The zero-shot text-to-speech (TTS) method, based on speaker embeddings extracted from reference speech using self-supervised learning (SSL) speech representations, can reproduce speaker characteristics very accurately. However, this…

With the popularity of deep neural network, speech synthesis task has achieved significant improvements based on the end-to-end encoder-decoder framework in the recent days. More and more applications relying on speech synthesis technology…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-23 Dongyang Dai , Li Chen , Yuping Wang , Mu Wang , Rui Xia , Xuchen Song , Zhiyong Wu , Yuxuan Wang

Recent Text-to-Speech (TTS) systems trained on reading or acted corpora have achieved near human-level naturalness. The diversity of human speech, however, often goes beyond the coverage of these corpora. We believe the ability to handle…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-09 Li-Wei Chen , Shinji Watanabe , Alexander Rudnicky

The recent developments in technology have re-warded us with amazing audio synthesis models like TACOTRON and WAVENETS. On the other side, it poses greater threats such as speech clones and deep fakes, that may go undetected. To tackle…

Machine Learning · Computer Science 2021-07-27 Arun Kumar Singh , Priyanka Singh , Karan Nathwani

This paper presents a novel design of neural network system for fine-grained style modeling, transfer and prediction in expressive text-to-speech (TTS) synthesis. Fine-grained modeling is realized by extracting style embeddings from the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-11 Daxin Tan , Tan Lee

Speech synthesis technology has witnessed significant advancements in recent years, enabling the creation of natural and expressive synthetic speech. One area of particular interest is the generation of synthetic child speech, which…

Sound · Computer Science 2023-11-09 Rishabh Jain , Peter Corcoran

Recently, deep learning-based Text-to-Speech (TTS) systems have achieved high-quality speech synthesis results. Recurrent neural networks have become a standard modeling technique for sequential data in TTS systems and are widely used.…

Sound · Computer Science 2024-03-19 Ziqi Liang , Haoxiang Shi , Jiawei Wang , Keda Lu

Controlling the style and characteristics of speech synthesis is crucial for adapting the output to specific contexts and user requirements. Previous Text-to-speech (TTS) works have focused primarily on the technical aspects of producing…

Sound · Computer Science 2025-09-04 Jiawei Zhang , Tian-Hao Zhang , Jun Wang , Jiaran Gao , Xinyuan Qian , Xu-Cheng Yin

A Spoken dialogue system for an unseen language is referred to as Zero resource speech. It is especially beneficial for developing applications for languages that have low digital resources. Zero resource speech synthesis is the task of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-11 Karthik Pandia D S , Anusha Prakash , Mano Ranjith Kumar , Hema A Murthy

Modern text-to-speech synthesis pipelines typically involve multiple processing stages, each of which is designed or learnt independently from the rest. In this work, we take on the challenging task of learning to synthesise speech from…

Sound · Computer Science 2021-03-18 Jeff Donahue , Sander Dieleman , Mikołaj Bińkowski , Erich Elsen , Karen Simonyan

End-to-end speech summarization (E2E SSum) is a technique to directly generate summary sentences from speech. Compared with the cascade approach, which combines automatic speech recognition (ASR) and text summarization models, the E2E…

Computation and Language · Computer Science 2023-03-03 Kohei Matsuura , Takanori Ashihara , Takafumi Moriya , Tomohiro Tanaka , Atsunori Ogawa , Marc Delcroix , Ryo Masumura

This study aims at designing an environment-aware text-to-speech (TTS) system that can generate speech to suit specific acoustic environments. It is also motivated by the desire to leverage massive data of speech audio from heterogeneous…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-09 Daxin Tan , Guangyan Zhang , Tan Lee

This paper presents the system description of the THUEE team for the NIST 2020 Speaker Recognition Evaluation (SRE) conversational telephone speech (CTS) challenge. The subsystems including ResNet74, ResNet152, and RepVGG-B2 are developed…

Sound · Computer Science 2022-10-13 Yu Zheng , Jinghan Peng , Miao Zhao , Yufeng Ma , Min Liu , Xinyue Ma , Tianyu Liang , Tianlong Kong , Liang He , Minqiang Xu