English
Related papers

Related papers: Evaluating Features and Metrics for High-Quality S…

200 papers

Infant speech perception and learning is modeled using Echo State Network classification and Reinforcement Learning. Ambient speech for the modeled infant learner is created using the speech synthesizer Vocaltractlab. An auditory system is…

Sound · Computer Science 2016-10-21 Philip Zurbuchen

Background: Infant cry acoustics provide a promising window into early neurodevelopment and may serve as scalable biomarkers for neurodevelopmental disorders. However, conventional microphone-based recordings are highly susceptible to…

Sound · Computer Science 2026-05-28 Winko W. An , Saketh Sundar , Lisa Yankowitz , Daryush D. Mehta , Carol L. Wilkinson

With the recent developments in speech synthesis via machine learning, this study explores incorporating linguistics knowledge to visualise and evaluate synthetic speech model training. If changes to the first and second formant (in turn,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-23 Binu Abeysinghe , Jesin James , Catherine I. Watson , Felix Marattukalam

Modern speech synthesis systems have improved significantly, with synthetic speech being indistinguishable from real speech. However, efficient and holistic evaluation of synthetic speech still remains a significant challenge. Human…

Computation and Language · Computer Science 2023-10-03 Dareen Alharthi , Roshan Sharma , Hira Dhamyal , Soumi Maiti , Bhiksha Raj , Rita Singh

Learning to understand speech appears almost effortless for typically developing infants, yet from an information-processing perspective, acquiring a language from acoustic speech is an enormous challenge. This chapter reviews recent…

Computation and Language · Computer Science 2026-03-12 Okko Räsänen

The increasing use of children's automatic speech recognition (ASR) systems has spurred research efforts to improve the accuracy of models designed for children's speech in recent years. The current approach utilizes either open-source…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-13 Vishwanath Pratap Singh , Md. Sahidullah , Tomi Kinnunen

The assessment of children at risk of autism typically involves a clinician observing, taking notes, and rating children's behaviors. A machine learning model that can label adult and child audio may largely save labor in coding children's…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-07 Jialu Li , Mark Hasegawa-Johnson , Karrie Karahalios

During the first years of life, infant vocalizations change considerably, as infants develop the vocalization skills that enable them to produce speech sounds. Characterizations based on specific acoustic features, protophone categories, or…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-27 Silvia Pagliarini , Sara Schneider , Christopher T. Kello , Anne S. Warlaumont

Despite growing interest in generating high-fidelity accents, evaluating accent similarity in speech synthesis has been underexplored. We aim to enhance both subjective and objective evaluation methods for accent similarity. Subjectively,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Jinzuomu Zhong , Suyuan Liu , Dan Wells , Korin Richmond

High-quality articulatory speech synthesis has many potential applications in speech science and technology. However, developing appropriate mappings from linguistic specification to articulatory gestures is difficult and time consuming. In…

Sound · Computer Science 2022-07-01 Daniel R. van Niekerk , Anqi Xu , Branislav Gerazov , Paul K. Krug , Peter Birkholz , Yi Xu

This work explores nonparametric methods which aim at synthesizing audio from low-dimensionnal acoustic features typically used in MIR frameworks. Several issues prevent this task to be straightforwardly achieved. Such features are designed…

Sound · Computer Science 2015-01-22 Manuel Moussallam , Antoine Liutkus , Laurent Daudet

In time-cost scale model studies, predicting acoustic performance by using simulation methods is a commonly used method that is preferred. In this field, building acoustic simulation tools are complicated by several challenges, including…

Existing fake audio detection systems perform well in in-domain testing, but still face many challenges in out-of-domain testing. This is due to the mismatch between the training and test data, as well as the poor generalizability of…

Sound · Computer Science 2023-05-24 Chenglong Wang , Jiangyan Yi , Jianhua Tao , Chuyuan Zhang , Shuai Zhang , Xun Chen

One of the many tasks facing the typically-developing child language learner is learning to discriminate between the distinctive sounds that make up words in their native language. Here we investigate whether multimodal…

Computation and Language · Computer Science 2024-07-24 Sophia Zhi , Roger P. Levy , Stephan C. Meylan

Training dialog policies for speech-based virtual assistants requires a plethora of conversational data. The data collection phase is often expensive and time consuming due to human involvement. To address this issue, a common solution is…

Computation and Language · Computer Science 2019-11-11 Maryam Fazel-Zarandi , Longshaokan Wang , Aditya Tiwari , Spyros Matsoukas

Audiovisual synchronisation is the task of determining the time offset between speech audio and a video recording of the articulators. In child speech therapy, audio and ultrasound videos of the tongue are captured using instruments which…

Computation and Language · Computer Science 2019-11-28 Aciel Eshky , Manuel Sam Ribeiro , Korin Richmond , Steve Renals

The goal of this work is to recover articulatory information from the speech signal by acoustic-to-articulatory inversion. One of the main difficulties with inversion is that the problem is underdetermined and inversion methods generally…

Computation and Language · Computer Science 2007-05-23 Blaise Potard , Yves Laprie

In this work, we propose a novel method for modeling numerous speakers, which enables expressing the overall characteristics of speakers in detail like a trained multi-speaker model without additional training on the target speaker's…

Sound · Computer Science 2024-06-03 Jungil Kong , Junmo Lee , Jeongmin Kim , Beomjeong Kim , Jihoon Park , Dohee Kong , Changheon Lee , Sangjin Kim

Previous real-time MRI (rtMRI)-based speech synthesis models depend heavily on noisy ground-truth speech. Applying loss directly over ground truth mel-spectrograms entangles speech content with MRI noise, resulting in poor intelligibility.…

Sound · Computer Science 2025-01-20 Neil Shah , Ayan Kashyap , Shirish Karande , Vineet Gandhi

It is increasingly considered that human speech perception and production both rely on articulatory representations. In this paper, we investigate whether this type of representation could improve the performances of a deep generative model…

Sound · Computer Science 2021-04-08 Marc-Antoine Georges , Laurent Girin , Jean-Luc Schwartz , Thomas Hueber