English
Related papers

Related papers: Speech prosody and remote experiments: a technical…

200 papers

The rapid move to remote work due to COVID-19 social distancing policies has slowed or stopped most in-person qualitative user research activities. The limitation on in-person activities has pushed many user researchers to consider how they…

Human-Computer Interaction · Computer Science 2022-08-09 Nikolas Martelaro

Speech is a multiplexed signal displaying levels of complexity, organizational principles and perceptual units of analysis at distinct timescales. This critical acoustic signal for human communication is thus characterized at distinct…

Neurons and Cognition · Quantitative Biology 2024-07-10 Jérémy Giroud , Benjamin Morillon

The prosody of a spoken utterance, including features like stress, intonation and rhythm, can significantly affect the underlying semantics, and as a consequence can also affect its textual translation. Nevertheless, prosody is rarely…

Computation and Language · Computer Science 2024-11-01 Ioannis Tsiamas , Matthias Sperber , Andrew Finch , Sarthak Garg

Recent advances in deep learning methods have elevated synthetic speech quality to human level, and the field is now moving towards addressing prosodic variation in synthetic speech.Despite successes in this effort, the state-of-the-art…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-30 Antti Suni , Sofoklis Kakouros , Martti Vainio , Juraj Šimko

Voice conversion is a common speech synthesis task which can be solved in different ways depending on a particular real-world scenario. The most challenging one often referred to as one-shot many-to-many voice conversion consists in copying…

Sound · Computer Science 2022-08-05 Vadim Popov , Ivan Vovk , Vladimir Gogoryan , Tasnima Sadekova , Mikhail Kudinov , Jiansheng Wei

In this paper, we propose three methods for generating synthetic samples to train and evaluate multimodal large language models capable of processing both text and speech inputs. Addressing the scarcity of samples containing both…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-21 Vahid Noroozi , Zhehuai Chen , Somshubra Majumdar , Steve Huang , Jagadeesh Balam , Boris Ginsburg

The noise of a device under test (DUT) is measured simultaneously with two instruments, each of which contributes its own background. The average cross power spectral density converges to the DUT power spectral density. This method enables…

Instrumentation and Detectors · Physics 2010-03-02 Enrico Rubiola , Francois Vernotte

Speech synthesis has recently seen significant improvements in fidelity, driven by the advent of neural vocoders and neural prosody generators. However, these systems lack intuitive user controls over prosody, making them unable to rectify…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-13 Max Morrison , Zeyu Jin , Justin Salamon , Nicholas J. Bryan , Gautham J. Mysore

This paper briefly reports our ongoing attempt at the development of a multi-platform browser-based speech recording system. We designed the system toward a service of providing open service of building large-scale speech corpora at a…

Human-Computer Interaction · Computer Science 2019-12-20 Keita Ishizuka , Takashi Nose

This paper considers a sequential sensor scheduling and remote estimation problem with multiple communication channels. Departing from the classical remote estimation paradigm, which involves one communication channel (noiseless or noisy),…

Systems and Control · Computer Science 2018-04-10 Xiaobin Gao , Emrah Akyol , Tamer Basar

Text-based speech editors expedite the process of editing speech recordings by permitting editing via intuitive cut, copy, and paste operations on a speech transcript. A major drawback of current systems, however, is that edited recordings…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-17 Max Morrison , Lucas Rencker , Zeyu Jin , Nicholas J. Bryan , Juan-Pablo Caceres , Bryan Pardo

The present work describes a website designed for remote teaching of optical measurements using lasers. It enables senior undergraduate and postgraduate students to learn theoretical aspects of the subject and also have a means to perform…

Physics Education · Physics 2018-03-02 Veena Singh , Richa Dubey , P. K. Panigrahi , K. Muralidhar

Recordings gathered with child-worn devices promised to revolutionize both fundamental and applied speech sciences by allowing the effortless capture of children's naturalistic speech environment and language production. This promise hinges…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Tarek Kunze , Marianne Métais , Hadrien Titeux , Lucas Elbert , Joseph Coffey , Emmanuel Dupoux , Alejandrina Cristia , Marvin Lavechin

We propose protocols for acquiring speech materials, making them reusable for future investigations, and presenting them for subjective experiments. We also provide means to evaluate existing speech materials' compatibility with target…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-01 Hideki Kawahara , Ken-Ichi Sakakibara , Mitsunori Mizumachi , Kohei Yatabe

Vocal feedback (e.g., `mhm', `yeah', `okay') is an important component of spoken dialogue and is crucial to ensuring common ground in conversational systems. The exact meaning of such feedback is conveyed through both lexical and prosodic…

Computation and Language · Computer Science 2025-05-20 Livia Qian , Carol Figueroa , Gabriel Skantze

With the pandemic, many experimental psychologists and linguists have started to collect data over the internet (hereafter on-line data). The feasibility of such experiments and the sample sizes required to achieve sufficient statistical…

Computation and Language · Computer Science 2024-03-26 Bürki Audrey , Vasishth Shravan

The problem of pitch tracking has been extensively studied in the speech research community. The goal of this paper is to investigate how these techniques should be adapted to singing voice analysis, and to provide a comparative evaluation…

Sound · Computer Science 2020-01-01 Onur Babacan , Thomas Drugman , Nicolas d'Alessandro , Nathalie Henrich , Thierry Dutoit

Teleconferencing is becoming essential during the COVID-19 pandemic. However, in real-world applications, speech quality can deteriorate due to, for example, background interference, noise, or reverberation. To solve this problem, target…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-02 Yicheng Hsu , Yonghan Lee , Mingsian R. Bai

Many popular form factors of digital assistants---such as Amazon Echo, Apple Homepod, or Google Home---enable the user to hold a conversation with these systems based only on the speech modality. The lack of a screen presents unique…

Computation and Language · Computer Science 2019-10-03 Aleksandr Chuklin , Aliaksei Severyn , Johanne Trippas , Enrique Alfonseca , Hanna Silen , Damiano Spina

This paper considers a sequential sensor scheduling and remote estimation problem with one sensor and one estimator. The sensor makes sequential observations about the state of an underlying memoryless stochastic process and makes a…

Optimization and Control · Mathematics 2016-10-19 Xiaobin Gao , Emrah Akyol , Tamer Basar