English
Related papers

Related papers: RWCP-SSD-Onomatopoeia: Onomatopoeic Word Dataset f…

200 papers

The NLP community has broadly focused on text-only approaches of cognitive state tasks, but audio can provide vital missing cues through prosody. We posit that text-to-speech models learn to track aspects of cognitive state in order to…

Sound · Computer Science 2025-02-12 Adil Soubki , John Murzaku , Peter Zeng , Owen Rambow

Most soundfield synthesis approaches deal with extensive and regular loudspeaker arrays, which are often not suitable for home audio systems, due to physical space constraints. In this article we propose a technique for soundfield synthesis…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-09 Luca Comanducci , Fabio Antonacci , Augusto Sarti

Today, many state-of-the-art automatic speech recognition (ASR) systems apply all-neural models that map audio to word sequences trained end-to-end along one global optimisation criterion in a fully data driven fashion. These models allow…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-11 Xianrui Zheng , Yulan Liu , Deniz Gunceler , Daniel Willett

In conventional studies on environmental sound separation and synthesis using captions, datasets consisting of multiple-source sounds with their captions were used for model training. However, when we collect the captions for…

Sound · Computer Science 2023-05-30 Yuki Okamoto , Kanta Shimonishi , Keisuke Imoto , Kota Dohi , Shota Horiguchi , Yohei Kawaguchi

This paper describes a submission to the Environment-Aware Speech and Sound Deepfake Detection Challenge (ESDD2) 2026, which addresses component-level deepfake detection using the CompSpoofV2 dataset, where speech and environmental sounds…

Sound · Computer Science 2026-05-06 Khalid Zaman , Qixuan Huang , Muhammad Uzair , Masashi Unoki

The unrealizability of a specification is often due to the assumption that the behavior of the environment is unrestricted. In this paper, we present algorithms for synthesis in bounded environments, where the environment can only generate…

Logic in Computer Science · Computer Science 2021-01-01 Rayna Dimitrova , Bernd Finkbeiner , Hazem Torfah

Passive Acoustic Monitoring (PAM) analysis is often hindered by the intensive manual effort needed to create labelled training data. This study introduces a synthetic data framework to generate large volumes of richly labelled training data…

Sound · Computer Science 2025-07-23 Kaspar Soltero , Tadeu Siqueira , Stefanie Gutschmidt

Large, human-annotated datasets are central to the development of natural language processing models. Collecting these datasets can be the most challenging part of the development process. We address this problem by introducing a general…

Computation and Language · Computer Science 2020-04-29 Alana Marzoev , Samuel Madden , M. Frans Kaashoek , Michael Cafarella , Jacob Andreas

With recent advances in speech synthesis, synthetic data is becoming a viable alternative to real data for training speech recognition models. However, machine learning with synthetic data is not trivial due to the gap between the synthetic…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-25 Ting-Yao Hu , Mohammadreza Armandpour , Ashish Shrivastava , Jen-Hao Rick Chang , Hema Koppula , Oncel Tuzel

In recent years, speech generation technology has advanced rapidly, fueled by generative models and large-scale training techniques. While these developments have enabled the production of high-quality synthetic speech, they have also…

Computation and Language · Computer Science 2024-09-18 Peizhuo Liu , Li Wang , Renqiang He , Haorui He , Lei Wang , Huadi Zheng , Jie Shi , Tong Xiao , Zhizheng Wu

Objects make unique sounds under different perturbations, environment conditions, and poses relative to the listener. While prior works have modeled impact sounds and sound propagation in simulation, we lack a standard dataset of impact…

Sound · Computer Science 2023-06-19 Samuel Clarke , Ruohan Gao , Mason Wang , Mark Rau , Julia Xu , Jui-Hsien Wang , Doug L. James , Jiajun Wu

Recent advances in foundation models have enabled audio-generative models that produce high-fidelity sounds associated with music, events, and human actions. Despite the success achieved in modern audio-generative models, the conventional…

Sound · Computer Science 2024-08-30 Tiantian Feng , Dimitrios Dimitriadis , Shrikanth Narayanan

Machine listening systems often rely on fixed taxonomies to organize and label audio data, key for training and evaluating deep neural networks (DNNs) and other supervised algorithms. However, such taxonomies face significant constraints:…

Sound · Computer Science 2024-09-19 Paraskevas Stamatiadis , Michel Olvera , Slim Essid

To assist in the development of machine learning methods for automated classification of spectroscopic data, we have generated a universal synthetic dataset that can be used for model validation. This dataset contains artificial spectra…

Machine Learning · Computer Science 2022-06-15 Jan Schuetzke , Nathan J. Szymanski , Markus Reischl

Recently, there has been an increasing interest in neural speech synthesis. While the deep neural network achieves the state-of-the-art result in text-to-speech (TTS) tasks, how to generate a more emotional and more expressive speech is…

Computation and Language · Computer Science 2021-06-24 Chenye Cui , Yi Ren , Jinglin Liu , Feiyang Chen , Rongjie Huang , Ming Lei , Zhou Zhao

Synthetic datasets are widely used in many applications, such as missing data imputation, examining non-stationary scenarios, in simulations, training data-driven models, and analyzing system robustness. Typically, synthetic data are based…

Methodology · Statistics 2025-02-05 Ofek Aloni , Gal Perelman , Barak Fishbain

Mapping words into a fixed-dimensional vector space is the backbone of modern NLP. While most word embedding methods successfully encode semantic information, they overlook phonetic information that is crucial for many tasks. We develop…

Computation and Language · Computer Science 2024-03-27 Vilém Zouhar , Kalvin Chang , Chenxuan Cui , Nathaniel Carlson , Nathaniel Robinson , Mrinmaya Sachan , David Mortensen

A sound field synthesis method enhancing perceptual quality is proposed. Sound field synthesis using multiple loudspeakers enables spatial audio reproduction with a broad listening area; however, synthesis errors at high frequencies called…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-27 Keisuke Kimura , Shoichi Koyama , Hiroshi Saruwatari

Synthesising 3D facial motion from speech is a crucial problem manifesting in a multitude of applications such as computer games and movies. Recently proposed methods tackle this problem in controlled conditions of speech. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Panagiotis Tzirakis , Athanasios Papaioannou , Alexander Lattas , Michail Tarasiou , Björn Schuller , Stefanos Zafeiriou

Spoken Keyword Spotting (KWS) is the task of distinguishing between the presence and absence of a keyword in audio. The accuracy of a KWS model hinges on its ability to correctly classify examples close to the keyword and non-keyword…

Sound · Computer Science 2026-02-06 Harry Zhang , Kurt Partridge , Pai Zhu , Neng Chen , Hyun Jin Park , Dhruuv Agarwal , Quan Wang