English
Related papers

Related papers: A New Dataset for Amateur Vocal Percussion Analysi…

200 papers

This paper addresses the task of counting human actions of interest using sensor data from wearable devices. We propose a novel exemplar-based framework, allowing users to provide exemplars of the actions they want to count by vocalizing…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Yifeng Huang , Duc Duy Nguyen , Lam Nguyen , Cuong Pham , Minh Hoai

Imitation learning field requires expert data to train agents in a task. Most often, this learning approach suffers from the absence of available data, which results in techniques being tested on its dataset. Creating datasets is a…

Machine Learning · Computer Science 2024-03-04 Nathan Gavenski , Michael Luck , Odinaldo Rodrigues

Many datasets have been designed to further the development of fake audio detection. However, fake utterances in previous datasets are mostly generated by altering timbre, prosody, linguistic content or channel noise of original audio.…

We present a novel neural encoder system for acoustic-to-articulatory inversion. We leverage the Pink Trombone voice synthesizer that reveals articulatory parameters (e.g tongue position and vocal cord configuration). Our system is designed…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-21 Mateo Cámara , Fernando Marcos , José Luis Blanco

The advancements of AI-synthesized human voices have introduced a growing threat of impersonation and disinformation. It is therefore of practical importance to developdetection methods for synthetic human voices. This work proposes a new…

Sound · Computer Science 2023-04-28 Chengzhe Sun , Shan Jia , Shuwei Hou , Ehab AlBadawy , Siwei Lyu

Recent advancements in audio-visual generative modeling have been propelled by progress in deep learning and the availability of data-rich benchmarks. However, the growth is not attributed solely to models and benchmarks. Universally…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Lucas Goncalves , Prashant Mathur , Chandrashekhar Lavania , Metehan Cekic , Marcello Federico , Kyu J. Han

Voice conversion (VC) has made progress in feature disentanglement, but it is still difficult to balance timbre and content information. This paper evaluates the pre-trained model features commonly used in voice conversion, and proposes an…

Sound · Computer Science 2025-04-09 Wenyu Wang , Yiquan Zhou , Jihua Zhu , Hongwu Ding , Jiacheng Xu , Shihao Li

A common problem for automatic speech recognition systems is how to recognize words that they did not see during training. Currently there is no established method of evaluating different techniques for tackling this problem. We propose…

Computation and Language · Computer Science 2021-07-20 Rudolf A. Braun , Srikanth Madikeri , Petr Motlicek

Automatic speech recognition systems have created exciting possibilities for applications, however they also enable opportunities for systematic eavesdropping. We propose a method to camouflage a person's voice over-the-air from these…

Sound · Computer Science 2022-02-18 Mia Chiquier , Chengzhi Mao , Carl Vondrick

This paper presents a new voice impersonation attack using voice conversion (VC). Enrolling personal voices for automatic speaker verification (ASV) offers natural and flexible biometric authentication systems. Basically, the ASV systems do…

Sound · Computer Science 2019-08-06 Taiki Nakamura , Yuki Saito , Shinnosuke Takamichi , Yusuke Ijima , Hiroshi Saruwatari

General audio understanding is a fundamental goal for large audio-language models, with audio captioning serving as a cornerstone task for their development. However, progress in this domain is hindered by existing datasets, which lack the…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-26 Yadong Niu , Tianzi Wang , Heinrich Dinkel , Xingwei Sun , Jiahao Zhou , Gang Li , Jizhong Liu , Junbo Zhang , Jian Luan

A non-invasive method for the monitoring of heart activity can help to reduce the deaths caused by heart disorders such as stroke, arrhythmia and heart attack. The human voice can be considered as a biometric data that can be used for…

Sound · Computer Science 2016-08-15 Aibek Ryskaliyev , Sanzhar Askaruly , Alex Pappachen James

Automatic speaker verification (ASV) technology is recently finding its way to end-user applications for secure access to personal data, smart services or physical facilities. Similar to other biometric technologies, speaker verification is…

Sound · Computer Science 2016-09-16 Cemal Hanilci , Tomi Kinnunen , Md Sahidullah , Aleksandr Sizov

Personal Voice Activity Detection (PVAD) is crucial for identifying target speaker segments in the mixture, yet its performance heavily depends on the quality of speaker embeddings. A key practical limitation is the short enrollment…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-21 Fuyuan Feng , Wenbin Zhang , Yu Gao , Longting Xu , Xiaofeng Mou , Yi Xu

The Voice Conversion Challenge 2020 is the third edition under its flagship that promotes intra-lingual semiparallel and cross-lingual voice conversion (VC). While the primary evaluation of the challenge submissions was done through…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-09 Rohan Kumar Das , Tomi Kinnunen , Wen-Chin Huang , Zhenhua Ling , Junichi Yamagishi , Yi Zhao , Xiaohai Tian , Tomoki Toda

The rapid advancement of generative AI has made audio deepfakes increasingly indistinguishable from authentic human vocals, posing significant threats to persons-of-interest (POI) such as public figures. Current detection systems primarily…

Sound · Computer Science 2026-05-19 Jun Xue , Tong Zhang , Zhuolin Yi , Yihuan Huang , Yi Chai , Yiyang Zhang , Yanzhen Ren

This paper introduces a dataset for training and evaluating methods for 6D pose estimation of hand-held tools in task demonstrations captured by a standard RGB camera. Despite the significant progress of 6D pose estimation methods, their…

Audio captioning is a novel field of multi-modal translation and it is the task of creating a textual description of the content of an audio signal (e.g. "people talking in a big room"). The creation of a dataset for this task requires a…

Sound · Computer Science 2019-07-23 Samuel Lipping , Konstantinos Drossos , Tuomas Virtanen

Deep learning-based works for singing voice separation have performed exceptionally well in the recent past. However, most of these works do not focus on allowing users to interact with the model to improve performance. This can be crucial…

Sound · Computer Science 2025-12-03 Ankur Gupta , Anshul Rai , Archit Bansal , Vipul Arora

Replay attacks remain a critical vulnerability for automatic speaker verification systems, particularly in real-time voice assistant applications. In this work, we propose acoustic maps as a novel spatial feature representation for replay…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-21 Michael Neri , Tuomas Virtanen