English
Related papers

Related papers: RealMAN: A Real-Recorded and Annotated Microphone …

200 papers

The problem of synthetic speech detection has enjoyed considerable attention, with recent methods achieving low error rates across several established benchmarks. However, to what extent can low error rates on academic benchmarks translate…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-23 Ashi Garg , Zexin Cai , Lin Zhang , Henry Li Xinyuan , Leibny Paola García-Perera , Kevin Duh , Sanjeev Khudanpur , Matthew Wiesner , Nicholas Andrews

Replay attacks remain a critical vulnerability for automatic speaker verification systems, particularly in real-time voice assistant applications. In this work, we propose acoustic maps as a novel spatial feature representation for replay…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-21 Michael Neri , Tuomas Virtanen

Automating child speech analysis is crucial for applications such as neurocognitive assessments. Speaker diarization, which identifies ``who spoke when'', is an essential component of the automated analysis. However, publicly available…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-13 Anfeng Xu , Tiantian Feng , Helen Tager-Flusberg , Catherine Lord , Shrikanth Narayanan

This work introduces the Cleanformer, a streaming multichannel neural based enhancement frontend for automatic speech recognition (ASR). This model has a conformer-based architecture which takes as inputs a single channel each of raw and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-05 Joseph Caroselli , Arun Narayanan , Nathan Howard , Tom O'Malley

This report presents the Sony-TAu Realistic Spatial Soundscapes 2022 (STARS22) dataset for sound event localization and detection, comprised of spatial recordings of real scenes collected in various interiors of two different sites. The…

Audio deepfake detection (ADD) is essential for preventing the misuse of synthetic voices that may infringe on personal rights and privacy. Recent zero-shot text-to-speech (TTS) models pose higher risks as they can clone voices with a…

Sound · Computer Science 2024-09-23 Yuang Li , Min Zhang , Mengxin Ren , Miaomiao Ma , Daimeng Wei , Hao Yang

Recent advances in audio generation led to an increasing number of deepfakes, making the general public more vulnerable to financial scams, identity theft, and misinformation. Audio deepfake detectors promise to alleviate this issue, with…

We present a novel dataset for training and benchmarking semantic SLAM methods. The dataset consists of 200 long sequences, each one containing 3000-5000 data frames. We generate the sequences using realistic home layouts. For that we…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Pavel Kirsanov , Airat Gaskarov , Filipp Konokhov , Konstantin Sofiiuk , Anna Vorontsova , Igor Slinko , Dmitry Zhukov , Sergey Bykov , Olga Barinova , Anton Konushin

Code-switching, the alternation between two or more languages within communication, poses great challenges for Automatic Speech Recognition (ASR) systems. Existing models and datasets are limited in their ability to effectively handle these…

Sound · Computer Science 2025-11-14 Yupei Li , Zifan Wei , Heng Yu , Jiahao Xue , Huichi Zhou , Björn W. Schuller

In recent years, large language models (LLMs) have achieved remarkable advancements in multimodal processing, including end-to-end speech-based language models that enable natural interactions and perform specific tasks in task-oriented…

Computation and Language · Computer Science 2025-08-15 Enzhi Wang , Qicheng Li , Shiwan Zhao , Aobo Kong , Jiaming Zhou , Xi Yang , Yequan Wang , Yonghua Lin , Yong Qin

Neural TTS has shown it can generate high quality synthesized speech. In this paper, we investigate the multi-speaker latent space to improve neural TTS for adapting the system to new speakers with only several minutes of speech or…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-04 Yan Deng , Lei He , Frank Soong

This paper presents a novel approach for indoor acoustic source localization using microphone arrays and based on a Convolutional Neural Network (CNN). The proposed solution is, to the best of our knowledge, the first published work in…

Sound · Computer Science 2019-02-01 Juan Manuel Vera-Diaz , Daniel Pizarro , Javier Macias-Guarasa

The ICASSP 2022 Multi-channel Multi-party Meeting Transcription Grand Challenge (M2MeT) focuses on one of the most valuable and the most challenging scenarios of speech technologies. The M2MeT challenge has particularly set up two tracks,…

The presence of a corresponding talking face has been shown to significantly improve speech intelligibility in noisy conditions and for hearing impaired population. In this paper, we present a system that can generate landmark points of a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Sefik Emre Eskimez , Ross K Maddox , Chenliang Xu , Zhiyao Duan

With the rapid advancement of speech generation technologies, the threat posed by speech deepfakes in real-time communication (RTC) scenarios has intensified. However, existing detection studies mainly focus on offline simulations and…

Sound · Computer Science 2026-04-28 Jun Xue , Zhuolin Yi , Yihuan Huang , Yanzhen Ren , Yujie Chen , Cunhang Fan , Zicheng Su , Yonghong Zhang , Bo Cai

This paper describes the practical response- and performance-aware development of online speech enhancement for an augmented reality (AR) headset that helps a user understand conversations made in real noisy echoic environments (e.g.,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-18 Kouhei Sekiguchi , Aditya Arie Nugraha , Yicheng Du , Yoshiaki Bando , Mathieu Fontaine , Kazuyoshi Yoshii

The objective of this work is to develop a speaker recognition model to be used in diverse scenarios. We hypothesise that two components should be adequately configured to build such a model. First, adequate architecture would be required.…

This paper introduces the Extended Length Audio Dataset for Synthetic Voice Detection and Speaker Recognition (ELAD SVDSR), a resource specifically designed to facilitate the creation of high quality deepfakes and support the development of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-02 Rahul Vijaykumar , Ajan Ahmed , John Parker , Dinesh Pendyala , Aidan Collins , Stephanie Schuckers , Masudul H. Imtiaz

Recent breakthroughs in multi-talker ASR (MT-ASR) and speaker diarization (SD) rely on synthetic data to mitigate the scarcity of large-scale conversational recordings, yet the impact of specific simulation choices remains poorly…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-18 Alexander Polok , Ivan Medennikov , Jan Černocký , Shinji Watanabe , Lukáš Burget , Samuele Cornell

This paper describes a system that generates speaker-annotated transcripts of meetings by using a microphone array and a 360-degree camera. The hallmark of the system is its ability to handle overlapped speech, which has been an unsolved…