English
Related papers

Related papers: Frame-to-Utterance Convergence: A Spectra-Temporal…

200 papers

Audio deepfake detection is well-studied as a binary problem, but partially manipulated speech, where a short synthesised segment is spliced into an otherwise genuine utterance, poses a harder and more realistic threat. Detecting such…

Sound · Computer Science 2026-05-29 S. Sutharya , Remya K. Sasi

Autonomous Vehicles (AVs) increasingly depend on Multi-Sensor Fusion (MSF) to combine complementary modalities such as cameras and LiDAR for robust perception. While this redundancy is intended to safeguard against single-sensor failures,…

Cryptography and Security · Computer Science 2026-04-24 Shahriar Rahman Khan , Raiful Hasan

Recent advancements have highlighted the efficacy of self-supervised learning (SSL) features in various speech-related tasks, providing lightweight and versatile multi-view speech representations. However, our study reveals that while SSL…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-15 Weiqiao Shan , Yuhao Zhang , Yuchen Han , Bei Li , Xiaofeng Zhao , Yuang Li , Min Zhang , Hao Yang , Tong Xiao , Jingbo Zhu

Many endeavors have sought to develop countermeasure techniques as enhancements on Automatic Speaker Verification (ASV) systems, in order to make them more robust against spoof attacks. As evidenced by the latest ASVspoof 2019…

Sound · Computer Science 2021-09-21 Amir Mohammad Rostami , Mohammad Mehdi Homayounpour , Ahmad Nickabadi

In this paper, we propose a deep learning based system for the task of deepfake audio detection. In particular, the draw input audio is first transformed into various spectrograms using three transformation methods of Short-time Fourier…

Sound · Computer Science 2024-07-03 Lam Pham , Phat Lam , Truong Nguyen , Huyen Nguyen , Alexander Schindler

In this study, we concentrate on replacing the process of extracting hand-crafted acoustic feature with end-to-end DNN using complementary high-resolution spectrograms. As a result of advance in audio devices, typical characteristics of a…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-18 Jee-weon Jung , Hye-jin Shim , Hee-Soo Heo , Ha-Jin Yu

Generative audio technologies now enable highly realistic voice cloning and real-time voice conversion, increasing the risk of impersonation, fraud, and misinformation in communication channels such as phone and video calls. This study…

Sound · Computer Science 2026-01-09 Prajwal Chinchmalatpure , Suyash Chinchmalatpure , Siddharth Chavan

Consecutive frames in a video contain redundancy, but they may also contain relevant complementary information for the detection task. The objective of our work is to leverage this complementary information to improve detection. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Noreen Anwar , Guillaume-Alexandre Bilodeau , Wassim Bouachir

Different machines can exhibit diverse frequency patterns in their emitted sound. This feature has been recently explored in anomaly sound detection and reached state-of-the-art performance. However, existing methods rely on the manual or…

Sound · Computer Science 2023-09-07 Hejing Zhang , Jian Guan , Qiaoxi Zhu , Feiyang Xiao , Youde Liu

With rapid advances in audio-visual generative models, reliable forgery detection becomes increasingly critical. Existing methods for audio-visual deepfake detection typically rely on cross-modal inconsistencies. In singing, rhythmic…

Artificial Intelligence · Computer Science 2026-05-28 Ke Liu , Jiwei Wei , Wenyu Zhang , Shuchang Zhou , Ruikun Chai , Yutao Dai , Chaoning Zhang , Yang Yang

The rapid advancement of spoofing algorithms necessitates the development of robust detection methods capable of accurately identifying emerging fake audio. Traditional approaches, such as finetuning on new datasets containing these novel…

Sound · Computer Science 2023-06-16 Xiaohui Zhang , Jiangyan Yi , Jianhua Tao , Chenlong Wang , Le Xu , Ruibo Fu

Despite the rapid progress of automatic speech recognition (ASR) technologies targeting normal speech in recent decades, accurate recognition of dysarthric and elderly speech remains highly challenging tasks to date. Sources of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-18 Mengzhe Geng , Xurong Xie , Zi Ye , Tianzi Wang , Guinan Li , Shujie Hu , Xunying Liu , Helen Meng

Deep learning has brought impressive progress in the study of both automatic speaker verification (ASV) and spoofing countermeasures (CM). Although solutions are mutually dependent, they have typically evolved as standalone sub-systems…

The rapid advancement of speech synthesis and voice conversion technologies has raised significant security concerns in multimedia forensics. Although current detection models demonstrate impressive performance, they struggle to maintain…

Sound · Computer Science 2025-11-26 Wangjie Li , Lin Li , Qingyang Hong

This paper describes our DKU-OPPO system for the 2022 Spoofing-Aware Speaker Verification (SASV) Challenge. First, we split the joint task into speaker verification (SV) and spoofing countermeasure (CM), these two tasks which are optimized…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-18 Xingming Wang , Xiaoyi Qin , Yikang Wang , Yunfei Xu , Ming Li

We introduce a deepfake video detection approach that exploits pixel-wise temporal inconsistencies, which traditional spatial frequency-based detectors often overlook. Traditional detectors represent temporal information merely by stacking…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Taehoon Kim , Jongwook Choi , Yonghyun Jeong , Haeun Noh , Jaejun Yoo , Seungryul Baek , Jongwon Choi

In this paper, we present UR-AIR system submission to the logical access (LA) and the speech deepfake (DF) tracks of the ASVspoof 2021 Challenge. The LA and DF tasks focus on synthetic speech detection (SSD), i.e. detecting text-to-speech…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-05 Xinhui Chen , You Zhang , Ge Zhu , Zhiyao Duan

A number of studies have successfully developed speaker verification or presentation attack detection systems. However, studies integrating the two tasks remain in the preliminary stages. In this paper, we propose two approaches for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-29 Hye-jin Shim , Jee-weon Jung , Ju-ho Kim , Seung-bin Kim , Ha-Jin Yu

We propose an explainable probabilistic framework for characterizing spoofed speech by decomposing it into probabilistic attribute embeddings. Unlike raw high-dimensional countermeasure embeddings, which lack interpretability, the proposed…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Jagabandhu Mishra , Manasi Chhibber , Hye-jin Shim , Tomi H. Kinnunen

Artefacts that differentiate spoofed from bona-fide utterances can reside in spectral or temporal domains. Their reliable detection usually depends upon computationally demanding ensemble systems where each subsystem is tuned to some…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-05 Jee-weon Jung , Hee-Soo Heo , Hemlata Tak , Hye-jin Shim , Joon Son Chung , Bong-Jin Lee , Ha-Jin Yu , Nicholas Evans