English
Related papers

Related papers: RTCFake: Speech Deepfake Detection in Real-Time Co…

200 papers

This paper conducts a comprehensive layer-wise analysis of self-supervised learning (SSL) models for audio deepfake detection across diverse contexts, including multilingual datasets (English, Chinese, Spanish), partial, song, and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-10 Yassine El Kheir , Youness Samih , Suraj Maharjan , Tim Polzehl , Sebastian Möller

Deepfakes are major threats to the integrity of digital media. We propose DeiTFake, a DeiT-based transformer and a novel two-stage progressive training strategy with increasing augmentation complexity. The approach applies an initial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Saksham Kumar , Ashish Singh , Srinivasarao Thota , Sunil Kumar Singh , Chandan Kumar

This paper proposes a novel framework for audio deepfake detection with two main objectives: i) attaining the highest possible accuracy on available fake data, and ii) effectively performing continuous learning on new fake data in a…

Sound · Computer Science 2024-09-11 Tuan Duy Nguyen Le , Kah Kuan Teh , Huy Dat Tran

This paper describes a dataset and protocols for evaluating continuous speech separation algorithms. Most prior studies on speech separation use pre-segmented signals of artificially mixed speech utterances which are mostly \emph{fully}…

Sound · Computer Science 2020-05-08 Zhuo Chen , Takuya Yoshioka , Liang Lu , Tianyan Zhou , Zhong Meng , Yi Luo , Jian Wu , Xiong Xiao , Jinyu Li

This study introduces LENS-DF, a novel and comprehensive recipe for training and evaluating audio deepfake detection and temporal localization under complicated and realistic audio conditions. The generation part of the recipe outputs…

Sound · Computer Science 2025-07-25 Xuechen Liu , Wanying Ge , Xin Wang , Junichi Yamagishi

The proliferation of sophisticated generative models has significantly advanced the realism of synthetic facial content, known as deepfakes, raising serious concerns about digital trust. Although modern deep learning-based detectors perform…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Salar Adel Sabri , Ramadhan J. Mstafa

In recent years, large language models (LLMs) have achieved remarkable advancements in multimodal processing, including end-to-end speech-based language models that enable natural interactions and perform specific tasks in task-oriented…

Computation and Language · Computer Science 2025-08-15 Enzhi Wang , Qicheng Li , Shiwan Zhao , Aobo Kong , Jiaming Zhou , Xi Yang , Yequan Wang , Yonghua Lin , Yong Qin

This document provides a brief description of the National Institute of Standards and Technology (NIST) speaker recognition evaluation (SRE) conversational telephone speech (CTS) Superset. The CTS Superset has been created in an attempt to…

Sound · Computer Science 2021-08-17 Seyed Omid Sadjadi

This paper addresses the challenge of developing a robust audio-visual deepfake detection model. In practical use cases, new generation algorithms are continually emerging, and these algorithms are not encountered during the development of…

Sound · Computer Science 2024-08-20 Kyungbok Lee , You Zhang , Zhiyao Duan

Learning an effective speaker representation is crucial for achieving reliable performance in speaker verification tasks. Speech signals are high-dimensional, long, and variable-length sequences containing diverse information at each…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-25 Wei Xia , John H. L. Hansen

Deepfakes have emerged as a significant threat to digital media authenticity, increasing the need for advanced detection techniques that can identify subtle and time-dependent manipulations. CNNs are effective at capturing spatial artifacts…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Aryan Thakre , Omkar Nagwekar , Vedang Talekar , Aparna Santra Biswas

Deepfakes have become a growing concern in recent years, prompting researchers to develop benchmark datasets and detection algorithms to tackle the issue. However, existing datasets suffer from significant drawbacks that hamper their…

Computers and Society · Computer Science 2023-09-07 Beomsang Cho , Binh M. Le , Jiwon Kim , Simon Woo , Shahroz Tariq , Alsharif Abuadbba , Kristen Moore

Neural speech synthesis techniques have enabled highly realistic speech deepfakes, posing major security risks. Speech deepfake detection is challenging due to distribution shifts across spoofing methods and variability in speakers,…

Sound · Computer Science 2025-09-30 Pu Huang , Shouguang Wang , Siya Yao , Mengchu Zhou

Long-context understanding poses significant challenges in natural language processing, particularly for real-world dialogues characterized by speech-based elements, high redundancy, and uneven information density. Although large language…

Computation and Language · Computer Science 2025-04-25 Yongxuan Wu , Runyu Chen , Peiyu Liu , Hongjin Qian

Modern speaker recognition system relies on abundant and balanced datasets for classification training. However, diverse defective datasets, such as partially-labelled, small-scale, and imbalanced datasets, are common in real-world…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Ruijie Tao , Zhan Shi , Yidi Jiang , Tianchi Liu , Haizhou Li

Easy access to audio-visual content on social media, combined with the availability of modern tools such as Tensorflow or Keras, open-source trained models, and economical computing infrastructure, and the rapid evolution of deep-learning…

Cryptography and Security · Computer Science 2021-11-24 Momina Masood , Marriam Nawaz , Khalid Mahmood Malik , Ali Javed , Aun Irtaza

Deep-learning based methods have shown their advantages in audio coding over traditional ones but limited attention has been paid on real-time communications (RTC). This paper proposes the TFNet, an end-to-end neural speech codec with low…

Sound · Computer Science 2022-02-16 Xue Jiang , Xiulian Peng , Chengyu Zheng , Huaying Xue , Yuan Zhang , Yan Lu

Audio deepfakes pose a growing threat, already exploited in fraud and misinformation. A key challenge is ensuring detectors remain robust to unseen synthesis methods and diverse speakers, since generation techniques evolve quickly. Despite…

Sound · Computer Science 2025-10-28 Jiyoung Hong , Yoonseo Chung , Seungyeon Oh , Juntae Kim , Jiyoung Lee , Sookyung Kim , Hyunsoo Cho

The development of powerful deep learning technologies has brought about some negative effects to both society and individuals. One such issue is the emergence of fake media. To tackle the issue, we have organized the Trusted Media…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Weiling Chen , Sheng Lun Benjamin Chua , Stefan Winkler , See-Kiong Ng

The convolutional neural network (CNN) based approaches have shown great success for speaker verification (SV) tasks, where modeling long temporal context and reducing information loss of speaker characteristics are two important challenges…

Sound · Computer Science 2021-08-31 Yanfeng Wu , Chenkai Guo , Junan Zhao , Xiao Jin , Jing Xu