English
Related papers

Related papers: AT-ADD: All-Type Audio Deepfake Detection Challeng…

200 papers

The proliferation of multimedia content on social media platforms has dramatically transformed how information is consumed and disseminated. While this shift enables real-time coverage of global events, it also facilitates the rapid spread…

We propose a dataset, AVASpeech-SMAD, to assist speech and music activity detection research. With frame-level music labels, the proposed dataset extends the existing AVASpeech dataset, which originally consists of 45 hours of audio and…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-03 Yun-Ning Hung , Karn N. Watcharasupat , Chih-Wei Wu , Iroro Orife , Kelian Li , Pavan Seshadri , Junyoung Lee

Recent advances in AI-generated voices have intensified the challenge of detecting deepfake audio, posing risks for scams and the spread of disinformation. To tackle this issue, we establish the largest public voice dataset to date, named…

In recent years, self-supervised learning (SSL) models have made significant progress in audio deepfake detection (ADD) tasks. However, existing SSL models mainly rely on large-scale real speech for pre-training and lack the learning of…

Sound · Computer Science 2025-09-05 Yunqi Hao , Yihao Chen , Minqiang Xu , Jianbo Zhan , Liang He , Lei Fang , Sian Fang , Lin Liu

The availability of smart devices leads to an exponential increase in multimedia content. However, advancements in deep learning have also enabled the creation of highly sophisticated Deepfake content, including speech Deepfakes, which pose…

Sound · Computer Science 2025-07-16 Menglu Li , Yasaman Ahmadiadli , Xiao-Ping Zhang

Diverse promising datasets have been designed to hold back the development of fake audio detection, such as ASVspoof databases. However, previous datasets ignore an attacking situation, in which the hacker hides some small fake clips in…

Sound · Computer Science 2023-12-19 Jiangyan Yi , Ye Bai , Jianhua Tao , Haoxin Ma , Zhengkun Tian , Chenglong Wang , Tao Wang , Ruibo Fu

This technical report describes Chung-Ang University and Korea University (CAU_KU) team's model participating in the Audio Deep Synthesis Detection (ADD) 2022 Challenge, track 1: Low-quality fake audio detection. For track 1, we propose a…

Sound · Computer Science 2022-02-10 Il-Youp Kwak , Sunmook Choi , Jonghoon Yang , Yerin Lee , Seungsang Oh

This paper presents an overview and the technical framework of the ICME 2026 Grand Challenge on Academic Text-to-Music Generation (ATTM). Despite the rapid progress in text-to-music generation (TTM) systems, the field is currently dominated…

Sound · Computer Science 2026-05-22 Fang-Chih Hsieh , Wei-Jaw Lee , Chun-Ping Wang , Hung-yi Lee , Hao-Wen Dong , Yi-Hsuan Yang

In this paper, we introduce ASDKit, a toolkit for anomalous sound detection (ASD) task. Our aim is to facilitate ASD research by providing an open-source framework that collects and carefully evaluates various ASD methods. First, ASDKit…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-15 Takuya Fujimura , Kevin Wilkinghoff , Keisuke Imoto , Tomoki Toda

With the proliferation of deepfake audio, there is an urgent need to investigate their attribution. Current source tracing methods can effectively distinguish in-distribution (ID) categories. However, the rapid evolution of deepfake…

Sound · Computer Science 2024-06-11 Yuankun Xie , Ruibo Fu , Zhengqi Wen , Zhiyong Wang , Xiaopeng Wang , Haonnan Cheng , Long Ye , Jianhua Tao

Deepfake speech detection systems are often limited to binary classification tasks and struggle to generate interpretable reasoning or provide context-rich explanations for their decisions. These models primarily extract latent embeddings…

Sound · Computer Science 2026-04-01 Runkun Chen , Yixiong Fang , Pengyu Chang , Yuante Li , Massa Baali , Bhiksha Raj

We introduce a novel, general-purpose audio generation framework specifically designed for anomaly detection and localization. Unlike existing datasets that predominantly focus on industrial and machine-related sounds, our framework focuses…

As speech generation technology advances, the risk of misuse through deepfake audio has become a pressing concern, which underscores the critical need for robust detection systems. However, many existing speech deepfake datasets are limited…

Sound · Computer Science 2025-07-30 Wen Huang , Yanmei Gu , Zhiming Wang , Huijia Zhu , Yanmin Qian

With the advancement of audio generation, generative models can produce highly realistic audios. However, the proliferation of deepfake general audio can pose negative consequences. Therefore, we propose a new task, deepfake general audio…

Sound · Computer Science 2024-06-13 Zeyu Xie , Baihan Li , Xuenan Xu , Zheng Liang , Kai Yu , Mengyue Wu

Large-scale multimodal generative modeling has created milestones in text-to-image and text-to-video generation. Its application to audio still lags behind for two main reasons: the lack of large-scale datasets with high-quality text-audio…

As deepfake speech becomes common and hard to detect, it is vital to trace its source. Recent work on audio deepfake source tracing (ST) aims to find the origins of synthetic or manipulated speech. However, ST models must adapt to learn new…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Yang Xiao , Rohan Kumar Das

Adding explanations to audio deepfake detection (ADD) models will boost their real-world application by providing insight on the decision making process. In this paper, we propose a relevancy-based explainable AI (XAI) method to analyze the…

Machine Learning · Computer Science 2025-06-10 Petr Grinberg , Ankur Kumar , Surya Koppisetti , Gaurav Bharaj

Multimodal large language models (MLLMs), which bridge the gap between audio-visual and natural language processing, achieve state-of-the-art performance on several audio-visual tasks. Despite the superior performance of MLLMs, the scarcity…

Cryptography and Security · Computer Science 2025-06-16 Jinming Wen , Xinyi Wu , Shuai Zhao , Yanhao Jia , Yuwen Li

Current state-of-the-art (SOTA) codec-based audio synthesis systems can mimic anyone's voice with just a 3-second sample from that specific unseen speaker. Unfortunately, malicious attackers may exploit these technologies, causing misuse…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Haibin Wu , Yuan Tseng , Hung-yi Lee

This paper reviews the state-of-the-art in deepfake generation and detection, focusing on modern deep learning technologies and tools based on the latest scientific advancements. The rise of deepfakes, leveraging techniques like Variational…

Cryptography and Security · Computer Science 2025-01-14 Arash Dehghani , Hossein Saberi