English
Related papers

Related papers: EmoFake: An Initial Dataset for Emotion Fake Audio…

200 papers

With the proliferation of Audio Language Model (ALM) based deepfake audio, there is an urgent need for generalized detection methods. ALM-based deepfake audio currently exhibits widespread, high deception, and type versatility, posing a…

This paper describes a submission to the Environment-Aware Speech and Sound Deepfake Detection Challenge (ESDD2) 2026, which addresses component-level deepfake detection using the CompSpoofV2 dataset, where speech and environmental sounds…

Sound · Computer Science 2026-05-06 Khalid Zaman , Qixuan Huang , Muhammad Uzair , Masashi Unoki

Significant advancements made in the generation of deepfakes have caused security and privacy issues. Attackers can easily impersonate a person's identity in an image by replacing his face with the target person's face. Moreover, a new…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Hasam Khalid , Minha Kim , Shahroz Tariq , Simon S. Woo

The existing fake audio detection systems often rely on expert experience to design the acoustic features or manually design the hyperparameters of the network structure. However, artificial adjustment of the parameters can have a…

Advancements in audio deepfake technology offers benefits like AI assistants, better accessibility for speech impairments, and enhanced entertainment. However, it also poses significant risks to security, privacy, and trust in digital…

Sound · Computer Science 2025-06-27 Abhay Kumar , Kunal Verma , Omkar More

The emergence of new spoofing attacks poses an increasing challenge to audio security. Current detection methods often falter when faced with unseen spoofing attacks. Traditional strategies, such as retraining with new data, are not always…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-16 Feiyi Dong , Qingchen Tang , Yichen Bai , Zihan Wang

The advances in generative AI have enabled the creation of synthetic audio which is perceptually indistinguishable from real, genuine audio. Although this stellar progress enables many positive applications, it also raises risks of misuse,…

Emotion is a critical component of artificial social intelligence. However, while current methods excel in lip synchronization and image quality, they often fail to generate accurate and controllable emotional expressions while preserving…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Wenqing Wang , Yun Fu

Generating emotion-specific talking head videos from audio input is an important and complex challenge for human-machine interaction. However, emotion is highly abstract concept with ambiguous boundaries, and it necessitates disentangled…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Xuli Shen , Hua Cai , Dingding Yu , Weilin Shen , Qing Xu , Xiangyang Xue

This paper reviews the state-of-the-art in deepfake generation and detection, focusing on modern deep learning technologies and tools based on the latest scientific advancements. The rise of deepfakes, leveraging techniques like Variational…

Cryptography and Security · Computer Science 2025-01-14 Arash Dehghani , Hossein Saberi

Text-to-Speech (TTS) and Voice Conversion (VC) models have exhibited remarkable performance in generating realistic and natural audio. However, their dark side, audio deepfake poses a significant threat to both society and individuals.…

Cryptography and Security · Computer Science 2024-09-17 Xinfeng Li , Kai Li , Yifan Zheng , Chen Yan , Xiaoyu Ji , Wenyuan Xu

With the rapid advancement of generative AI, multimodal deepfakes, which manipulate both audio and visual modalities, have drawn increasing public concern. Currently, deepfake detection has emerged as a crucial strategy in countering these…

Sound · Computer Science 2024-05-16 Yang Hou , Haitao Fu , Chuankai Chen , Zida Li , Haoyu Zhang , Jianjun Zhao

Effective human-AI interaction relies on AI's ability to accurately perceive and interpret human emotions. Current benchmarks for vision and vision-language models are severely limited, offering a narrow emotional spectrum that overlooks…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Christoph Schuhmann , Robert Kaczmarczyk , Gollam Rabby , Felix Friedrich , Maurice Kraus , Krishna Kalyan , Kourosh Nadi , Huu Nguyen , Kristian Kersting , Sören Auer

Recently, there has been an increasing interest in neural speech synthesis. While the deep neural network achieves the state-of-the-art result in text-to-speech (TTS) tasks, how to generate a more emotional and more expressive speech is…

Computation and Language · Computer Science 2021-06-24 Chenye Cui , Yi Ren , Jinglin Liu , Feiyang Chen , Rongjie Huang , Ming Lei , Zhou Zhao

Deception detection is an important task that has been a hot research topic due to its potential applications. It can be applied in many areas, from national security (e.g., airport security, jurisprudence, and law enforcement) to real-life…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jun-Teng Yang , Guei-Ming Liu , Scott C. -H Huang

While the technologies empowering malicious audio deepfakes have dramatically evolved in recent years due to generative AI advances, the same cannot be said of global research into spoofing (deepfake) countermeasures. This paper highlights…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-16 Héctor Delgado , Giorgio Ramondetti , Emanuele Dalmasso , Gennady Karvitsky , Daniele Colibro , Haydar Talib

Thanks to advancements in deep learning, speech generation systems now power a variety of real-world applications, such as text-to-speech for individuals with speech disorders, voice chatbots in call centers, cross-linguistic speech…

Speech-driven 3D face animation aims to generate realistic facial expressions that match the speech content and emotion. However, existing methods often neglect emotional facial expressions or fail to disentangle them from speech content.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Ziqiao Peng , Haoyu Wu , Zhenbo Song , Hao Xu , Xiangyu Zhu , Jun He , Hongyan Liu , Zhaoxin Fan

AI-generated speech is becoming increasingly used in everyday life, powering virtual assistants, accessibility tools, and other applications. However, it is also being exploited for malicious purposes such as impersonation, misinformation,…

Sound · Computer Science 2025-09-23 Viola Negroni , Davide Salvi , Alessandro Ilic Mezza , Paolo Bestagini , Stefano Tubaro

Deepfakes, synthetic media created using advanced AI techniques, pose a growing threat to information integrity, particularly in politically sensitive contexts. This challenge is amplified by the increasing realism of modern generative…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Victor Livernoche , Akshatha Arodi , Andreea Musulan , Zachary Yang , Adam Salvail , Gaétan Marceau Caron , Jean-François Godbout , Reihaneh Rabbany