中文
相关论文

相关论文: HierCon: Hierarchical Contrastive Attention for Au…

200 篇论文

With recent advances in speech synthesis including text-to-speech (TTS) and voice conversion (VC) systems enabling the generation of ultra-realistic audio deepfakes, there is growing concern about their potential misuse. However, most…

声音 · 计算机科学 2024-04-24 Zuheng Kang , Yayun He , Botao Zhao , Xiaoyang Qu , Junqing Peng , Jing Xiao , Jianzong Wang

Neural audio codecs discretize speech via residual vector quantization (RVQ), forming a coarse-to-fine hierarchy across quantizers. While codec models have been explored for representation learning, their discrete structure remains…

声音 · 计算机科学 2026-03-19 Jinyang Wu , Zihan Pan , Qiquan Zhang , Sailor Hardik Bhupendra , Soumik Mondal

Speaker verification systems have seen significant advancements with the introduction of Multi-scale Feature Aggregation (MFA) architectures, such as MFA-Conformer and ECAPA-TDNN. These models leverage information from various network…

声音 · 计算机科学 2024-10-08 Satvik Dixit , Massa Baali , Rita Singh , Bhiksha Raj

With the rise in manipulated media, deepfake detection has become an imperative task for preserving the authenticity of digital content. In this paper, we present a novel multi-modal audio-video framework designed to concurrently process…

计算机视觉与模式识别 · 计算机科学 2023-09-14 Aaditya Kharel , Manas Paranjape , Aniket Bera

The rapid advancement of deepfake technology poses a significant threat to digital media integrity. Deepfakes, synthetic media created using AI, can convincingly alter videos and audio to misrepresent reality. This creates risks of…

计算机视觉与模式识别 · 计算机科学 2024-10-21 Kashish Gandhi , Prutha Kulkarni , Taran Shah , Piyush Chaudhari , Meera Narvekar , Kranti Ghag

Deepfake detection is crucial for curbing the harm it causes to society. However, current Deepfake detection methods fail to thoroughly explore artifact information across different domains due to insufficient intrinsic interactions. These…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Xueqi Qiu , Xingyu Miao , Fan Wan , Haoran Duan , Tejal Shah , Varun Ojhab , Yang Longa , Rajiv Ranjan

Recent advances in synthetic speech have made audio deepfakes increasingly realistic, posing significant security risks. Existing detection methods that rely on a single modality, either raw waveform embeddings or spectral based features,…

AI-generated speech is becoming increasingly used in everyday life, powering virtual assistants, accessibility tools, and other applications. However, it is also being exploited for malicious purposes such as impersonation, misinformation,…

声音 · 计算机科学 2025-09-23 Viola Negroni , Davide Salvi , Alessandro Ilic Mezza , Paolo Bestagini , Stefano Tubaro

Neural codec language models enable high-quality discrete speech synthesis, yet their inference remains vulnerable to token-level artifacts and distributional drift that degrade perceptual realism. Rather than relying on preference…

声音 · 计算机科学 2026-04-14 Junchuan Zhao , Minh Duc Vu , Ye Wang

Current text-to-speech algorithms produce realistic fakes of human voices, making deepfake detection a much-needed area of research. While researchers have presented various techniques for detecting audio spoofs, it is often unclear exactly…

Deepfake (DF) audio detectors still struggle to generalize to out of distribution inputs. A central reason is spectral bias, the tendency of neural networks to learn low-frequency structure before high-frequency (HF) details, which both…

声音 · 计算机科学 2025-11-27 Ido Nitzan HIdekel , Gal lifshitz , Khen Cohen , Dan Raviv

The growing prevalence of real-world deepfakes presents a critical challenge for existing detection systems, which are often evaluated on datasets collected just for scientific purposes. To address this gap, we introduce a novel dataset of…

音频与语音处理 · 电气工程与系统科学 2025-09-30 David Combei , Adriana Stan , Dan Oneata , Nicolas Müller , Horia Cucu

Recent advances in Text-to-Speech (TTS) and Voice-Conversion (VC) using generative Artificial Intelligence (AI) technology have made it possible to generate high-quality and realistic human-like audio. This poses growing challenges in…

声音 · 计算机科学 2025-03-25 Xiang Li , Pin-Yu Chen , Wenqi Wei

This paper describes a submission to the Environment-Aware Speech and Sound Deepfake Detection Challenge (ESDD2) 2026, which addresses component-level deepfake detection using the CompSpoofV2 dataset, where speech and environmental sounds…

声音 · 计算机科学 2026-05-06 Khalid Zaman , Qixuan Huang , Muhammad Uzair , Masashi Unoki

The rapid evolution of deep generative models poses a critical challenge to deepfake detection, as detectors trained on forgery-specific artifacts often suffer significant performance degradation when encountering unseen forgeries. While…

计算机视觉与模式识别 · 计算机科学 2025-04-25 Mengyu Qiao , Runze Tian , Yang Wang

Recently, there has been a significant advancement in designing Self-Supervised Learning (SSL) frameworks for time series data to reduce the dependency on data labels. Among these works, hierarchical contrastive learning-based SSL…

机器学习 · 计算机科学 2025-02-18 Kevin Garcia , Juan Manuel Perez , Yifeng Gao

For nearly a decade, deepfake detection has been framed as a classification task: given an audio or video clip, decide whether it is real or synthetic. Top detectors often report high accuracy on standard benchmarks; however, performance…

计算机与社会 · 计算机科学 2026-05-12 Jessee Ho , Shweta Khushu , Shaina Raza

Pioneering advancements in artificial intelligence, especially in genAI, have enabled significant possibilities for content creation, but also led to widespread misinformation and false content. The growing sophistication and realism of…

人工智能 · 计算机科学 2024-11-14 Dinesh Srivasthav P , Badri Narayan Subudhi

Deepfakes are AI-synthesized multimedia data that may be abused for spreading misinformation. Deepfake generation involves both visual and audio manipulation. To detect audio-visual deepfakes, previous studies commonly employ two relatively…

声音 · 计算机科学 2025-06-10 Kuiyuan Zhang , Wenjie Pei , Rushi Lan , Yifang Guo , Zhongyun Hua

Advances in AIGC technologies have enabled the synthesis of highly realistic audio deepfakes capable of deceiving human auditory perception. Although numerous audio deepfake detection (ADD) methods have been developed, most rely on local…

声音 · 计算机科学 2026-02-06 Qing Wen , Haohao Li , Zhongjie Ba , Peng Cheng , Miao He , Li Lu , Kui Ren