中文
相关论文

相关论文: Evolutionary Multi-Objective Fusion of Deepfake Sp…

200 篇论文

Modern speaker verification (SV) systems typically demand expensive storage and computing resources, thereby hindering their deployment on mobile devices. In this paper, we explore adaptive neural network quantization for lightweight…

音频与语音处理 · 电气工程与系统科学 2024-12-03 Bei Liu , Haoyu Wang , Yanmin Qian

Self-supervised learning (SSL) speech representation models, trained on large speech corpora, have demonstrated effectiveness in extracting hierarchical speech embeddings through multiple transformer layers. However, the behavior of these…

计算与语言 · 计算机科学 2024-06-18 Zihan Pan , Tianchi Liu , Hardik B. Sailor , Qiongqiong Wang

Audio deepfake detection (ADD) is crucial to combat the misuse of speech synthesized from generative AI models. Existing ADD models suffer from generalization issues, with a large performance discrepancy between in-domain and out-of-domain…

声音 · 计算机科学 2024-07-29 Yi Zhu , Surya Koppisetti , Trang Tran , Gaurav Bharaj

We introduce EffiFusion-GAN (Efficient Fusion Generative Adversarial Network), a lightweight yet powerful model for speech enhancement. The model integrates depthwise separable convolutions within a multi-scale block to capture diverse…

声音 · 计算机科学 2025-08-21 Bin Wen , Tien-Ping Tan

The performance of speech spoofing detection often varies across different training and evaluation corpora. Leveraging multiple corpora typically enhances robustness and performance in fields like speaker recognition and speech recognition.…

机器学习 · 计算机科学 2026-03-20 Anh-Tuan Dao , Driss Matrouf , Mickael Rouvier , Nicholas Evans

With rapid advances in audio-visual generative models, reliable forgery detection becomes increasingly critical. Existing methods for audio-visual deepfake detection typically rely on cross-modal inconsistencies. In singing, rhythmic…

人工智能 · 计算机科学 2026-05-28 Ke Liu , Jiwei Wei , Wenyu Zhang , Shuchang Zhou , Ruikun Chai , Yutao Dai , Chaoning Zhang , Yang Yang

The spoofing-aware speaker verification (SASV) challenge was designed to promote the study of jointly-optimised solutions to accomplish the traditionally separately-optimised tasks of spoofing detection and speaker verification.…

音频与语音处理 · 电气工程与系统科学 2022-10-10 Wanying Ge , Hemlata Tak , Massimiliano Todisco , Nicholas Evans

With diverse presentation forgery methods emerging continually, detecting the authenticity of images has drawn growing attention. Although existing methods have achieved impressive accuracy in training dataset detection, they still perform…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Yingxin Lai , Guoqing Yang Yifan He , Zhiming Luo , Shaozi Li

In this work, we address EmoFake Detection (EFD). We hypothesize that multilingual speech foundation models (SFMs) will be particularly effective for EFD due to their pre-training across diverse languages, enabling a nuanced understanding…

音频与语音处理 · 电气工程与系统科学 2025-07-18 Orchid Chetia Phukan , Mohd Mujtaba Akhtar , Girish , Arun Balaji Buduru

The objective of automatic speaker verification (ASV) systems is to determine whether a given test speech utterance corresponds to a claimed enrolled speaker. These systems have a wide range of applications, and ensuring their reliability…

音频与语音处理 · 电气工程与系统科学 2025-05-27 Amro Asali , Yehuda Ben-Shimol , Itshak Lapidot

Speech-based assessment of the schizophrenia spectrum has been widely researched over in the recent past. In this study, we develop a deep learning framework to estimate schizophrenia severity scores from speech using a feature fusion…

音频与语音处理 · 电气工程与系统科学 2024-11-21 Gowtham Premananth , Carol Espy-Wilson

We propose an end-to-end joint optimization framework of a multi-channel neural speech extraction and deep acoustic model without mel-filterbank (FBANK) extraction for overlapped speech recognition. First, based on a multi-channel…

音频与语音处理 · 电气工程与系统科学 2019-10-31 Bo Wu , Meng Yu , Lianwu Chen , Chao Weng , Dan Su , Dong Yu

Audio deepfake detection is crucial to combat the malicious use of AI-synthesized speech. Among many efforts undertaken by the community, the ASVspoof challenge has become one of the benchmarks to evaluate the generalizability and…

音频与语音处理 · 电气工程与系统科学 2024-10-11 Yi Zhu , Chirag Goel , Surya Koppisetti , Trang Tran , Ankur Kumar , Gaurav Bharaj

In this paper, two multi-objective optimization frameworks in two variants (i.e., NSGA-III-ARM-V1, NSGA-III-ARM-V2; and MOEAD-ARM-V1, MOEAD-ARM-V2) are proposed to find association rules from transactional datasets. The first framework uses…

神经与进化计算 · 计算机科学 2020-03-23 Shaik Tanveer Ul Huq , Vadlamani Ravi

Modern face recognition systems remain vulnerable to spoofing attempts, including both physical presentation attacks and digital forgeries. Traditionally, these two attack vectors have been handled by separate models, each targeting its own…

计算机视觉与模式识别 · 计算机科学 2025-08-22 Andrei Balykin , Anvar Ganiev , Denis Kondranin , Kirill Polevoda , Nikolai Liudkevich , Artem Petrov

Recently, Transformer-based encoder-decoder models have demonstrated strong performance in multilingual speech recognition. However, the decoder's autoregressive nature and large size introduce significant bottlenecks during inference.…

音频与语音处理 · 电气工程与系统科学 2025-08-28 Yunkyu Lim , Jihwan Park , Hyung Yong Kim , Hanbin Lee , Byeong-Yeol Kim

We address the challenge of detecting synthesized speech under distribution shifts -- arising from unseen synthesis methods, speakers, languages, or audio conditions -- relative to the training data. Few-shot learning methods are a…

音频与语音处理 · 电气工程与系统科学 2025-08-20 Ashi Garg , Zexin Cai , Henry Li Xinyuan , Leibny Paola García-Perera , Kevin Duh , Sanjeev Khudanpur , Matthew Wiesner , Nicholas Andrews

Audio-visual speech enhancement system is regarded as one of promising solutions for isolating and enhancing speech of desired speaker. Typical methods focus on predicting clean speech spectrum via a naive convolution neural network based…

音频与语音处理 · 电气工程与系统科学 2022-07-01 Xinmeng Xu , Yang Wang , Jie Jia , Binbin Chen , Dejun Li

Target speaker extraction, which aims at extracting a target speaker's voice from a mixture of voices using audio, visual or locational clues, has received much interest. Recently an audio-visual target speaker extraction has been proposed…

音频与语音处理 · 电气工程与系统科学 2021-02-03 Hiroshi Sato , Tsubasa Ochiai , Keisuke Kinoshita , Marc Delcroix , Tomohiro Nakatani , Shoko Araki

End-to-end approaches to anti-spoofing, especially those which operate directly upon the raw signal, are starting to be competitive with their more traditional counterparts. Until recently, all such approaches consider only the learning of…

音频与语音处理 · 电气工程与系统科学 2021-10-07 Wanying Ge , Jose Patino , Massimiliano Todisco , Nicholas Evans