English
Related papers

Related papers: Multi-Granularity Adaptive Time-Frequency Attentio…

200 papers

Adversarial discriminative domain adaptation (ADDA) is an efficient framework for unsupervised domain adaptation in image classification, where the source and target domains are assumed to have the same classes, but no labels are available…

Computer Vision and Pattern Recognition · Computer Science 2019-11-12 Aaron Chadha , Yiannis Andreopoulos

Auditory attention detection (AAD) aims to detect the target speaker in a multi-talker environment from brain signals, such as electroencephalography (EEG), which has made great progress. However, most AAD methods solely utilize attention…

Human-Computer Interaction · Computer Science 2025-05-22 Lu Li , Cunhang Fan , Hongyu Zhang , Jingjing Zhang , Xiaoke Yang , Jian Zhou , Zhao Lv

Existing deepfake detectors face several challenges in achieving robustness and generalization. One of the primary reasons is their limited ability to extract relevant information from forgery videos, especially in the presence of various…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Zhiyuan Yan , Peng Sun , Yubo Lang , Shuo Du , Shanzhuo Zhang , Wei Wang , Lei Liu

In the digital age, the emergence of deepfakes and synthetic media presents a significant threat to societal and political integrity. Deepfakes based on multi-modal manipulation, such as audio-visual, are more realistic and pose a greater…

Sound · Computer Science 2024-08-08 Vinaya Sree Katamneni , Ajita Rattani

Audio-visual speech enhancement system is regarded to be one of promising solutions for isolating and enhancing speech of desired speaker. Conventional methods focus on predicting clean speech spectrum via a naive convolution neural network…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-28 Xinmeng Xu , Jianjun Hao

Domain adaptive detection aims to improve the generalization of detectors on target domain. To reduce discrepancy in feature distributions between two domains, recent approaches achieve domain adaption through feature alignment in different…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Libo Zhang , Wenzhang Zhou , Heng Fan , Tiejian Luo , Haibin Ling

We study test-time domain adaptation for audio deepfake detection (ADD), addressing three challenges: (i) source-target domain gaps, (ii) limited target dataset size, and (iii) high computational costs. We propose an ADD method using prompt…

Sound · Computer Science 2024-10-15 Hideyuki Oiso , Yuto Matsunaga , Kazuya Kakizaki , Taiki Miyagawa

Artefacts that serve to distinguish bona fide speech from spoofed or deepfake speech are known to reside in specific subbands and temporal segments. Various approaches can be used to capture and model such artefacts, however, none works…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-24 Hemlata Tak , Jee-weon Jung , Jose Patino , Madhu Kamble , Massimiliano Todisco , Nicholas Evans

Existing generative models for unsupervised anomalous sound detection are limited by their inability to fully capture the complex feature distribution of normal sounds, while the potential of powerful diffusion models in this domain remains…

Sound · Computer Science 2026-02-03 Chengyuan Ma , Peng Jia , Hongyue Guo , Wenming Yang

Current state-of-the-art dialogue systems heavily rely on extensive training datasets. However, challenges arise in domains where domain-specific training datasets are insufficient or entirely absent. To tackle this challenge, we propose a…

Computation and Language · Computer Science 2024-07-01 Yongkang Liu , Ercong Nie , Shi Feng , Zheng Hua , Zifeng Ding , Daling Wang , Yifei Zhang , Hinrich Schütze

The rise of AI-driven generative models has enabled the creation of highly realistic speech deepfakes - synthetic audio signals that can imitate target speakers' voices - raising critical security concerns. Existing methods for detecting…

Sound · Computer Science 2025-03-25 Emma Coletta , Davide Salvi , Viola Negroni , Daniele Ugo Leonzio , Paolo Bestagini

Defect detection is a critical research area in artificial intelligence. Recently, synthetic data-based self-supervised learning has shown great potential on this task. Although many sophisticated synthesizing strategies exist, little…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Yuxuan Cai , Dingkang Liang , Dongliang Luo , Xinwei He , Xin Yang , Xiang Bai

In recent years, deep learning models have demonstrated remarkable success in various domains, such as computer vision, natural language processing, and speech recognition. However, the generalization capabilities of these models can be…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Neelesh Mungoli

Speech deepfakes pose a significant threat to personal security and content authenticity. Several detectors have been proposed in the literature, and one of the primary challenges these systems have to face is the generalization over unseen…

Sound · Computer Science 2024-09-25 Viola Negroni , Davide Salvi , Alessandro Ilic Mezza , Paolo Bestagini , Stefano Tubaro

Automatic speaker verification systems are vulnerable to a variety of access threats, prompting research into the formulation of effective spoofing detection systems to act as a gate to filter out such spoofing attacks. This study…

Sound · Computer Science 2022-11-21 Zhenyu Wang , John H. L. Hansen

Recent advances in audio large language models (ALLMs) have made high-quality synthetic audio widely accessible, increasing the risk of malicious audio deepfakes across speech, environmental sounds, singing voice, and music. Real-world…

Sound · Computer Science 2026-01-07 Yuankun Xie , Xiaoxuan Guo , Jiayi Zhou , Tao Wang , Jian Liu , Ruibo Fu , Xiaopeng Wang , Haonan Cheng , Long Ye

Universal speech enhancement aims at handling inputs with various speech distortions and recording conditions. In this work, we propose a novel hybrid architecture that synergizes the signal fidelity of discriminative modeling with the…

Sound · Computer Science 2026-01-28 Yinghao Liu , Chengwei Liu , Xiaotao Liang , Haoyin Yan , Shaofei Xue , Zheng Xue

Existing methods on audio-visual deepfake detection mainly focus on high-level features for modeling inconsistencies between audio and visual data. As a result, these approaches usually overlook finer audio-visual artifacts, which are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Marcella Astrid , Enjie Ghorbel , Djamila Aouada

Radio frequency fingerprinting (RFF) is a promising device authentication technique for securing the Internet of things. It exploits the intrinsic and unique hardware impairments of the transmitters for RF device identification. In…

Signal Processing · Electrical Eng. & Systems 2023-06-26 Yuan Zeng , Yi Gong , Jiawei Liu , Shangao Lin , Zidong Han , Ruoxiao Cao , Kaibin Huang , Khaled Ben Letaief

Reliable detection of speech deepfakes (spoofs) must remain effective when the distribution of spoofing attacks shifts. We frame the task as domain generalization and show that inserting Low-Rank Adaptation (LoRA) adapters into every…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-18 Janne Laakkonen , Ivan Kukanov , Ville Hautamäki