English
Related papers

Related papers: CA-MHFA: A Context-Aware Multi-Head Factorized Att…

200 papers

The goal of this paper is text-independent speaker verification where utterances come from 'in the wild' videos and may contain irrelevant signal. While speaker verification is naturally a pair-wise problem, existing methods to produce the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-04 Seong Min Kye , Yoohwan Kwon , Joon Son Chung

Recent face anti-spoofing (FAS) methods have shown remarkable cross-domain performance by employing vision-language models like CLIP. However, existing CLIP-based FAS models do not fully exploit CLIP's patch embedding tokens, failing to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Jeongmin Yu , Susang Kim , Kisu Lee , Taekyoung Kwon , Won-Yong Shin , Ha Young Kim

Sound source localization (SSL) is essential for many speech-processing applications. Deep learning models have achieved high performance, but often fail when the training and inference environments differ. Adapting SSL models to dynamic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-21 Yang Xiao , Rohan Kumar Das

The rapid development of audio-driven talking head generators and advanced Text-To-Speech (TTS) models has led to more sophisticated temporal deepfakes. These advances highlight the need for robust methods capable of detecting and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-12 Ivan Kukanov , Jun Wah Ng

Recent advancements in generative AI, particularly in speech synthesis, have enabled the generation of highly natural-sounding synthetic speech that closely mimics human voices. While these innovations hold promise for applications like…

State-of-the-art Deep Learning systems for speaker verification are commonly based on speaker embedding extractors. These architectures are usually composed of a feature extractor front-end together with a pooling layer to encode…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-08 Federico Costa , Miquel India , Javier Hernando

Affective video facial analysis (AVFA) has emerged as a key research field for building emotion-aware intelligent systems, yet this field continues to suffer from limited data availability. In recent years, the self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Xuecheng Wu , Junxiao Xue , Xinyi Yin , Yunyun Shi , Liangyu Fu , Danlei Huang , Yifan Wang , Jia Zhang , Jiayu Nie , Jun Wang

Transformer-based architectures for speaker verification typically require more training data than ECAPA-TDNN. Therefore, recent work has generally been trained on VoxCeleb1&2. We propose a backbone network based on self-attention, which…

Sound · Computer Science 2024-05-31 Nian Li , Jianguo Wei

This paper conducts a comprehensive layer-wise analysis of self-supervised learning (SSL) models for audio deepfake detection across diverse contexts, including multilingual datasets (English, Chinese, Spanish), partial, song, and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-10 Yassine El Kheir , Youness Samih , Suraj Maharjan , Tim Polzehl , Sebastian Möller

Recent years have witnessed the extraordinary development of automatic speaker verification (ASV). However, previous works show that state-of-the-art ASV models are seriously vulnerable to voice spoofing attacks, and the recently proposed…

Sound · Computer Science 2022-06-22 Haibin Wu , Jiawen Kang , Lingwei Meng , Yang Zhang , Xixin Wu , Zhiyong Wu , Hung-yi Lee , Helen Meng

Spoofing attacks posed by generating artificial speech can severely degrade the performance of a speaker verification system. Recently, many anti-spoofing countermeasures have been proposed for detecting varying types of attacks from…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-08 Yuanjun Zhao , Roberto Togneri , Victor Sreeram

Self-supervised learning (SSL) speech models such as wav2vec and HuBERT have demonstrated state-of-the-art performance on automatic speech recognition (ASR) and proved to be extremely useful in low label-resource settings. However, the…

Sound · Computer Science 2023-10-05 Weiwei Lin , Chenhang He , Man-Wai Mak , Youzhi Tu

Speech Emotion Recognition (SER) research has faced limitations due to the lack of standard and sufficiently large datasets. Recent studies have leveraged pre-trained models to extract features for downstream tasks such as SER. This work…

Artificial Intelligence · Computer Science 2026-02-10 Ali Shendabadi , Parnia Izadirad , Mostafa Salehi , Mahmoud Bijankhan

This paper describes the UZH-CL system submitted to the SASV section of the WildSpoof 2026 challenge. The challenge focuses on the integrated defense against generative spoofing attacks by requiring the simultaneous verification of speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-27 Aref Farhadipour , Ming Jin , Valeriia Vyshnevetska , Xiyang Li , Elisa Pellegrino , Srikanth Madikeri

Time delay neural network (TDNN) has been proven to be efficient for speaker verification. One of its successful variants, ECAPA-TDNN, achieved state-of-the-art performance at the cost of much higher computational complexity and slower…

Sound · Computer Science 2023-06-19 Hui Wang , Siqi Zheng , Yafeng Chen , Luyao Cheng , Qian Chen

Traditional hearing aids often rely on static fittings that fail to adapt to their dynamic acoustic environments. We propose CAFA, a Context-Adaptive Fitting Advisor that provides personalized, real-time hearing aid adjustments through a…

Human-Computer Interaction · Computer Science 2025-09-09 Yingke Ding , Zeyu Wang , Xiyuxing Zhang , Hongbin Chen , Zhenan Xu

The computing power of mobile devices limits the end-user applications in terms of storage size, processing, memory and energy consumption. These limitations motivate researchers for the design of more efficient deep models. On the other…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-05 Pooyan Safari , Miquel India , Javier Hernando

Recent advancements in Self-Supervised Learning (SSL) have shown promising results in Speaker Verification (SV). However, narrowing the performance gap with supervised systems remains an ongoing challenge. Several studies have observed that…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-25 Victor Miara , Theo Lepage , Reda Dehak

Spoofing-robust speaker verification (SASV) combines the tasks of speaker and spoof detection to authenticate speakers under adversarial settings. Many SASV systems rely on fusion of speaker and spoof cues at embedding, score or decision…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-31 Oğuzhan Kurnaz , Jagabandhu Mishra , Tomi H. Kinnunen , Cemal Hanilçi

Speech deepfake detection has achieved remarkable success in clean environments but faces significant challenges in complex, real-world scenarios where speech is often mixed with background music or noise. Current state-of-the-art methods…

Sound · Computer Science 2026-05-25 Qingcao Li , Yipeng Lin , Weichen Lian , Zhongjie Ba , Peng Cheng , Zhichao Lian