中文
相关论文

相关论文: MFA-Conformer: Multi-scale Feature Aggregation Con…

200 篇论文

Modern speaker verification models use deep neural networks to encode utterance audio into discriminative embedding vectors. During the training process, these networks are typically optimized to differentiate arbitrary speakers. This…

音频与语音处理 · 电气工程与系统科学 2024-02-09 Hua Shen , Yuguang Yang , Guoli Sun , Ryan Langman , Eunjung Han , Jasha Droppo , Andreas Stolcke

Transformer-based models have shown strong performance in speech deepfake detection, largely due to the effectiveness of the multi-head self-attention (MHSA) mechanism. MHSA provides frame-level attention scores, which are particularly…

声音 · 计算机科学 2026-02-05 Tuan Dat Phuong , Duc-Tuan Truong , Long-Vu Hoang , Trang Nguyen Thi Thu

The recently proposed Conformer architecture which combines convolution with attention to capture both local and global dependencies has become the \textit{de facto} backbone model for Automatic Speech Recognition~(ASR). Inherited from the…

We propose SpeakerNet - a new neural architecture for speaker recognition and speaker verification tasks. It is composed of residual blocks with 1D depth-wise separable convolutions, batch-normalization, and ReLU layers. This architecture…

音频与语音处理 · 电气工程与系统科学 2020-10-27 Nithin Rao Koluguri , Jason Li , Vitaly Lavrukhin , Boris Ginsburg

In recent years, neural network based methods for multi-speaker text-to-speech synthesis (TTS) have made significant progress. However, the current speaker encoder models used in these methods still cannot capture enough speaker…

声音 · 计算机科学 2022-03-29 Jinlong Xue , Yayue Deng , Yichen Han , Ya Li , Jianqing Sun , Jiaen Liang

Optimization of modern ASR architectures is among the highest priority tasks since it saves many computational resources for model training and inference. The work proposes a new Uconv-Conformer architecture based on the standard Conformer…

音频与语音处理 · 电气工程与系统科学 2023-03-14 Andrei Andrusenko , Rauf Nasretdinov , Aleksei Romanenko

Deepfake detection faces increasing challenges since the fast growth of generative models in developing massive and diverse Deepfake technologies. Recent advances rely on introducing heuristic features from spatial or frequency domains…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Zifeng Li , Wenzhong Tang , Shijun Gao , Shuai Wang , Yanxiang Wang

An important step in speaker verification is extracting features that best characterize the speaker voice. This paper investigates a front-end processing that aims at improving the performance of speaker verification based on the SVMs…

机器学习 · 计算机科学 2013-06-13 Kawthar Yasmine Zergat , Abderrahmane Amrouche

In this paper, a novel Convolutional Neural Network architecture has been developed for speaker verification in order to simultaneously capture and discard speaker and non-speaker information, respectively. In training phase, the network is…

音频与语音处理 · 电气工程与系统科学 2018-08-13 Hossein Salehghaffari

Transformer has emerged in speech emotion recognition (SER) at present. However, its equal patch division not only damages frequency information but also ignores local emotion correlations across frames, which are key cues to represent…

声音 · 计算机科学 2023-06-05 Cheng Lu , Hailun Lian , Wenming Zheng , Yuan Zong , Yan Zhao , Sunan Li

Speaker Verification (SV) systems involve mainly two individual stages: feature extraction and classification. In this paper, we explore these two modules with the aim of improving the performance of a speaker verification system under…

音频与语音处理 · 电气工程与系统科学 2024-02-06 Kerlos Atia Abdalmalak , Ascensión Gallardo-Antol'in

The convolutional neural network (CNN) based approaches have shown great success for speaker verification (SV) tasks, where modeling long temporal context and reducing information loss of speaker characteristics are two important challenges…

声音 · 计算机科学 2021-08-31 Yanfeng Wu , Chenkai Guo , Junan Zhao , Xiao Jin , Jing Xu

Decoding speech-related information from non-invasive MEG is a key step toward scalable brain-computer interfaces. We present compact Conformer-based decoders on the LibriBrain 2025 PNPL benchmark for two core tasks: Speech Detection and…

计算与语言 · 计算机科学 2026-02-11 Xabier de Zuazo , Ibon Saratxaga , Eva Navas

This work introduces the Cleanformer, a streaming multichannel neural based enhancement frontend for automatic speech recognition (ASR). This model has a conformer-based architecture which takes as inputs a single channel each of raw and…

音频与语音处理 · 电气工程与系统科学 2023-05-05 Joseph Caroselli , Arun Narayanan , Nathan Howard , Tom O'Malley

Automatic Speaker Verification systems are gaining popularity these days; spoofing attacks are of prime concern as they make these systems vulnerable. Some spoofing attacks like Replay attacks are easier to implement but are very hard to…

音频与语音处理 · 电气工程与系统科学 2020-08-11 Rahul T P , P R Aravind , Ranjith C , Usamath Nechiyil , Nandakumar Paramparambath

Bengali, spoken by over 300 million people, is a morphologically rich and lowresource language, posing challenges for automatic speech recognition (ASR). This research presents an end-to-end framework for Bengali ASR, building on a…

音频与语音处理 · 电气工程与系统科学 2026-01-16 Md. Nazmus Sakib , Golam Mahmud , Md. Maruf Bangabashi , Umme Ara Mahinur Istia , Md. Jahidul Islam , Partha Sarker , Afra Yeamini Prity

Time Delay Neural Networks (TDNN)-based methods are widely used in dialect identification. However, in previous work with TDNN application, subtle variant is being neglected in different feature scales. To address this issue, we propose a…

计算与语言 · 计算机科学 2021-08-18 Tianlong Kong , Shouyi Yin , Dawei Zhang , Wang Geng , Xin Wang , Dandan Song , Jinwen Huang , Huiyu Shi , Xiaorui Wang

This study addresses robust automatic speech recognition (ASR) by introducing a Conformer-based acoustic model. The proposed model builds on the wide residual bi-directional long short-term memory network (WRBN) with utterance-wise dropout…

声音 · 计算机科学 2022-10-21 Yufeng Yang , Peidong Wang , DeLiang Wang

Single-channel speech enhancement (SE) is an important task in speech processing. A widely used framework combines an analysis/synthesis filterbank with a mask prediction network, such as the Conv-TasNet architecture. In such systems, the…

音频与语音处理 · 电气工程与系统科学 2021-08-06 Yuma Koizumi , Shigeki Karita , Scott Wisdom , Hakan Erdogan , John R. Hershey , Llion Jones , Michiel Bacchiani

Recently, Conformer as a backbone network for end-to-end automatic speech recognition achieved state-of-the-art performance. The Conformer block leverages a self-attention mechanism to capture global information, along with a convolutional…

声音 · 计算机科学 2023-10-31 Peng Fan , Changhao Shan , Sining Sun , Qing Yang , Jianwei Zhang