English
Related papers

Related papers: SCA: Streaming Cross-attention Alignment for Echo …

200 papers

Echo path delay (or ref-delay) estimation is a big challenge in acoustic echo cancellation. Different devices may introduce various ref-delay in practice. Ref-delay inconsistency slows down the convergence of adaptive filters, and also…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-12 Yi Zhang , Chengyun Deng , Shiqian Ma , Yongtao Sha , Hui Song

In this paper, we propose ACA-Net, a lightweight, global context-aware speaker embedding extractor for Speaker Verification (SV) that improves upon existing work by using Asymmetric Cross Attention (ACA) to replace temporal pooling. ACA is…

Traditional Active Noise Control (ANC) systems are mostly based on FxLMS algorithms, but such algorithms rely on linear assumptions and are often limited in handling broadband non-stationary noise or nonlinear acoustic paths. Not only that,…

Signal Processing · Electrical Eng. & Systems 2026-04-14 Shuning Dai

Most end-to-end (E2E) spoken dialogue systems (SDS) rely on voice activity detection (VAD) for turn-taking, but VAD fails to distinguish between pauses and turn completions. Duplex SDS models address this by predicting output continuously,…

Computation and Language · Computer Science 2025-10-03 Siddhant Arora , Jinchuan Tian , Hayato Futami , Jiatong Shi , Yosuke Kashiwagi , Emiru Tsunoo , Shinji Watanabe

We propose a) a Language Agnostic end-to-end Speech Translation model (LAST), and b) a data augmentation strategy to increase code-switching (CS) performance. With increasing globalization, multiple languages are increasingly used…

Computation and Language · Computer Science 2022-11-10 Christian Huber , Enes Yavuz Ugan , Alexander Waibel

In this paper, we present a streaming end-to-end speech recognition model based on Monotonic Chunkwise Attention (MoCha) jointly trained with enhancement layers. Even though the MoCha attention enables streaming speech recognition with…

Sound · Computer Science 2021-05-05 Chanwoo Kim , Abhinav Garg , Dhananjaya Gowda , Seongkyu Mun , Changwoo Han

We present a state-of-the-art speech recognition system developed using end-to-end deep learning. Our architecture is significantly simpler than traditional speech systems, which rely on laboriously engineered processing pipelines; these…

The selective fixed-filter strategy is popular in industrial applications involving active noise control (ANC) technology, which circumvents the time-consuming online learning process by selecting the best-matched pre-trained control…

Signal Processing · Electrical Eng. & Systems 2025-04-29 Y. Xiao , M. Liu , D. Wei , L. Jian

End-to-end learning treats the entire system as a whole adaptable black box, which, if sufficient data are available, may learn a system that works very well for the target task. This principle has recently been applied to several prototype…

Sound · Computer Science 2017-06-27 Dong Wang , Lantian Li , Zhiyuan Tang , Thomas Fang Zheng

Although today's speech communication systems support various bandwidths from narrowband to super-wideband and beyond, state-of-the art DNN methods for acoustic echo cancellation (AEC) are lacking modularity and bandwidth scalability. Our…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-08 Ernst Seidel , Rasmus Kongsgaard Olsson , Karim Haddad , Zhengyang Li , Pejman Mowlaee , Tim Fingscheidt

In this paper, we present a conditional multitask learning method for end-to-end neural speaker diarization (EEND). The EEND system has shown promising performance compared with traditional clustering-based methods, especially in the case…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-09 Yuki Takashima , Yusuke Fujita , Shinji Watanabe , Shota Horiguchi , Paola García , Kenji Nagamatsu

Transformer-based end-to-end neural speaker diarization (EEND) models utilize the multi-head self-attention (SA) mechanism to enable accurate speaker label prediction in overlapped speech regions. In this study, to enhance the training…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-03 Ye-Rin Jeoung , Joon-Young Yang , Jeong-Hwan Choi , Joon-Hyuk Chang

In this paper, we present Adaptive Computation Steps (ACS) algo-rithm, which enables end-to-end speech recognition models to dy-namically decide how many frames should be processed to predict a linguistic output. The model that applies ACS…

Audio and Speech Processing · Electrical Eng. & Systems 2018-09-27 Mohan Li , Min Liu , Masanori Hattori

End-to-end models for robust automatic speech recognition (ASR) have not been sufficiently well-explored in prior work. With end-to-end models, one could choose to preprocess the input speech using speech enhancement techniques and train…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Archiki Prasad , Preethi Jyothi , Rajbabu Velmurugan

The goal of this work is to synchronise audio and video of a talking face using deep neural network models. Existing works have trained networks on proxy tasks such as cross-modal similarity learning, and then computed similarities between…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 You Jin Kim , Hee Soo Heo , Soo-Whan Chung , Bong-Jin Lee

Noise reduction techniques based on deep learning have demonstrated impressive performance in enhancing the overall quality of recorded speech. While these approaches are highly performant, their application in audio engineering can be…

Sound · Computer Science 2023-10-18 Christian J. Steinmetz , Thomas Walther , Joshua D. Reiss

This paper introduces the SWANT team entry to the ICASSP 2023 AEC Challenge. We submit a system that cascades a linear filter with a neural post-filter. Particularly, we adopt sub-band processing to handle full-band signals and shape the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Jiayao Sun , Dawei Luo , Zhaoxia Li , Jindong Li , Yukai Ju , Yang Li

In this paper, we propose an end-to-end post-filter method with deep attention fusion features for monaural speaker-independent speech separation. At first, a time-frequency domain speech separation method is applied as the pre-separation…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-18 Cunhang Fan , Jianhua Tao , Bin Liu , Jiangyan Yi , Zhengqi Wen , Xuefei Liu

We present a system for keyword spotting that, except for a frontend component for feature generation, it is entirely contained in a deep neural network (DNN) model trained "end-to-end" to predict the presence of the keyword in a stream of…

Computation and Language · Computer Science 2019-02-19 Alvarez Raziel , Park Hyun-Jin

Personalised speech enhancement (PSE), which extracts only the speech of a target user and removes everything else from a recorded audio clip, can potentially improve users' experiences of audio AI modules deployed in the wild. To support a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-09 Shucong Zhang , Malcolm Chadwick , Alberto Gil C. P. Ramos , Sourav Bhattacharya