English
Related papers

Related papers: Study of positional encoding approaches for Audio …

200 papers

We propose CAST, a dual-stream architecture that utilizes channel-aware spatial transfer learning for isolated sign language recognition addressing the challenges of magnitude-only 60~GHz radar Range-Time Maps (RTM). The proposed framework…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Md. Shakhoyat Rahman Shujon , Sheikh Md. Galib Mahim , Md. Milon Islam , Md Rezwanul Haque , Md Rabiul Islam , Hamdi Altaheri , Fakhri Karray

Sound event localization and detection (SELD) is a task for the classification of sound events and the identification of direction of arrival (DoA) utilizing multichannel acoustic signals. For effective classification and localization, a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-18 Yusun Shul , Dayun Choi , Jung-Woo Choi

Interaction and navigation defined by natural language instructions in dynamic environments pose significant challenges for neural agents. This paper focuses on addressing two challenges: handling long sequence of subtasks, and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Alexander Pashevich , Cordelia Schmid , Chen Sun

In recent years, researchers combine both audio and video signals to deal with challenges where actions are not well represented or captured by visual cues. However, how to effectively leverage the two modalities is still under development.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Wentao Zhu

In recent years, speech enhancement (SE) has achieved impressive progress with the success of deep neural networks (DNNs). However, the DNN approach usually fails to generalize well to unseen environmental noise that is not included in the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-09 Haoyu Li , Junichi Yamagishi

Recent studies of streaming automatic speech recognition (ASR) recurrent neural network transducer (RNN-T)-based systems have fed the encoder with past contextual information in order to improve its word error rate (WER) performance. In…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-31 Alejandro Gomez-Alanis , Lukas Drude , Andreas Schwarz , Rupak Vignesh Swaminathan , Simon Wiesler

In this paper, we propose a method to improve the accuracy of speech emotion recognition (SER) by using vision transformer (ViT) to attend to the correlation of frequency (y-axis) with time (x-axis) in spectrogram and transferring…

Sound · Computer Science 2024-11-05 Jeong-Yoon Kim , Seung-Ho Lee

For automatic speech translation (AST), end-to-end approaches are outperformed by cascaded models that transcribe with automatic speech recognition (ASR), then translate with machine translation (MT). A major cause of the performance gap is…

Computation and Language · Computer Science 2019-10-23 Juan Pino , Liezl Puzon , Jiatao Gu , Xutai Ma , Arya D. McCarthy , Deepak Gopinath

This paper studies a simple extension of image-based Masked Autoencoders (MAE) to self-supervised representation learning from audio spectrograms. Following the Transformer encoder-decoder design in MAE, our Audio-MAE first encodes audio…

Pre-trained speech Transformers have facilitated great success across various speech processing tasks. However, fine-tuning these encoders for downstream tasks require sufficiently large training data to converge or to achieve…

Computation and Language · Computer Science 2022-10-25 Hao Yang , Jinming Zhao , Gholamreza Haffari , Ehsan Shareghi

Automatic Speaker Verification (ASV) suffers from performance degradation in noisy conditions. To address this issue, we propose a novel adversarial learning framework that incorporates noise-disentanglement to establish a noise-independent…

Sound · Computer Science 2024-09-27 Xujiang Xing , Mingxing Xu , Thomas Fang Zheng

Conformer, a convolution-augmented Transformer variant, has become the de facto encoder architecture for speech processing due to its superior performance in various tasks, including automatic speech recognition (ASR), speech translation…

Computation and Language · Computer Science 2023-05-19 Yifan Peng , Kwangyoun Kim , Felix Wu , Brian Yan , Siddhant Arora , William Chen , Jiyang Tang , Suwon Shon , Prashant Sridhar , Shinji Watanabe

Fast contextual adaptation has shown to be effective in improving Automatic Speech Recognition (ASR) of rare words and when combined with an on-device personalized training, it can yield an even better recognition result. However, the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-08 Tsendsuren Munkhdalai , Khe Chai Sim , Angad Chandorkar , Fan Gao , Mason Chua , Trevor Strohman , Françoise Beaufays

The Transformer based neural networks have been showing significant advantages on most evaluations of various natural language processing and other sequence-to-sequence tasks due to its inherent architecture based superiorities. Although…

Computation and Language · Computer Science 2019-10-31 Hailiang Li , Adele Y. C. Wang , Yang Liu , Du Tang , Zhibin Lei , Wenye Li

Recently, audio-visual scene classification (AVSC) has attracted increasing attention from multidisciplinary communities. Previous studies tended to adopt a pipeline training strategy, which uses well-trained visual and acoustic encoders to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Chengxin Chen , Meng Wang , Pengyuan Zhang

This paper introduces a novel audio-to-image encoding framework that integrates multiple dimensions of voice characteristics into a single RGB image for speaker recognition. In this method, the green channel encodes raw audio data, the red…

Sound · Computer Science 2025-03-11 Youness Atif

Most of the parameters in large vocabulary models are used in embedding layer to map categorical features to vectors and in softmax layer for classification weights. This is a bottle-neck in memory constraint on-device training applications…

Machine Learning · Computer Science 2018-11-21 Ehsan Variani , Ananda Theertha Suresh , Mitchel Weintraub

Recent successful applications of convolutional neural networks (CNNs) to audio classification and speech recognition have motivated the search for better input representations for more efficient training. Visual displays of an audio…

Computer Vision and Pattern Recognition · Computer Science 2017-06-23 M. Huzaifah

Environmental Sound Classification (ESC) is a rapidly evolving field that recently demonstrated the advantages of application of visual domain techniques to the audio-related tasks. Previous studies indicate that the domain-specific…

Sound · Computer Science 2021-04-26 Andrey Guzhov , Federico Raue , Jörn Hees , Andreas Dengel

The field of audio captioning has seen significant advancements in recent years, driven by the availability of large-scale audio datasets and advancements in deep learning techniques. In this technical report, we present our approach to…

Sound · Computer Science 2023-05-18 Marek Kadlčík , Adam Hájek , Jürgen Kieslich , Radosław Winiecki