English
Related papers

Related papers: Leveraging Joint Spectral and Spatial Learning wit…

200 papers

Recently, the state space model (SSM) represented by Mamba has shown remarkable performance in long-term sequence modeling tasks, including speech enhancement. However, due to substantial differences in sub-band features, applying the same…

Sound · Computer Science 2025-02-25 Jizhen Li , Weiping Tu , Yuhong Yang , Xinmeng Xu , Yiqun Zhang , Yanzhen Ren

Existing CNN-based speech separation models face local receptive field limitations and cannot effectively capture long time dependencies. Although LSTM and Transformer-based speech separation models can avoid this problem, their high…

Sound · Computer Science 2024-09-11 Kai Li , Guo Chen , Runxuan Yang , Xiaolin Hu

Transformer-based models have become increasingly popular and have impacted speech-processing research owing to their exceptional performance in sequence modeling. Recently, a promising model architecture, Mamba, has emerged as a potential…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-27 Wen-Yuan Ting , Wenze Ren , Rong Chao , Hsin-Yi Lin , Yu Tsao , Fan-Gang Zeng

Whispered speech recognition presents significant challenges for conventional automatic speech recognition systems, particularly when combined with dialect variation. However, utilizing an efficient method to solve this problem using a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-30 Aref Farhadipour , Homayoon Beigi , Volker Dellwo , Hadi Veisi

Recent Mamba-based models have shown promise in speech enhancement by efficiently modeling long-range temporal dependencies. However, models like Speech Enhancement Mamba (SEMamba) remain limited to single-speaker scenarios and struggle in…

Sound · Computer Science 2025-10-01 Rong Chao , Wenze Ren , You-Jin Li , Kuo-Hsuan Hung , Sung-Feng Huang , Szu-Wei Fu , Wen-Huang Cheng , Yu Tsao

The Interspeech 2025 URGENT Challenge aimed to advance universal, robust, and generalizable speech enhancement by unifying speech enhancement tasks across a wide variety of conditions, including seven different distortion types and five…

Sound · Computer Science 2025-10-01 Rong Chao , Rauf Nasretdinov , Yu-Chiang Frank Wang , Ante Jukić , Szu-Wei Fu , Yu Tsao

Spatial-Spectral Mamba (SSM) improves computational efficiency and captures long-range dependencies, addressing Transformer limitations. However, traditional Mamba models overlook rich spectral information in HSIs and struggle with high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Muhammad Ahmad , Muhammad Hassaan Farooq Butt , Muhammad Usama , Hamad Ahmed Altuwaijri , Manuel Mazzara , Salvatore Distefano

Despite its widespread adoption as the prominent neural architecture, the Transformer has spurred several independent lines of work to address its limitations. One such approach is selective state space models, which have demonstrated…

Sound · Computer Science 2024-06-11 Sarthak Yadav , Zheng-Hua Tan

In this work, we extend our previously proposed offline SpatialNet for long-term streaming multichannel speech enhancement in both static and moving speaker scenarios. SpatialNet exploits spatial information, such as the spatial/steering…

Sound · Computer Science 2024-06-21 Changsheng Quan , Xiaofei Li

In recent speech enhancement (SE) research, transformer and its variants have emerged as the predominant methodologies. However, the quadratic complexity of the self-attention mechanism imposes certain limitations on practical deployment.…

Sound · Computer Science 2025-01-03 Junyu Wang , Zizhen Lin , Tianrui Wang , Meng Ge , Longbiao Wang , Jianwu Dang

Transformers have been the most successful architecture for various speech modeling tasks, including speech separation. However, the self-attention mechanism in transformers with quadratic complexity is inefficient in computation and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-02 Xilin Jiang , Cong Han , Nima Mesgarani

Transformers have revolutionized deep learning across various tasks, including audio representation learning, due to their powerful modeling capabilities. However, they often suffer from quadratic complexity in both GPU memory usage and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-06 Siavash Shams , Sukru Samet Dindar , Xilin Jiang , Nima Mesgarani

Accurate traffic prediction plays a vital role in intelligent transportation systems by enabling efficient routing, congestion mitigation, and proactive traffic control. However, forecasting is challenging due to the combined effects of…

Machine Learning · Computer Science 2025-07-08 Mohamed Hamad , Mohamed Mabrok , Nizar Zorba

This work aims to investigate the use of a recently proposed, attention-free, scalable state-space model (SSM), Mamba, for the speech enhancement (SE) task. In particular, we employ Mamba to deploy different regression-based SE models…

State space models (SSMs) have emerged as an efficient alternative to Transformer models for language modeling, offering linear computational complexity and constant memory usage as context length increases. However, despite their…

Computation and Language · Computer Science 2025-04-23 Zhifan Ye , Kejing Xia , Yonggan Fu , Xin Dong , Jihoon Hong , Xiangchi Yuan , Shizhe Diao , Jan Kautz , Pavlo Molchanov , Yingyan Celine Lin

Abnormality detection in medical imaging is a critical task requiring both high efficiency and accuracy to support effective diagnosis. While convolutional neural networks (CNNs) and Transformer-based models are widely used, both face…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yao Wang , Dong Yang , Zhi Qiao , Wenjian Huang , Liuzhi Yang , Zhen Qian

Motor imagery (MI) classification is key for brain-computer interfaces (BCIs). Until recent years, numerous models had been proposed, ranging from classical algorithms like Common Spatial Pattern (CSP) to deep learning models such as…

Human-Computer Interaction · Computer Science 2024-09-20 Xiaoxiao Yang , Ziyu Jia

Deep learning models like Convolutional Neural Networks and transformers have shown impressive capabilities in speech verification, gaining considerable attention in the research community. However, CNN-based approaches struggle with…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-17 Yang Liu , Li Wan , Yiteng Huang , Ming Sun , Yangyang Shi , Florian Metze

Although the complex spectrum-based speech enhancement(SE) methods have achieved significant performance, coupling amplitude and phase can lead to a compensation effect, where amplitude information is sacrificed to compensate for the phase…

Sound · Computer Science 2024-12-30 Cunhang Fan , Enrui Liu , Andong Li , Jianhua Tao , Jian Zhou , Jiahao Li , Chengshi Zheng , Zhao Lv

Video anomaly detection (VAD) has been extensively researched due to its potential for intelligent video systems. However, most existing methods based on CNNs and transformers still suffer from substantial computational burdens and have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Zhangxun Li , Mengyang Zhao , Xuan Yang , Yang Liu , Jiamu Sheng , Xinhua Zeng , Tian Wang , Kewei Wu , Yu-Gang Jiang
‹ Prev 1 2 3 10 Next ›