English
Related papers

Related papers: TF-Mamba: A Time-Frequency Network for Sound Sourc…

200 papers

While Mamba has demonstrated strong performance in language modeling, its potential as a speech self-supervised learning (SSL) model remains underexplored, with prior studies limited to isolated tasks. To address this, we explore…

Computation and Language · Computer Science 2026-04-21 Tzu-Quan Lin , Heng-Cheng Kuo , Tzu-Chieh Wei , Hsi-Chun Cheng , Chun Wei Chen , Hsien-Fu Hsiao , Yu Tsao , Hung-yi Lee

This paper presents a framework for universal sound separation and polyphonic audio classification, addressing the challenges of separating and classifying individual sound sources in a multichannel mixture. The proposed framework,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-12 Dongheon Lee , Jung-Woo Choi

Existing CNN-based speech separation models face local receptive field limitations and cannot effectively capture long time dependencies. Although LSTM and Transformer-based speech separation models can avoid this problem, their high…

Sound · Computer Science 2024-09-11 Kai Li , Guo Chen , Runxuan Yang , Xiaolin Hu

In multichannel speech enhancement, effectively capturing spatial and spectral information across different microphones is crucial for noise reduction. Traditional methods, such as CNN or LSTM, attempt to model the temporal dynamics of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-15 Wenze Ren , Haibin Wu , Yi-Cheng Lin , Xuanjun Chen , Rong Chao , Kuo-Hsuan Hung , You-Jin Li , Wen-Yuan Ting , Hsin-Min Wang , Yu Tsao

Deep learning models like Convolutional Neural Networks and transformers have shown impressive capabilities in speech verification, gaining considerable attention in the research community. However, CNN-based approaches struggle with…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-17 Yang Liu , Li Wan , Yiteng Huang , Ming Sun , Yangyang Shi , Florian Metze

Traffic flow estimation (TFE) is crucial for urban intelligent traffic systems. While traditional on-road detectors are hindered by limited coverage and high costs, cloud computing and data mining of vehicular network data, such as driving…

Artificial Intelligence · Computer Science 2024-07-12 Doncheng Yuan , Jianzhe Xue , Jinshan Su , Wenchao Xu , Haibo Zhou

Long-term time series forecasting (LTSF) provides longer insights into future trends and patterns. Over the past few years, deep learning models especially Transformers have achieved advanced performance in LTSF tasks. However, LTSF faces…

Machine Learning · Computer Science 2024-06-28 Aobo Liang , Xingguo Jiang , Yan Sun , Xiaohou Shi , Ke Li

Mamba has recently emerged as a promising alternative to Transformers, offering near-linear complexity in processing sequential data. However, while channels in time series (TS) data have no specific order in general, recent studies have…

Machine Learning · Computer Science 2024-11-01 Seunghan Lee , Juri Hong , Kibok Lee , Taeyoung Park

Recent advances in deep learning structured state space models, especially the Mamba architecture, have demonstrated remarkable performance improvements while maintaining linear complexity. In this study, we introduce functional…

Machine Learning · Computer Science 2025-03-24 Yuxiang Wei , Anees Abrol , Vince Calhoun

Traffic flow prediction, a critical aspect of intelligent transportation systems, has been increasingly popular in the field of artificial intelligence, driven by the availability of extensive traffic data. The current challenges of traffic…

Machine Learning · Computer Science 2024-05-21 Zhiqi Shao , Michael G. H. Bell , Ze Wang , D. Glenn Geers , Haoning Xi , Junbin Gao

Tooth segmentation is a pivotal step in modern digital dentistry, essential for applications across orthodontic diagnosis and treatment planning. Despite its importance, this process is fraught with challenges due to the high noise and low…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Jing Hao , Yonghui Zhu , Lei He , Moyun Liu , James Kit Hon Tsoi , Kuo Feng Hung

Transformers and their variants have achieved great success in speech processing. However, their multi-head self-attention mechanism is computationally expensive. Therefore, one novel selective state space model, Mamba, has been proposed as…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-04 Yang Xiao , Rohan Kumar Das

Sound source localization (SSL) adds a spatial dimension to auditory perception, allowing a system to pinpoint the origin of speech, machinery noise, warning tones, or other acoustic events, capabilities that facilitate robot navigation,…

Robotics · Computer Science 2025-08-29 Reza Jalayer , Masoud Jalayer , Amirali Baniasadi

We introduce a new music source separation model tailored for accurate vocal isolation. Unlike Transformer-based approaches, which often fail to capture intermittently occurring vocals, our model leverages Mamba2, a recent state space…

Sound · Computer Science 2026-01-01 Euiyeon Kim , Yong-Hoon Choi

Music source separation (MSS) aims to separate mixed music into its distinct tracks, such as vocals, bass, drums, and more. MSS is considered to be a challenging audio separation task due to the complexity of music signals. Although the RNN…

Sound · Computer Science 2024-09-16 Jinglin Bai , Yuan Fang , Jiajie Wang , Xueliang Zhang

This paper describes a sound source localization (SSL) technique that combines an $\alpha$-stable model for the observed signal with a neural network-based approach for modeling steering vectors. Specifically, a physics-informed neural…

Sound source localization (SSL) is a critical technology for determining the position of sound sources in complex environments. However, existing methods face challenges such as high computational costs and precise calibration requirements,…

Sound · Computer Science 2025-05-28 Yiyuan Yang , Shitong Xu , Niki Trigoni , Andrew Markham

Spoken term detection (STD) is often hindered by reliance on frame-level features and the computationally intensive DTW-based template matching, limiting its practicality. To address these challenges, we propose a novel approach that…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-24 Anup Singh , Kris Demuynck , Vipul Arora

Advances in speech synthesis intensify security threats, motivating real-time deepfake detection research. We investigate whether bidirectional Mamba can serve as a competitive alternative to Self-Attention in detecting synthetic speech.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-14 Xi Xuan , Zimo Zhu , Wenxin Zhang , Yi-Cheng Lin , Tomi Kinnunen

Although MODIS time series data are critical for supporting dynamic, large-scale land cover land use classification, it is a challenging task to capture the subtle class signature information due to key MODIS difficulties, e.g., high…

Image and Video Processing · Electrical Eng. & Systems 2025-08-06 Zack Dewis , Zhengsen Xu , Yimin Zhu , Motasem Alkayid , Mabel Heffring , Lincoln Linlin Xu
‹ Prev 1 2 3 10 Next ›