English
Related papers

Related papers: Mamba for Streaming ASR Combined with Unimodal Agg…

200 papers

This work investigates bidirectional Mamba (BiMamba) for unified streaming and non-streaming automatic speech recognition (ASR). Dynamic chunk size training enables a single model for offline decoding and streaming decoding with various…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-03 Qingshun She , Jing Peng , Yangui Fang , Yu Xi , Kai Yu

Sequential Recommenders have been widely applied in various online services, aiming to model users' dynamic interests from their sequential interactions. With users increasingly engaging with online platforms, vast amounts of lifelong user…

Information Retrieval · Computer Science 2024-03-26 Jiyuan Yang , Yuanzi Li , Jingyu Zhao , Hanbing Wang , Muyang Ma , Jun Ma , Zhaochun Ren , Mengqi Zhang , Xin Xin , Zhumin Chen , Pengjie Ren

Acoustic Scene Classification (ASC) is a fundamental problem in computational audition, which seeks to classify environments based on the distinctive acoustic features. In the ASC task of the APSIPA ASC 2025 Grand Challenge, the organizers…

Sound · Computer Science 2025-08-26 Bochao Sun , Dong Wang , ZhanLong Yang , Jun Yang , Han Yin

State Space Models (SSMs)-most notably RNNs-have historically played a central role in sequential modeling. Although attention mechanisms such as Transformers have since dominated due to their ability to model global context, their…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Hyun-kyu Ko , Youbin Kim , Jihyeon Park , Dongheok Park , Gyeongjin Kang , Wonjun Cho , Hyung Yi , Eunbyung Park

We present Schr\"odinger Bridge Mamba (SBM), a novel model for efficient speech enhancement by integrating the Schr\"odinger Bridge (SB) training paradigm and the Mamba architecture. Experiments of joint denoising and dereverberation tasks…

Sound · Computer Science 2026-03-06 Jing Yang , Sirui Wang , Chao Wu , Lei Guo , Fan Fan

While the conditional sequence modeling with the transformer architecture has demonstrated its effectiveness in dealing with offline reinforcement learning (RL) tasks, it is struggle to handle out-of-distribution states and actions.…

Machine Learning · Computer Science 2025-01-23 Qi Lv , Xiang Deng , Gongwei Chen , Michael Yu Wang , Liqiang Nie

State-space models (SSMs), such as Mamba (Gu & Dao, 2023), have been proposed as alternatives to Transformer networks in language modeling, by incorporating gating, convolutions, and input-dependent token selection to mitigate the quadratic…

Machine Learning · Computer Science 2024-04-26 Jongho Park , Jaeseung Park , Zheyang Xiong , Nayoung Lee , Jaewoong Cho , Samet Oymak , Kangwook Lee , Dimitris Papailiopoulos

Recent Mamba-based architectures for video understanding demonstrate promising computational efficiency and competitive performance, yet struggle with overfitting issues that hinder their scalability. To overcome this challenge, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yunze Liu , Peiran Wu , Cheng Liang , Junxiao Shen , Limin Wang , Li Yi

Transformers have rapidly become the preferred choice for audio classification, surpassing methods based on CNNs. However, Audio Spectrogram Transformers (ASTs) exhibit quadratic scaling due to self-attention. The removal of this quadratic…

Sound · Computer Science 2024-06-06 Mehmet Hamza Erol , Arda Senocak , Jiu Feng , Joon Son Chung

Mamba is a newly proposed architecture which behaves like a recurrent neural network (RNN) with attention-like capabilities. These properties are promising for speaker diarization, as attention-based models have unsuitable memory…

Sound · Computer Science 2024-10-11 Alexis Plaquet , Naohiro Tawara , Marc Delcroix , Shota Horiguchi , Atsushi Ando , Shoko Araki

State-space modeling has emerged as a powerful paradigm for sequence analysis in various tasks such as natural language processing, time-series forecasting, and signal processing. In this work, we propose an \emph{Adaptive State-Space…

Machine Learning · Computer Science 2025-07-31 Alice Zhang , Chao Li

Transformer-based methods have achieved remarkable performance in event-based object detection, owing to the global modeling ability. However, they neglect the influence of non-event and noisy regions and process them uniformly, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Nan Yang , Yang Wang , Zhanwen Liu , Meng Li , Yisheng An , Xiangmo Zhao

Efficiently modeling sequences with infinite context length has long been a challenging problem. Previous approaches have either suffered from quadratic computational complexity or limited extrapolation ability in length generalization. In…

Computation and Language · Computer Science 2025-03-03 Liliang Ren , Yang Liu , Yadong Lu , Yelong Shen , Chen Liang , Weizhu Chen

Recent advances in LiDAR 3D detection have demonstrated the effectiveness of Transformer-based frameworks in capturing the global dependencies from point cloud spaces, which serialize the 3D voxels into the flattened 1D sequence for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Xin Jin , Haisheng Su , Kai Liu , Cong Ma , Wei Wu , Fei Hui , Junchi Yan

The Interspeech 2025 URGENT Challenge aimed to advance universal, robust, and generalizable speech enhancement by unifying speech enhancement tasks across a wide variety of conditions, including seven different distortion types and five…

Sound · Computer Science 2025-10-01 Rong Chao , Rauf Nasretdinov , Yu-Chiang Frank Wang , Ante Jukić , Szu-Wei Fu , Yu Tsao

State space models (SSMs) for language modelling promise an efficient and performant alternative to quadratic-attention Transformers, yet show variable performance on recalling basic information from the context. While performance on…

Computation and Language · Computer Science 2026-02-02 Aryaman Arora , Neil Rathi , Nikil Roashan Selvam , Róbert Csordás , Dan Jurafsky , Christopher Potts

Transformer and its derivatives have achieved success in diverse tasks across computer vision, natural language processing, and speech processing. To reduce the complexity of computations within the multi-head self-attention mechanism in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-29 Xiangyu Zhang , Qiquan Zhang , Hexin Liu , Tianyi Xiao , Xinyuan Qian , Beena Ahmed , Eliathamby Ambikairajah , Haizhou Li , Julien Epps

Mamba has recently emerged as a promising alternative to Transformers, offering near-linear complexity in processing sequential data. However, while channels in time series (TS) data have no specific order in general, recent studies have…

Machine Learning · Computer Science 2024-11-01 Seunghan Lee , Juri Hong , Kibok Lee , Taeyoung Park

We propose ss-Mamba, a novel foundation model that enhances time series forecasting by integrating semantic-aware embeddings and adaptive spline-based temporal encoding within a selective state-space modeling framework. Building upon the…

Machine Learning · Computer Science 2025-06-19 Zuochen Ye

The rapid growth of long-duration, high-definition videos has made efficient video quality assessment (VQA) a critical challenge. Existing research typically tackles this problem through two main strategies: reducing model parameters and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Yachun Mi , Yu Li , Weicheng Meng , Chaofeng Chen , Chen Hui , Shaohui Liu