English
Related papers

Related papers: Mamba-based Decoder-Only Approach with Bidirection…

200 papers

Human engagement estimation in conversational scenarios is essential for applications such as adaptive tutoring, remote healthcare assessment, and socially aware human--computer interaction. Engagement is a dynamic, multimodal signal…

Artificial Intelligence · Computer Science 2025-09-23 Shenwei Kang , Xin Zhang , Wen Liu , Bin Li , Yujie Liu , Bo Gao

The Mamba-based model has demonstrated outstanding performance across tasks in computer vision, natural language processing, and speech processing. However, in the realm of speech processing, the Mamba-based model's performance varies…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-12 Xiangyu Zhang , Jianbo Ma , Mostafa Shahin , Beena Ahmed , Julien Epps

Mamba is a newly proposed architecture which behaves like a recurrent neural network (RNN) with attention-like capabilities. These properties are promising for speaker diarization, as attention-based models have unsuitable memory…

Sound · Computer Science 2024-10-11 Alexis Plaquet , Naohiro Tawara , Marc Delcroix , Shota Horiguchi , Atsushi Ando , Shoko Araki

Audio super-resolution aims to enhance low-resolution signals by creating high-frequency content. In this work, we modify the architecture of AERO (a state-of-the-art system for this task) for music super-resolution. SPecifically, we…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-13 Wallace Abreu , Luiz Wagner Pereira Biscainho

Current end-to-end multi-modal models utilize different encoders and decoders to process input and output information. This separation hinders the joint representation learning of various modalities. To unify multi-modal processing, we…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Chunhao Lu , Qiang Lu , Meichen Dong , Jake Luo

Arbitrary scale super-resolution (ASSR) aims to super-resolve low-resolution images to high-resolution images at any scale using a single model, addressing the limitations of traditional super-resolution methods that are restricted to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Peizhe Xia , Long Peng , Xin Di , Renjing Pei , Yang Wang , Yang Cao , Zheng-Jun Zha

MambaVoiceCloning (MVC) asks whether the conditioning path of diffusion-based TTS can be made fully SSM-only at inference, removing all attention and explicit RNN-style recurrence layers across text, rhythm, and prosody, while preserving or…

Sound · Computer Science 2026-04-02 Sahil Kumar , Namrataben Patel , Honggang Wang , Youshan Zhang

Recent advancements in imitation learning, particularly with the integration of LLM techniques, are set to significantly improve robots' dexterity and adaptability. This paper proposes using Mamba, a state-of-the-art architecture with…

Robotics · Computer Science 2024-09-26 Toshiaki Tsuji

Speech intelligibility prediction (SIP) models have been used as objective metrics to assess intelligibility for hearing-impaired (HI) listeners. In the Clarity Prediction Challenge 2 (CPC2), non-intrusive binaural SIP models based on…

Sound · Computer Science 2025-07-09 Katsuhiko Yamamoto , Koichi Miyazaki

Acoustic Scene Classification (ASC) is a fundamental problem in computational audition, which seeks to classify environments based on the distinctive acoustic features. In the ASC task of the APSIPA ASC 2025 Grand Challenge, the organizers…

Sound · Computer Science 2025-08-26 Bochao Sun , Dong Wang , ZhanLong Yang , Jun Yang , Han Yin

The topic of speech separation involves separating mixed speech with multiple overlapping speakers into several streams, with each stream containing speech from only one speaker. Many highly effective models have emerged and proliferated…

Sound · Computer Science 2024-12-25 Shaoxiang Dang , Tetsuya Matsumoto , Yoshinori Takeuchi , Hiroaki Kudo

Transformers are the cornerstone of modern large language models, but their quadratic computational complexity limits efficiency in long-sequence processing. Recent advancements in Mamba, a state space model (SSM) with linear complexity,…

Machine Learning · Computer Science 2026-01-08 Yixing Li , Ruobing Xie , Zhen Yang , Xingwu Sun , Shuaipeng Li , Weidong Han , Zhanhui Kang , Yu Cheng , Chengzhong Xu , Di Wang , Jie Jiang

Mamba has garnered widespread attention due to its flexible design and efficient hardware performance to process 1D sequences based on the state space model (SSM). Recent studies have attempted to apply Mamba to the visual domain by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Chengkun Wang , Wenzhao Zheng , Yuanhui Huang , Jie Zhou , Jiwen Lu

State space models (SSMs) are a promising alternative to transformers for language modeling because they use fixed memory during inference. However, this fixed memory usage requires some information loss in the hidden state when processing…

Computation and Language · Computer Science 2025-12-18 Tamanna Hossain , Robert L. Logan , Ganesh Jagadeesan , Sameer Singh , Joel Tetreault , Alejandro Jaimes

This paper introduces VMatcher, a hybrid Mamba-Transformer network for semi-dense feature matching between image pairs. Learning-based feature matching methods, whether detector-based or detector-free, achieve state-of-the-art performance…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ali Youssef

State-space models (SSMs), such as Mamba (Gu & Dao, 2023), have been proposed as alternatives to Transformer networks in language modeling, by incorporating gating, convolutions, and input-dependent token selection to mitigate the quadratic…

Machine Learning · Computer Science 2024-04-26 Jongho Park , Jaeseung Park , Zheyang Xiong , Nayoung Lee , Jaewoong Cho , Samet Oymak , Kangwook Lee , Dimitris Papailiopoulos

We propose ss-Mamba, a novel foundation model that enhances time series forecasting by integrating semantic-aware embeddings and adaptive spline-based temporal encoding within a selective state-space modeling framework. Building upon the…

Machine Learning · Computer Science 2025-06-19 Zuochen Ye

Mamba, a State Space Model (SSM) that accelerates training by recasting recurrence as a parallel scan, has recently emerged as a linearly-scaling alternative to self-attention. Because of its unidirectional nature, each state in Mamba only…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Jingwei Zhang , Xi Han , Hong Qin , Mahdi S. Hosseini , Dimitris Samaras

State Space Models (SSMs) have emerged as efficient alternatives to Transformers for sequential modeling, but their inability to leverage modality-specific features limits their performance in multi-modal pretraining. Here, we propose…

Machine Learning · Computer Science 2025-01-28 Weixin Liang , Junhong Shen , Genghan Zhang , Ning Dong , Luke Zettlemoyer , Lili Yu

We propose BiCrossMamba-ST, a robust framework for speech deepfake detection that leverages a dual-branch spectro-temporal architecture powered by bidirectional Mamba blocks and mutual cross-attention. By processing spectral sub-bands and…

Sound · Computer Science 2025-05-21 Yassine El Kheir , Tim Polzehl , Sebastian Möller