English
Related papers

Related papers: A Mamba-based Network for Semi-supervised Singing …

200 papers

Stereo disparity estimation is crucial for obtaining depth information in robot-assisted minimally invasive surgery (RAMIS). While current deep learning methods have made significant advancements, challenges remain in achieving an optimal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Xu Wang , Jialang Xu , Shuai Zhang , Baoru Huang , Danail Stoyanov , Evangelos B. Mazomenos

Music structure analysis (MSA) methods traditionally search for musically meaningful patterns in audio: homogeneity, repetition, novelty, and segment-length regularity. Hand-crafted audio features such as MFCCs or chromagrams are often used…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-03 Ju-Chiang Wang , Jordan B. L. Smith , Wei-Tsung Lu , Xuchen Song

Advances in speech synthesis intensify security threats, motivating real-time deepfake detection research. We investigate whether bidirectional Mamba can serve as a competitive alternative to Self-Attention in detecting synthetic speech.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-14 Xi Xuan , Zimo Zhu , Wenxin Zhang , Yi-Cheng Lin , Tomi Kinnunen

In the Sound Event Localization and Detection (SELD) task, Transformer-based models have demonstrated impressive capabilities. However, the quadratic complexity of the Transformer's self-attention mechanism results in computational…

Sound · Computer Science 2024-08-12 Da Mu , Zhicheng Zhang , Haobo Yue , Zehao Wang , Jin Tang , Jianqin Yin

Despite its widespread adoption as the prominent neural architecture, the Transformer has spurred several independent lines of work to address its limitations. One such approach is selective state space models, which have demonstrated…

Sound · Computer Science 2024-06-11 Sarthak Yadav , Zheng-Hua Tan

Transformer-based methods have achieved remarkable performance in event-based object detection, owing to the global modeling ability. However, they neglect the influence of non-event and noisy regions and process them uniformly, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Nan Yang , Yang Wang , Zhanwen Liu , Meng Li , Yisheng An , Xiangmo Zhao

Source-free domain adaptation (SFDA) tackles the critical challenge of adapting source-pretrained models to unlabeled target domains without access to source data, overcoming data privacy and storage limitations in real-world applications.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Xi Chen , Hongxun Yao , Sicheng Zhao , Jiankun Zhu , Jing Jiang , Kui Jiang

Audio super-resolution aims to enhance low-resolution signals by creating high-frequency content. In this work, we modify the architecture of AERO (a state-of-the-art system for this task) for music super-resolution. SPecifically, we…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-13 Wallace Abreu , Luiz Wagner Pereira Biscainho

Video mirror detection has received significant research attention, yet existing methods suffer from limited performance and robustness. These approaches often over-rely on single, unreliable dynamic features, and are typically built on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Rui Song , Jiaying Lin , Rynson W. H. Lau

While Mamba has demonstrated strong performance in language modeling, its potential as a speech self-supervised learning (SSL) model remains underexplored, with prior studies limited to isolated tasks. To address this, we explore…

Computation and Language · Computer Science 2026-04-21 Tzu-Quan Lin , Heng-Cheng Kuo , Tzu-Chieh Wei , Hsi-Chun Cheng , Chun Wei Chen , Hsien-Fu Hsiao , Yu Tsao , Hung-yi Lee

Video anomaly detection (VAD) has been extensively researched due to its potential for intelligent video systems. However, most existing methods based on CNNs and transformers still suffer from substantial computational burdens and have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Zhangxun Li , Mengyang Zhao , Xuan Yang , Yang Liu , Jiamu Sheng , Xinhua Zeng , Tian Wang , Kewei Wu , Yu-Gang Jiang

Radiography imaging protocols target on specific anatomical regions, resulting in highly consistent images with recurrent structural patterns across patients. Recent advances in medical anomaly detection have demonstrated the effectiveness…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Rui Pan , Ruiying Lu

The recent surge in State Space Models (SSMs), particularly the emergence of Mamba, has established them as strong alternatives or complementary modules to Transformers across diverse domains. In this work, we aim to explore the potential…

Sound · Computer Science 2025-07-10 Wei-Jaw Lee , Fang-Chih Hsieh , Xuanjun Chen , Fang-Duo Tsai , Yi-Hsuan Yang

Music source separation (MSS) aims to separate mixed music into its distinct tracks, such as vocals, bass, drums, and more. MSS is considered to be a challenging audio separation task due to the complexity of music signals. Although the RNN…

Sound · Computer Science 2024-09-16 Jinglin Bai , Yuan Fang , Jiajie Wang , Xueliang Zhang

The recent empirical success of Mamba and other selective state space models (SSMs) has renewed interest in non-attention architectures for sequence modeling, yet their theoretical foundations remain underexplored. We present a first-step…

Machine Learning · Computer Science 2026-02-16 Mugunthan Shandirasegaran , Hongkang Li , Songyang Zhang , Meng Wang , Shuai Zhang

Melody preservation is crucial in singing voice conversion (SVC). However, in many scenarios, audio is often accompanied with background music (BGM), which can cause audio distortion and interfere with the extraction of melody and other key…

Sound · Computer Science 2025-02-10 Wei Chen , Binzhu Sha , Jing Yang , Zhuo Wang , Fan Fan , Zhiyong Wu

In the field of multi-source remote sensing image classification, remarkable progress has been made by using Convolutional Neural Network (CNN) and Transformer. Recently, Mamba-based methods built upon the State Space Model (SSM) have shown…

Image and Video Processing · Electrical Eng. & Systems 2025-01-28 Feng Gao , Xuepeng Jin , Xiaowei Zhou , Junyu Dong , Qian Du

Low-resolution fine-grained image classification has recently made significant progress, largely thanks to the super-resolution techniques and knowledge distillation methods. However, these approaches lead to an exponential increase in the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Yao Chen , Jiabao Wang , Peichao Wang , Rui Zhang , Yang Li

Mamba-based models have drawn much attention in offline RL. However, their selective mechanism often detrimental when key steps in RL sequences are omitted. To address these issues, we propose a simple yet effective structure, called…

Machine Learning · Computer Science 2026-02-27 Wall Kim , Chaeyoung Song , Hanul Kim

Although the complex spectrum-based speech enhancement(SE) methods have achieved significant performance, coupling amplitude and phase can lead to a compensation effect, where amplitude information is sacrificed to compensate for the phase…

Sound · Computer Science 2024-12-30 Cunhang Fan , Enrui Liu , Andong Li , Jianhua Tao , Jian Zhou , Jiahao Li , Chengshi Zheng , Zhao Lv