English
Related papers

Related papers: MASV: Speaker Verification with Global and Local C…

200 papers

Recently, a novel visual state space (VSS) model, referred to as Mamba, has demonstrated significant progress in modeling long sequences with linear complexity, comparable to Transformer models, thereby enhancing its adaptability for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Tao Wang , Tiecheng Bai , Chao Xu , Bin Liu , Erlei Zhang , Jiyun Huang , Hongming Zhang

Recent works have shown the remarkable superiority of transformer models in reinforcement learning (RL), where the decision-making problem is formulated as sequential generation. Transformer-based agents could emerge with self-improvement…

Machine Learning · Computer Science 2024-06-04 Sili Huang , Jifeng Hu , Zhejian Yang , Liwei Yang , Tao Luo , Hechang Chen , Lichao Sun , Bo Yang

Advanced speech synthesis technologies have enabled highly realistic speech generation, posing security risks that motivate research into audio deepfake detection (ADD). While state space models (SSMs) offer linear complexity, pure causal…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-20 Kwok-Ho Ng , Tingting Song , Yongdong Wu , Zhihua Xia

This paper introduces VMatcher, a hybrid Mamba-Transformer network for semi-dense feature matching between image pairs. Learning-based feature matching methods, whether detector-based or detector-free, achieve state-of-the-art performance…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ali Youssef

In recent years, the application of multimodal large language models (MLLM) in various fields has achieved remarkable success. However, as the foundation model for many downstream tasks, current MLLMs are composed of the well-known…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Han Zhao , Min Zhang , Wei Zhao , Pengxiang Ding , Siteng Huang , Donglin Wang

Abnormality detection in medical imaging is a critical task requiring both high efficiency and accuracy to support effective diagnosis. While convolutional neural networks (CNNs) and Transformer-based models are widely used, both face…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yao Wang , Dong Yang , Zhi Qiao , Wenjian Huang , Liuzhi Yang , Zhen Qian

Convolutional neural networks (CNN) and Transformers have made impressive progress in the field of remote sensing change detection (CD). However, both architectures have inherent shortcomings: CNN are constrained by a limited receptive…

Image and Video Processing · Electrical Eng. & Systems 2024-12-31 Hongruixuan Chen , Jian Song , Chengxi Han , Junshi Xia , Naoto Yokoya

Deep learning has achieved substantial improvement on single-channel speech enhancement tasks. However, the performance of multi-layer perceptions (MLPs)-based methods is limited by the ability to capture the long-term effective history…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Qiquan Zhang , Aaron Nicolson , Mingjiang Wang , Kuldip K. Paliwal , Chenxu Wang

The Mamba-based model has demonstrated outstanding performance across tasks in computer vision, natural language processing, and speech processing. However, in the realm of speech processing, the Mamba-based model's performance varies…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-12 Xiangyu Zhang , Jianbo Ma , Mostafa Shahin , Beena Ahmed , Julien Epps

We introduce a new music source separation model tailored for accurate vocal isolation. Unlike Transformer-based approaches, which often fail to capture intermittently occurring vocals, our model leverages Mamba2, a recent state space…

Sound · Computer Science 2026-01-01 Euiyeon Kim , Yong-Hoon Choi

Emotion Recognition in Conversations (ERCs) is a vital area within multimodal interaction research, dedicated to accurately identifying and classifying the emotions expressed by speakers throughout a conversation. Traditional ERC approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Xinran Li , Xiaomao Fan , Qingyang Wu , Xiaojiang Peng , Ye Li

Snapshot Compressive Imaging (SCI) enables fast spectral imaging but requires effective decoding algorithms for hyperspectral image (HSI) reconstruction from compressed measurements. Current CNN-based methods are limited in modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Wenzhe Tian , Haijin Zeng , Yin-Ping Zhao , Yongyong Chen , Zhen Wang , Xuelong Li

Multimodal Sentiment Analysis (MSA) with missing modalities has attracted increasing attention recently. While current Transformer-based methods leverage dense text information to maintain model robustness, their quadratic complexity…

Multimedia · Computer Science 2026-01-12 Xiang Li , Xianfu Cheng , Dezhuang Miao , Xiaoming Zhang , Zhoujun Li

Multimodal fusion has made great progress in the field of remote sensing image classification due to its ability to exploit the complementary spatial-spectral information. Deep learning methods such as CNN and Transformer have been widely…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Qingyu Wang , Xue Jiang , Guozheng Xu

Self-supervised video hashing (SSVH) is a practical task in video indexing and retrieval. Although Transformers are predominant in SSVH for their impressive temporal modeling capabilities, they often suffer from computational and memory…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jinpeng Wang , Niu Lian , Jun Li , Yuting Wang , Yan Feng , Bin Chen , Yongbing Zhang , Shu-Tao Xia

Ultrasound imaging frequently encounters challenges, such as those related to elevated noise levels, diminished spatiotemporal resolution, and the complexity of anatomical structures. These factors significantly hinder the model's ability…

Image and Video Processing · Electrical Eng. & Systems 2025-01-14 Xiaoxian Yang , Qi Wang , Kaiqi Zhang , Ke Wei , Jun Lyu , Lingchao Chen

Transformer, a deep neural network architecture, has long dominated the field of natural language processing and beyond. Nevertheless, the recent introduction of Mamba challenges its supremacy, sparks considerable interest among…

Computation and Language · Computer Science 2024-06-25 Yuchen Zou , Yineng Chen , Zuchao Li , Lefei Zhang , Hai Zhao

Linear RNN architectures, like Mamba, can be competitive with Transformer models in language modeling while having advantageous deployment characteristics. Given the focus on training large-scale Transformer models, we consider the…

Machine Learning · Computer Science 2025-06-30 Junxiong Wang , Daniele Paliotta , Avner May , Alexander M. Rush , Tri Dao

Existing RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture. Nonetheless, these methods mainly adopt imagepair appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Simiao Lai , Chang Liu , Jiawen Zhu , Ben Kang , Yang Liu , Dong Wang , Huchuan Lu

Within the family of convolutional neural networks, InceptionNeXt has shown excellent competitiveness in image classification and a number of downstream tasks. Built on parallel one-dimensional strip convolutions, however, it suffers from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Yuhang Wang , Jun Li , Zhijian Wu , Jifeng Shen , Jianhua Xu , Wankou Yang