English
Related papers

Related papers: PoinTramba: A Hybrid Transformer-Mamba Framework f…

200 papers

Recent advances in deep learning have made it possible to predict phenotypic measures directly from functional magnetic resonance imaging (fMRI) brain volumes, sparking significant interest in the neuroimaging community. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Arunkumar Kannan , Martin A. Lindquist , Brian Caffo

Transformers have widely adopted attention networks for sequence mixing and MLPs for channel mixing, playing a pivotal role in achieving breakthroughs across domains. However, recent literature highlights issues with attention networks,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Badri N. Patro , Vijay S. Agneeswaran

In this effort, we propose using the Mamba for handling tabular data in personalized recommendation systems. We present the \textit{FT-Mamba} (Feature Tokenizer\,$+$\,Mamba), a novel hybrid model that replaces Transformer layers with Mamba…

Information Retrieval · Computer Science 2024-09-27 Andrew Starnes , Clayton Webster

Transformer structure has achieved great success in multiple applied machine learning communities, such as natural language processing (NLP), computer vision (CV) and information retrieval (IR). Transformer architecture's core mechanism\,…

Information Retrieval · Computer Science 2026-01-06 Zhichao Xu

Point cloud segmentation is crucial for robotic visual perception and environmental understanding, enabling applications such as robotic navigation and 3D reconstruction. However, handling the sparse and unordered nature of point cloud data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Tao Wang , Wei Wen , Jingzhi Zhai , Kang Xu , Haoming Luo

Transformer, a deep neural network architecture, has long dominated the field of natural language processing and beyond. Nevertheless, the recent introduction of Mamba challenges its supremacy, sparks considerable interest among…

Computation and Language · Computer Science 2024-06-25 Yuchen Zou , Yineng Chen , Zuchao Li , Lefei Zhang , Hai Zhao

In recent years, deep learning has shown near-expert performance in segmenting complex medical tissues and tumors. However, existing models are often task-specific, with performance varying across modalities and anatomical regions.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 T-Mai Bui , Fares Bougourzi , Fadi Dornaika , Vinh Truong Hoang

In the era of large-scale pre-trained models, effectively adapting general knowledge to specific affective computing tasks remains a challenge, particularly regarding computational efficiency and multimodal heterogeneity. While…

Artificial Intelligence · Computer Science 2026-03-20 Yan Li , Yifei Xing , Xiangyuan Lan , Xin Li , Haifeng Chen , Dongmei Jiang

Attention mechanisms have been widely used to capture long-range dependencies among nodes in Graph Transformers. Bottlenecked by the quadratic computational cost, attention mechanisms fail to scale in large graphs. Recent improvements in…

Machine Learning · Computer Science 2024-02-02 Chloe Wang , Oleksii Tsepa , Jun Ma , Bo Wang

Mamba is an effective state space model with linear computation complexity. It has recently shown impressive efficiency in dealing with high-resolution inputs across various vision tasks. In this paper, we reveal that the powerful Mamba…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Dongchen Han , Ziyi Wang , Zhuofan Xia , Yizeng Han , Yifan Pu , Chunjiang Ge , Jun Song , Shiji Song , Bo Zheng , Gao Huang

Weakly supervised semantic segmentation offers a label-efficient solution to train segmentation models for volumetric medical imaging. However, existing approaches often rely on 2D encoders that neglect the inherent volumetric nature of the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Yiheng Lyu , Lian Xu , Mohammed Bennamoun , Farid Boussaid , Coen Arrow , Girish Dwivedi

In recent years, Transformers-based models have made significant progress in the field of image restoration by leveraging their inherent ability to capture complex contextual features. Recently, Mamba models have made a splash in the field…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Juan Wen , Weiyan Hou , Luc Van Gool , Radu Timofte

In multivariate time-series forecasting (MTSF), extracting the temporal correlations of the input sequences is crucial. While popular Transformer-based predictive models can perform well, their quadratic computational complexity results in…

Machine Learning · Computer Science 2024-07-23 Shusen Ma , Yu Kang , Peng Bai , Yun-Bo Zhao

Long-short range time series forecasting is essential for predicting future trends and patterns over extended periods. While deep learning models such as Transformers have made significant strides in advancing time series forecasting, they…

Machine Learning · Computer Science 2024-09-16 Wenqing Zhang , Junming Huang , Ruotong Wang , Changsong Wei , Wenqian Huang , Yuxin Qiao

Recent efforts on image restoration have focused on developing "all-in-one" models that can handle different degradation types and levels within single model. However, most of mainstream Transformer-based ones confronted with dilemma…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Aiwen Jiang , Hourong Chen , Zhiwen Chen , Jihua Ye , Mingwen Wang

The Transformer model, particularly its cross-attention module, is widely used for feature fusion in target sound extraction which extracts the signal of interest based on given clues. Despite its effectiveness, this approach suffers from…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-26 Donghang Wu , Yiwen Wang , Xihong Wu , Tianshu Qu

Recent advancements in imitation learning have been largely fueled by the integration of sequence models, which provide a structured flow of information to effectively mimic task behaviours. Currently, Decision Transformer (DT) and…

Machine Learning · Computer Science 2024-10-18 André Correia , Luís A. Alexandre

Transformers and Mamba, initially invented for natural language processing, have inspired backbone architectures for visual recognition. Recent studies integrated Local Attention Transformers with Mamba to capture both local details and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Meng Lou , Yunxiang Fu , Yizhou Yu

Existing deraining Transformers employ self-attention mechanisms with fixed-range windows or along channel dimensions, limiting the exploitation of non-local receptive fields. In response to this issue, we introduce a novel dual-branch…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Shangquan Sun , Wenqi Ren , Juxiang Zhou , Jianhou Gan , Rui Wang , Xiaochun Cao

Accurate microscopic medical image segmentation plays a crucial role in diagnosing various cancerous cells and identifying tumors. Driven by advancements in deep learning, convolutional neural networks (CNNs) and transformer-based models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Daniya Najiha Abdul Kareem , Abdul Hannan , Mubashir Noman , Jean Lahoud , Mustansar Fiaz , Hisham Cholakkal