中文
相关论文

相关论文: BrainMT: A Hybrid Mamba-Transformer Architecture f…

200 篇论文

The effectiveness and efficiency of modeling complex spectral-spatial relations are both crucial for Hyperspectral image (HSI) classification. Most existing methods based on CNNs and transformers still suffer from heavy computational…

计算机视觉与模式识别 · 计算机科学 2024-06-12 Jiamu Sheng , Jingyi Zhou , Jiong Wang , Peng Ye , Jiayuan Fan

Recent 2D CNN-based domain adaptation approaches struggle with long-range dependencies due to limited receptive fields, making it difficult to adapt to target domains with significant spatial distribution changes. While transformer-based…

计算机视觉与模式识别 · 计算机科学 2025-05-08 A. Enes Doruk , Hasan F. Ates

Recent advances in deep learning for vision tasks have seen the rise of State Space Models (SSMs) like Mamba, celebrated for their linear scalability. However, their adaptation to 2D visual data often necessitates complex modifications that…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Minjong Cheon , Changbae Mun

Radiotherapy workflows for oncological patients increasingly rely on multi-modal medical imaging, commonly involving both Magnetic Resonance Imaging (MRI) and Computed Tomography (CT). MRI-only treatment planning has emerged as an…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Konstantinos Barmpounakis , Theodoros P. Vagenas , Maria Vakalopoulou , George K. Matsopoulos

Recently, State Space Models (SSMs), with Mamba as a prime example, have shown great promise for long-range dependency modeling with linear complexity. Then, Vision Mamba and the subsequent architectures are presented successively, and they…

图像与视频处理 · 电气工程与系统科学 2024-06-11 Zhongping Ji

Recurrent neural networks and Transformers have recently dominated most applications in hyperspectral (HS) imaging, owing to their capability to capture long-range dependencies from spectrum sequences. However, despite the success of these…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Jing Yao , Danfeng Hong , Chenyu Li , Jocelyn Chanussot

Human-human interaction generation has garnered significant attention in motion synthesis due to its vital role in understanding humans as social beings. However, existing methods typically rely on transformer-based architectures, which…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Zizhao Wu , Yingying Sun , Yiming Chen , Xiaoling Gu , Ruyu Liu , Jiazhou Chen

Skeleton-based action recognition has garnered significant attention in the computer vision community. Inspired by the recent success of the selective state-space model (SSM) Mamba in modeling 1D temporal sequences, we propose TSkel-Mamba,…

计算机视觉与模式识别 · 计算机科学 2025-12-15 Yanan Liu , Jun Liu , Hao Zhang , Dan Xu , Hossein Rahmani , Mohammed Bennamoun , Qiuhong Ke

In data-scarce scenarios, deep learning models often overfit to noise and irrelevant patterns, which limits their ability to generalize to unseen samples. To address these challenges in medical image segmentation, we introduce Diff-UMamba,…

计算机视觉与模式识别 · 计算机科学 2026-04-06 Dhruv Jain , Romain Modzelewski , Romain Herault , Clement Chatelain , Eva Torfeh , Sebastien Thureau

Tooth segmentation is a pivotal step in modern digital dentistry, essential for applications across orthodontic diagnosis and treatment planning. Despite its importance, this process is fraught with challenges due to the high noise and low…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Jing Hao , Yonghui Zhu , Lei He , Moyun Liu , James Kit Hon Tsoi , Kuo Feng Hung

Multi-modality image fusion aims to integrate the merits of images from different sources and render high-quality fusion images. However, existing feature extraction and fusion methods are either constrained by inherent local reduction bias…

计算机视觉与模式识别 · 计算机科学 2024-09-06 Chenguang Zhu , Shan Gao , Huafeng Chen , Guangqian Guo , Chaowei Wang , Yaoxing Wang , Chen Shu Lei , Quanjiang Fan

In the field of multimodal medical data analysis, leveraging diverse types of data and understanding their hidden relationships continues to be a research focus. The main challenges lie in effectively modeling the complex interactions…

计算机视觉与模式识别 · 计算机科学 2025-08-26 Xuhao Shan , Ruiquan Ge , Jikui Liu , Linglong Wu , Chi Zhang , Siqi Liu , Wenjian Qin , Wenwen Min , Ahmed Elazab , Changmiao Wang

Handling lengthy context is crucial for enhancing the recognition and understanding capabilities of multimodal large language models (MLLMs) in applications such as processing high-resolution images or high frame rate videos. The rise in…

计算机视觉与模式识别 · 计算机科学 2024-11-14 Jianing Zhou , Han Li , Shuai Zhang , Ning Xie , Ruijie Wang , Xiaohan Nie , Sheng Liu , Lingyun Wang

Numerous CNN-Transformer hybrid models rely on high-complexity global attention mechanisms to capture long-range dependencies, which introduces non-linear computational complexity and leads to significant resource consumption. Although…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Dayu Tan , Ziwei Zhang , Yansan Su , Xin Peng , Yike Dai , Chunhou Zheng , Weimin Zhong

Mamba is emerging as a novel approach to overcome the challenges faced by Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) in computer vision. While CNNs excel at extracting local features, they often struggle to capture…

计算机视觉与模式识别 · 计算机科学 2024-10-07 Md Maklachur Rahman , Abdullah Aman Tutul , Ankur Nath , Lamyanba Laishram , Soon Ki Jung , Tracy Hammond

Image generation models have encountered challenges related to scalability and quadratic complexity, primarily due to the reliance on Transformer-based backbones. In this study, we introduce MaskMamba, a novel hybrid model that combines…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Wenchao Chen , Liqiang Niu , Ziyao Lu , Fandong Meng , Jie Zhou

Multivariate Time series forecasting is crucial in domains such as transportation, meteorology, and finance, especially for predicting extreme weather events. State-of-the-art methods predominantly rely on Transformer architectures, which…

机器学习 · 计算机科学 2024-10-16 Li Wu , Wenbin Pei , Jiulong Jiao , Qiang Zhang

As remote sensing imaging technology continues to advance and evolve, processing high-resolution and diversified satellite imagery to improve segmentation accuracy and enhance interpretation efficiency emerg as a pivotal area of…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Yice Cao , Chenchen Liu , Zhenhua Wu , Wenxin Yao , Liu Xiong , Jie Chen , Zhixiang Huang

Multi-modal Emotion Recognition in Conversation (MERC) has received considerable attention in various fields, e.g., human-computer interaction and recommendation systems. Most existing works perform feature disentanglement and fusion to…

计算与语言 · 计算机科学 2024-05-06 Yuntao Shou , Tao Meng , Fuchen Zhang , Nan Yin , Keqin Li

With the explosive growth of data, long-sequence modeling has become increasingly important in tasks such as natural language processing and bioinformatics. However, existing methods face inherent trade-offs between efficiency and memory.…

机器学习 · 计算机科学 2025-10-07 Youjin Wang , Yangjingyi Chen , Jiahao Yan , Jiaxuan Lu , Xiao Sun