English
Related papers

Related papers: Flatten Wisely: How Patch Order Shapes Mamba-Power…

200 papers

State Space Models (SSMs) show significant potential for long-sequence modeling, but their reliance on input order conflicts with the irregular nature of point clouds. Existing approaches often rely on predefined serialization schemes whose…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Bin Liu , Chunyang Wang , Xuelian Liu , Ge Zhang

This report provides an overview of the current state of the art deep learning architectures and optimisation techniques, and uses the ADNI hippocampus MRI dataset as an example to compare the effectiveness and efficiency of different…

Machine Learning · Computer Science 2015-05-11 Matthew Lai

To address complex pathological feature extraction in automated cardiac MRI segmentation, we propose SAMba-UNet, a novel dual-encoder architecture that synergistically combines the vision foundation model SAM2, the linear-complexity…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Guohao Huo , Ruiting Dai , Ling Shao , Hao Tang

Mamba-based models have drawn much attention in offline RL. However, their selective mechanism often detrimental when key steps in RL sequences are omitted. To address these issues, we propose a simple yet effective structure, called…

Machine Learning · Computer Science 2026-02-27 Wall Kim , Chaeyoung Song , Hanul Kim

Multimodal Large Language Models (MLLMs) have attracted much attention for their multifunctionality. However, traditional Transformer architectures incur significant overhead due to their secondary computational complexity. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Wenjun Huang , Jiakai Pan , Jiahao Tang , Yanyu Ding , Yifei Xing , Yuhe Wang , Zhengzhuo Wang , Jianguo Hu

Deep state-space models (SSMs), like recent Mamba architectures, are emerging as a promising alternative to CNN and Transformer networks. Existing Mamba-based restoration methods process visual data by leveraging a flatten-and-scan strategy…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Hanzhou Liu , Chengkai Liu , Jiacong Xu , Peng Jiang , Mi Lu

As remote sensing imaging technology continues to advance and evolve, processing high-resolution and diversified satellite imagery to improve segmentation accuracy and enhance interpretation efficiency emerg as a pivotal area of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yice Cao , Chenchen Liu , Zhenhua Wu , Wenxin Yao , Liu Xiong , Jie Chen , Zhixiang Huang

State-space models (SSMs), particularly the Mamba architecture, have emerged as powerful alternatives to Transformers for sequence modeling, offering linear-time complexity and competitive performance across diverse tasks. However, their…

Machine Learning · Computer Science 2025-09-30 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma

Survival analysis using whole-slide images (WSIs) is crucial in cancer research. Despite significant successes, pathology images typically only provide slide-level labels, which hinders the learning of discriminative representations from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Chengsheng Zhang , Linhao Qu , Xiaoyu Liu , Zhijian Song

Deep learning has been extensively applied in medical image reconstruction, where Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) represent the predominant paradigms, each possessing distinct advantages and inherent…

In recent years, Transformers have become the de-facto architecture for sequence modeling on text and a variety of multi-dimensional data, such as images and video. However, the use of self-attention layers in a Transformer incurs…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Shufan Li , Harkanwar Singh , Aditya Grover

Neuron segmentation is the cornerstone of reconstructing comprehensive neuronal connectomes, which is essential for deciphering the functional organization of the brain. The irregular morphology and densely intertwined structures of neurons…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Liuyun Jiang , Yizhuo Lu , Yanchao Zhang , Jiazheng Liu , Hua Han

This paper investigates joint channel estimation and positioning in near-field sparse extra-large multiple-input multiple-output (XL-MIMO) orthogonal frequency division multiplexing (OFDM) systems. To achieve cooperative gains between…

Signal Processing · Electrical Eng. & Systems 2025-07-29 Zhongnian Li , Chao Zheng , Jian Xiao , Ji Wang , Gongpu Wang , Ming Zeng , Octavia A. Dobre

Medical time series are central to healthcare, enabling continuous monitoring and supporting timely clinical decisions. Despite recent progress, existing methods struggle to jointly model local-global dynamics and handle nonstationarities…

Machine Learning · Computer Science 2026-05-26 Da Zhang , Bingyu Li , Zhiyuan Zhao , Hongyuan Zhang , Junyu Gao , Xuelong Li

Mamba-based models have drawn much attention in offline RL. However, their selective mechanism often detrimental when key steps in RL sequences are omitted. To address these issues, we propose a simple yet effective structure, called…

Machine Learning · Computer Science 2026-02-27 Wall Kim , Chaeyoung Song , Hanul Kim

Remote sensing change detection (CD) has made significant advancements with the adoption of Convolutional Neural Networks (CNNs) and Transformers. While CNNs offer powerful feature extraction, they are constrained by receptive field…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 JunYao Kaung , HongWei Ge

Mamba-based models, VMamba and Vim, are a recent family of vision encoders that offer promising performance improvements in many computer vision tasks. This paper compares Mamba-based models with traditional Convolutional Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Ali Nasiri-Sarvi , Mahdi S. Hosseini , Hassan Rivaz

Purpose: A fast data-driven optimization approach, named bias-accelerated subset selection (BASS), is proposed for learning efficacious sampling patterns (SPs) with the purpose of reducing scan time in large-dimensional parallel MRI.…

Signal Processing · Electrical Eng. & Systems 2020-11-05 Marcelo V. W. Zibetti , Gabor T. Herman , Ravinder R. Regatte

Vision Transformers (ViTs) and their variants have become state-of-the-art in many computer vision tasks and are widely used as backbones in large-scale vision and vision-language foundation models. While substantial research has focused on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Massoud Dehghan , Ramona Woitek , Amirreza Mahbod

In scoliosis surgery, the limited field of view of the C-arm X-ray machine restricts the surgeons' holistic analysis of spinal structures .This paper presents an end-to-end efficient and robust intraoperative X-ray image stitching method…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Yi Li , Heting Gao , Mingde He , Jinqian Liang , Jason Gu , Wei Liu