English
Related papers

Related papers: Vim-F: Visual State Space Model Benefiting from Le…

200 papers

State space models (SSMs) have emerged as an efficient alternative to transformer-based models, offering linear complexity that scales better than transformers. One of the latest advances in SSMs, Mamba, introduces a selective scan…

Machine Learning · Computer Science 2025-03-03 Junpeng Wang , Chin-Chia Michael Yeh , Uday Singh Saini , Mahashweta Das

Structured State Space Models (SSMs) have emerged as a transformative paradigm in sequence modeling, addressing critical limitations of Recurrent Neural Networks (RNNs) and Transformers, namely, vanishing gradients, sequential computation…

Recent learned image compression (LIC) leverages Mamba-style state-space models (SSMs) for global receptive fields with linear complexity. However, the standard Mamba adopts content-agnostic, predefined raster (or multi-directional) scans…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yunuo Chen , Zezheng Lyu , Bing He , Hongwei Hu , Qi Wang , Yuan Tian , Li Song , Wenjun Zhang , Guo Lu

Deep learning methods, especially Convolutional Neural Networks (CNN) and Vision Transformer (ViT), are frequently employed to perform semantic segmentation of high-resolution remotely sensed images. However, CNNs are constrained by their…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Qinfeng Zhu , Yuan Fang , Yuanzhi Cai , Cheng Chen , Lei Fan

Multi-Modal Image Fusion (MMIF) aims to integrate complementary image information from different modalities to produce informative images. Previous deep learning-based MMIF methods generally adopt Convolutional Neural Networks (CNNs) or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Hui Sun , Long Lv , Pingping Zhang , Tongdan Tang , Feng Tian , Weibing Sun , Huchuan Lu

State Space Models (SSMs)-most notably RNNs-have historically played a central role in sequential modeling. Although attention mechanisms such as Transformers have since dominated due to their ability to model global context, their…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Hyun-kyu Ko , Youbin Kim , Jihyeon Park , Dongheok Park , Gyeongjin Kang , Wonjun Cho , Hyung Yi , Eunbyung Park

In the field of medical image segmentation, models based on both CNN and Transformer have been thoroughly investigated. However, CNNs have limited modeling capabilities for long-range dependencies, making it challenging to exploit the…

Image and Video Processing · Electrical Eng. & Systems 2024-09-10 Mingya Zhang , Zhihao Chen , Yiyuan Ge , Xianping Tao

The Transformer architecture has shown a remarkable ability in modeling global relationships. However, it poses a significant computational challenge when processing high-dimensional medical images. This hinders its development and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Zhaohu Xing , Tian Ye , Yijun Yang , Guang Liu , Lei Zhu

Hyperspectral image (HSI) classification remains challenging due to high spectral dimensionality, redundancy, and limited labeled data. Although convolutional neural networks (CNNs) and Vision Transformers (ViTs) achieve strong performance…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Mohammed Q. Alkhatib

U-shaped architectures have long dominated the field of medical image segmentation, while Transformers are widely employed for modeling long-range dependencies. The former typically handles scale variations implicitly by aggregating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yanhua Zhang , Ke Zhang , Jingyu Wang , Gabriella Balestra , Samanta Rosati , Yulin Wu , Wuwei Wang , Valentina Giannini

State Space Models (SSMs) have the advantage of keeping linear computational complexity compared to attention modules in transformers, and have been applied to vision tasks as a new type of powerful vision foundation model. Inspired by the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Zheng Zhan , Zhenglun Kong , Yifan Gong , Yushu Wu , Zichong Meng , Hangyu Zheng , Xuan Shen , Stratis Ioannidis , Wei Niu , Pu Zhao , Yanzhi Wang

This paper introduces VMatcher, a hybrid Mamba-Transformer network for semi-dense feature matching between image pairs. Learning-based feature matching methods, whether detector-based or detector-free, achieve state-of-the-art performance…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ali Youssef

Physics-informed machine learning (PIML) has emerged as a promising alternative to classical methods for predicting dynamical systems, offering faster and more generalizable solutions. However, existing models, including recurrent neural…

Machine Learning · Computer Science 2025-01-28 Zheyuan Hu , Nazanin Ahmadi Daryakenari , Qianli Shen , Kenji Kawaguchi , George Em Karniadakis

In recent years, Transformers have become the de-facto architecture for sequence modeling on text and a variety of multi-dimensional data, such as images and video. However, the use of self-attention layers in a Transformer incurs…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Shufan Li , Harkanwar Singh , Aditya Grover

Extracting actionable knowledge from industrial visual data is fundamentally bottlenecked by extreme class imbalance and the prohibitive computational complexity of modern foundation models. In semi-conductor manufacturing, identifying…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Satwik Sai Prakash Sahoo , Jyoti Prakash Sahoo , Ting Wang , Subrota Kumar Mondal

Pathological diagnosis is highly reliant on image analysis, where Regions of Interest (ROIs) serve as the primary basis for diagnostic evidence, while whole-slide image (WSI)-level tasks primarily capture aggregated patterns. To extract…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Enhui Chai , Sicheng Chen , Tianyi Zhang , Xingyu Li , Tianxiang Cui

Early and accurate diagnosis of brain tumors is crucial for improving patient survival rates. However, the detection and classification of brain tumors are challenging due to their diverse types and complex morphological characteristics.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Yinyi Lai , Anbo Cao , Yuan Gao , Jiaqi Shang , Zongyu Li , Jia Guo

Medical image segmentation plays an important role in computer-aided diagnosis. Traditional convolution-based U-shape segmentation architectures are usually limited by the local receptive field. Existing vision transformers have been widely…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Qing Xu , Yanming Chen , Yue Li , Ziyu Liu , Zhenye Lou , Yixuan Zhang , Xiangjian He

Deep image hashing aims to enable effective large-scale image retrieval by mapping the input images into simple binary hash codes through deep neural networks. More recently, Vision Mamba with linear time complexity has attracted extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Chao He , Hongxi Wei

Translating NIR to the visible spectrum is challenging due to cross-domain complexities. Current models struggle to balance a broad receptive field with computational efficiency, limiting practical use. Although the Selective Structured…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Huiyu Zhai , Guang Jin , Xingxing Yang , Guosheng Kang