English
Related papers

Related papers: EfficientVMamba: Atrous Selective Scan for Light W…

200 papers

Semantic segmentation of high-resolution remote sensing images is vital in downstream applications such as land-cover mapping, urban planning and disaster assessment.Existing Transformer-based methods suffer from the constraint between…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Enze Zhu , Zhan Chen , Dingkai Wang , Hanru Shi , Xiaoxuan Liu , Lei Wang

State Space Models (SSM), such as Mamba, have shown strong representation ability in modeling long-range dependency with linear complexity, achieving successful applications from high-level to low-level vision tasks. However, SSM's…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Junbo Qiao , Jincheng Liao , Wei Li , Yulun Zhang , Yong Guo , Yi Wen , Zhangxizi Qiu , Jiao Xie , Jie Hu , Shaohui Lin

Pan-sharpening involves integrating information from low-resolution multi-spectral and high-resolution panchromatic images to generate high-resolution multi-spectral counterparts. While recent advancements in the state space model,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Xuanhua He , Ke Cao , Keyu Yan , Rui Li , Chengjun Xie , Jie Zhang , Man Zhou

Weakly supervised semantic segmentation offers a label-efficient solution to train segmentation models for volumetric medical imaging. However, existing approaches often rely on 2D encoders that neglect the inherent volumetric nature of the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Yiheng Lyu , Lian Xu , Mohammed Bennamoun , Farid Boussaid , Coen Arrow , Girish Dwivedi

The rapid growth of long-duration, high-definition videos has made efficient video quality assessment (VQA) a critical challenge. Existing research typically tackles this problem through two main strategies: reducing model parameters and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Yachun Mi , Yu Li , Weicheng Meng , Chaofeng Chen , Chen Hui , Shaohui Liu

Hyperspectral image (HSI) classification remains challenging due to high spectral dimensionality, redundancy, and limited labeled data. Although convolutional neural networks (CNNs) and Vision Transformers (ViTs) achieve strong performance…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Mohammed Q. Alkhatib

Image restoration is a critical task in low-level computer vision, aiming to restore high-quality images from degraded inputs. Various models, such as convolutional neural networks (CNNs), generative adversarial networks (GANs),…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yuan Shi , Bin Xia , Xiaoyu Jin , Xing Wang , Tianyu Zhao , Xin Xia , Xuefeng Xiao , Wenming Yang

Recent Transformer-based diffusion models have shown remarkable performance, largely attributed to the ability of the self-attention mechanism to accurately capture both global and local contexts by computing all-pair interactions among…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Yunxiang Fu , Chaoqi Chen , Yizhou Yu

The Mamba layer offers an efficient selective state space model (SSM) that is highly effective in modeling multiple domains, including NLP, long-range sequence processing, and computer vision. Selective SSMs are viewed as dual models, in…

Machine Learning · Computer Science 2024-04-02 Ameen Ali , Itamar Zimerman , Lior Wolf

Transformers have become dominant in large-scale deep learning tasks across various domains, including text, 2D and 3D vision. However, the quadratic complexity of their attention mechanism limits their efficiency as the sequence length…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Nursena Köprücü , Destiny Okpekpe , Antonio Orvieto

Multispectral fusion object detection is a critical task for edge-based maritime surveillance and remote sensing, demanding both high inference efficiency and robust feature representation for high-resolution inputs. However, current State…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Qianqian Zhang , Leon Tabaro , Ahmed M. Abdelmoniem , Junshe An

Image restoration requires simultaneously preserving fine-grained local structures and maintaining long-range spatial coherence. While convolutional networks struggle with limited receptive fields, and Transformers incur quadratic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Mohammed Hassanin , Nour Moustafa , Weijian Deng , Ibrahim Radwan

Linear State Space Models (SSMs) offer remarkable performance gains in efficient sequence modeling, with constant inference-time computation and memory complexity. Recent advances, such as Mamba, further enhance SSMs with input-dependent…

Machine Learning · Computer Science 2025-06-24 Zheng Zhan , Liliang Ren , Shuohang Wang , Liyuan Liu , Yang Liu , Yeyun Gong , Yanzhi Wang , Yelong Shen

State-space models (SSMs), exemplified by S4, have introduced a novel context modeling method by integrating state-space techniques into deep learning. However, they struggle with global context modeling due to their data-independent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Hamid Suleman , Syed Talal Wasim , Muzammal Naseer , Juergen Gall

State space models (SSMs) reduce the quadratic complexity of transformers by leveraging linear recurrence. Recently, VMamba has emerged as a strong SSM-based vision backbone, yet remains bottlenecked by spatial redundancy in its…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Tien-Yu Chi , Hung-Yueh Chiang , Diana Marculescu , Kai-Chiang Wu

Event cameras draw inspiration from biological systems, boasting low latency and high dynamic range while consuming minimal power. The most current approach to processing Event Cloud often involves converting it into frame-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Hongwei Ren , Yue Zhou , Jiadong Zhu , Haotian Fu , Yulong Huang , Xiaopeng Lin , Yuetong Fang , Fei Ma , Hao Yu , Bojun Cheng

Traffic flow prediction, a critical aspect of intelligent transportation systems, has been increasingly popular in the field of artificial intelligence, driven by the availability of extensive traffic data. The current challenges of traffic…

Machine Learning · Computer Science 2024-05-21 Zhiqi Shao , Michael G. H. Bell , Ze Wang , D. Glenn Geers , Haoning Xi , Junbin Gao

Learned visual compression is an important and active task in multimedia. Existing approaches have explored various CNN- and Transformer-based designs to model content distribution and eliminate redundancy, where balancing efficacy (i.e.,…

Image and Video Processing · Electrical Eng. & Systems 2024-05-29 Shiyu Qin , Jinpeng Wang , Yimin Zhou , Bin Chen , Tianci Luo , Baoyi An , Tao Dai , Shutao Xia , Yaowei Wang

Foundational models have significantly advanced in natural language processing (NLP) and computer vision (CV), with the Transformer architecture becoming a standard backbone. However, the Transformer's quadratic complexity poses challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Lv Tang , HaoKe Xiao , Peng-Tao Jiang , Hao Zhang , Jinwei Chen , Bo Li

State space models (SSMs) have emerged as an efficient alternative to transformer-based models, offering linear complexity that scales better than transformers. One of the latest advances in SSMs, Mamba, introduces a selective scan…

Machine Learning · Computer Science 2025-03-03 Junpeng Wang , Chin-Chia Michael Yeh , Uday Singh Saini , Mahashweta Das