English
Related papers

Related papers: Similarity-Aware Selective State-Space Modeling fo…

200 papers

Recent sequence modeling approaches using selective state space sequence models, referred to as Mamba models, have seen a surge of interest. These models allow efficient processing of long sequences in linear time and are rapidly being…

Machine Learning · Computer Science 2025-01-16 Farnoush Rezaei Jafari , Grégoire Montavon , Klaus-Robert Müller , Oliver Eberle

The task of inverting real images into StyleGAN's latent space to manipulate their attributes has been extensively studied. However, existing GAN inversion methods struggle to balance high reconstruction quality, effective editability, and…

Image and Video Processing · Electrical Eng. & Systems 2025-05-23 Jhon Lopez , Carlos Hinojosa , Henry Arguello , Bernard Ghanem

Transformers and Mamba, initially invented for natural language processing, have inspired backbone architectures for visual recognition. Recent studies integrated Local Attention Transformers with Mamba to capture both local details and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Meng Lou , Yunxiang Fu , Yizhou Yu

Recent advances in semantic correspondence have been largely driven by the use of pre-trained large-scale models. However, a limitation of these approaches is their dependence on high-resolution input images to achieve optimal performance,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Hailing Jin , Huiying Li

Vision transformers have significantly advanced the field of computer vision, offering robust modeling capabilities and global receptive field. However, their high computational demands limit their applicability in processing long…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Yuheng Shi , Minjing Dong , Mingjia Li , Chang Xu

Recently, a novel visual state space (VSS) model, referred to as Mamba, has demonstrated significant progress in modeling long sequences with linear complexity, comparable to Transformer models, thereby enhancing its adaptability for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Tao Wang , Tiecheng Bai , Chao Xu , Bin Liu , Erlei Zhang , Jiyun Huang , Hongming Zhang

In this study, we focus on video captioning by fully open multimodal large language models (MLLMs). The comprehension of visual sequences is challenging because of their intricate temporal dependencies and substantial sequence length. The…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Daichi Yashima , Shuhei Kurita , Yusuke Oda , Shuntaro Suzuki , Seitaro Otsuki , Komei Sugiura

Pan-sharpening aims to generate high-resolution multispectral (HRMS) images by integrating a high-resolution panchromatic (PAN) image with its corresponding low-resolution multispectral (MS) image. To achieve effective fusion, it is crucial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Yingying Wang , Xuanhua He , Chen Wu , Jialing Huang , Suiyun Zhang , Rui Liu , Xinghao Ding , Haoxuan Che

State space models (SSMs), such as Mamba, have emerged as an efficient alternative to transformers for long-context sequence modeling. However, despite their growing adoption, SSMs lack the interpretability tools that have been crucial for…

Computation and Language · Computer Science 2025-02-26 Hugo Pitorro , Marcos Treviso

Robust feature representations are essential for learning-based Multi-View Stereo (MVS), which relies on accurate feature matching. Recent MVS methods leverage Transformers to capture long-range dependencies based on local features…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Jianfei Jiang , Qiankun Liu , Hongyuan Liu , Haochen Yu , Liyong Wang , Jiansheng Chen , Huimin Ma

Recent advancements in Mamba have shown promising results in image restoration. These methods typically flatten 2D images into multiple distinct 1D sequences along rows and columns, process each sequence independently using selective scan…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Boyun Li , Haiyu Zhao , Wenxin Wang , Peng Hu , Yuanbiao Gou , Xi Peng

State-Space Models (SSMs) have attracted considerable attention in Image Restoration (IR) due to their ability to scale linearly sequence length while effectively capturing long-distance dependencies. However, deploying SSMs to edge devices…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Yujie Chen , Haotong Qin , Zhang Zhang , Michelo Magno , Luca Benini , Yawei Li

Learned visual compression is an important and active task in multimedia. Existing approaches have explored various CNN- and Transformer-based designs to model content distribution and eliminate redundancy, where balancing efficacy (i.e.,…

Image and Video Processing · Electrical Eng. & Systems 2024-05-29 Shiyu Qin , Jinpeng Wang , Yimin Zhou , Bin Chen , Tianci Luo , Baoyi An , Tao Dai , Shutao Xia , Yaowei Wang

Existing Mamba-based approaches in remote sensing change detection have enhanced scanning models, yet remain limited by their inability to capture long-range dependencies between image channels effectively, which restricts their feature…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Rui Huang , Jincheng Zeng , Sen Gao , Yan Xing

Due to the capability of dynamic state space models (SSMs) in capturing long-range dependencies with linear-time computational complexity, Mamba has shown notable performance in NLP tasks. This has inspired the rapid development of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Meng Lou , Yunxiang Fu , Yizhou Yu

Recent Mamba-based image restoration methods have achieved promising results but remain limited by fixed scanning patterns and inefficient feature utilization. Conventional Mamba architectures rely on predetermined paths that cannot adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Han Hu , Zhuoran Zheng , Liang Li , Chen Lyu

Multicategory remote object counting is a fundamental task in computer vision, aimed at accurately estimating the number of objects of various categories in remote images. Existing methods rely on CNNs and Transformers, but CNNs struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Peng Liu , Sen Lei , Heng-Chao Li

Mamba, a recent selective structured state space model, excels in long sequence modeling, which is vital in the large model era. Long sequence modeling poses significant challenges, including capturing long-range dependencies within the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Rui Xu , Shu Yang , Yihui Wang , Yu Cai , Bo Du , Hao Chen

Transformers have become increasingly popular for image super-resolution (SR) tasks due to their strong global context modeling capabilities. However, their quadratic computational complexity necessitates the use of window-based attention…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Aman Urumbekov , Zheng Chen

Cross-modality fusing complementary information from different modalities effectively improves object detection performance, making it more useful and robust for a wider range of applications. Existing fusion strategies combine different…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Wenhao Dong , Haodong Zhu , Shaohui Lin , Xiaoyan Luo , Yunhang Shen , Xuhui Liu , Juan Zhang , Guodong Guo , Baochang Zhang