English
Related papers

Related papers: MambaFlow: A Mamba-Centric Architecture for End-to…

200 papers

In this work, we propose an accurate and real-time optical flow and disparity estimation model by fusing pairwise input images in the proposed non-causal selective state space for dense perception tasks. We propose a non-causal Mamba…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Tushar Anand , Advik Sinha , Abhijit Das

Enhancing and preserving the readability of document images, particularly historical ones, is crucial for effective document image analysis. Numerous models have been proposed for this task, including convolutional-based, transformer-based,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Mohd. Azfar , Siddhant Bharadwaj , Ashwin Sasikumar

The goal of multimodal image fusion is to integrate complementary information from infrared and visible images, generating multimodal fused images for downstream tasks. Existing downstream pre-training models are typically trained on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Yushen Xu , Xiaosong Li , Zhenyu Kuang , Xiaoqi Cheng , Haishu Tan , Huafeng Li

Video Language Models (VLMs) are crucial for generalizing across diverse tasks and using language cues to enhance learning. While transformer-based architectures have been the de facto in vision-language training, they face challenges like…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Zhikang Dong , Apoorva Beedu , Jason Sheinkopf , Irfan Essa

Mamba has recently garnered attention as an effective backbone for vision tasks. However, its underlying mechanism in visual domains remains poorly understood. In this work, we systematically investigate Mamba's representational properties…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Timing Yang , Guoyizhe Wei , Alan Yuille , Feng Wang

Training deep learning models for semantic occupancy prediction is challenging due to factors such as a large number of occupancy cells, severe occlusion, limited visual cues, complicated driving scenarios, etc. Recent methods often adopt…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Heng Li , Yuenan Hou , Xiaohan Xing , Yuexin Ma , Xiao Sun , Yanyong Zhang

Transformers have become one of the foundational architectures in point cloud analysis tasks due to their excellent global modeling ability. However, the attention mechanism has quadratic complexity, making the design of a linear complexity…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Dingkang Liang , Xin Zhou , Wei Xu , Xingkui Zhu , Zhikang Zou , Xiaoqing Ye , Xiao Tan , Xiang Bai

Most post-disaster damage classifiers succeed only when destructive forces leave clear spectral or structural signatures -- conditions rarely present after inundation. Consequently, existing models perform poorly at identifying…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yu-Hsuan Ho , Ali Mostafavi

The Mamba architecture has been widely applied to various low-level vision tasks due to its exceptional adaptability and strong performance. Although the Mamba architecture has been adopted for spectral reconstruction, it still faces the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Yuze Zhang , Lingjie Li , Qiuzhen Lin , Zhong Ming , Fei Yu , Victor C. M. Leung

Motion planning is a challenging task to generate safe and feasible trajectories in highly dynamic and complex environments, forming a core capability for autonomous vehicles. In this paper, we propose DRAMA, the first Mamba-based…

State Space Models (SSMs), particularly the Mamba architecture, have recently emerged as powerful alternatives to Transformers for sequence modeling, offering linear computational complexity while achieving competitive performance. Yet,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Mohamed A. Mabrok , Yalda Zafari

Optical flow estimation is a fundamental task in computer vision. Recent direct-regression methods using deep neural networks achieve remarkable performance improvement. However, they do not explicitly capture long-term motion…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Shiyu Zhao , Long Zhao , Zhixing Zhang , Enyu Zhou , Dimitris Metaxas

Multimodal fusion has made great progress in the field of remote sensing image classification due to its ability to exploit the complementary spatial-spectral information. Deep learning methods such as CNN and Transformer have been widely…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Qingyu Wang , Xue Jiang , Guozheng Xu

Transformer and its derivatives have achieved success in diverse tasks across computer vision, natural language processing, and speech processing. To reduce the complexity of computations within the multi-head self-attention mechanism in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-29 Xiangyu Zhang , Qiquan Zhang , Hexin Liu , Tianyi Xiao , Xinyuan Qian , Beena Ahmed , Eliathamby Ambikairajah , Haizhou Li , Julien Epps

Optical flow is an indispensable building block for various important computer vision tasks, including motion estimation, object tracking, and disparity measurement. In this work, we propose TransFlow, a pure transformer architecture for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yawen Lu , Qifan Wang , Siqi Ma , Tong Geng , Yingjie Victor Chen , Huaijin Chen , Dongfang Liu

Combining traditional RGB cameras with bio-inspired event cameras for robust object tracking has garnered increasing attention in recent years. However, most existing multimodal tracking algorithms depend heavily on high-complexity Vision…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shiao Wang , Ju Huang , Qingchuan Ma , Jinfeng Gao , Chunyi Xu , Xiao Wang , Lan Chen , Bo Jiang

Optical flow estimation is crucial to a variety of vision tasks. Despite substantial recent advancements, achieving real-time on-device optical flow estimation remains a complex challenge. First, an optical flow model must be sufficiently…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Jamie Menjay Lin , Jisoo Jeong , Hong Cai , Risheek Garrepalli , Kai Wang , Fatih Porikli

Optical Coherence Tomography Angiography (OCTA) is a crucial imaging technique for visualizing retinal vasculature and diagnosing eye diseases such as diabetic retinopathy and glaucoma. However, precise segmentation of OCTA vasculature…

Image and Video Processing · Electrical Eng. & Systems 2025-01-03 Shun Zou , Zhuo Zhang , Guangwei Gao

Current strong pedestrian attribute recognition models are developed based on Transformer networks, which are computationally heavy. Recently proposed models with linear complexity (e.g., Mamba) have garnered significant attention and have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Xiao Wang , Weizhe Kong , Jiandong Jin , Shiao Wang , Ruichong Gao , Qingchuan Ma , Chenglong Li , Jin Tang

Recent advances in self-supervised learning for Vision Transformers (ViTs) have fueled breakthroughs in remote sensing (RS) foundation models. However, the quadratic complexity of self-attention poses a significant barrier to scalability,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Fengxiang Wang , Yulin Wang , Mingshuo Chen , Haiyan Zhao , Yangang Sun , Shuo Wang , Hongzhen Wang , Di Wang , Long Lan , Wenjing Yang , Jing Zhang