English
Related papers

Related papers: BVI-Mamba: Video Enhancement Using a Visual State-…

200 papers

Visual State Space Model (VMamba) has recently emerged as a promising architecture, exhibiting remarkable performance in various computer vision tasks. However, its robustness has not yet been thoroughly studied. In this paper, we delve…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Chengbin Du , Yanxi Li , Chang Xu

Recent event-based image reconstruction methods predominantly rely on Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) to process complementary event information. However, these architectures face fundamental limitations:…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Wei Yu , Yunhang Qian

Vision Mamba (ViM) models offer a compelling efficiency advantage over Transformers by leveraging the linear complexity of State Space Models (SSMs), yet efficiently deploying them on FPGAs remains challenging. Linear layers struggle with…

Hardware Architecture · Computer Science 2026-05-05 Shengzhe Lyu , Yuhan She , Patrick S. Y. Hung , Ray C. C. Cheung , Weitao Xu

Learned Image Compression (LIC) has explored various architectures, such as Convolutional Neural Networks (CNNs) and transformers, in modeling image content distributions in order to achieve compression effectiveness. However, achieving…

Image and Video Processing · Electrical Eng. & Systems 2025-02-10 Zhuojie Wu , Heming Du , Shuyun Wang , Ming Lu , Haiyang Sun , Yandong Guo , Xin Yu

We introduce TimeViper, a hybrid vision-language model designed to tackle challenges of long video understanding. Processing long videos demands both an efficient model architecture and an effective mechanism for handling extended temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Boshen Xu , Zihan Xiao , Jiaze Li , Jianzhong Ju , Zhenbo Luo , Jian Luan , Qin Jin

Atmospheric turbulence is a major source of image degradation in long-range imaging systems. Although numerous deep learning-based turbulence mitigation (TM) methods have been proposed, many are slow, memory-hungry, and do not generalize…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Xingguang Zhang , Nicholas Chimitt , Xijun Wang , Yu Yuan , Stanley H. Chan

Image restoration requires simultaneously preserving fine-grained local structures and maintaining long-range spatial coherence. While convolutional networks struggle with limited receptive fields, and Transformers incur quadratic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Mohammed Hassanin , Nour Moustafa , Weijian Deng , Ibrahim Radwan

Underwater Instance Segmentation (UIS) tasks are crucial for underwater complex scene detection. Mamba, as an emerging state space model with inherently linear complexity and global receptive fields, is highly suitable for processing image…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Runmin Cong , Zongji Yu , Hao Fang , Haoyan Sun , Sam Kwong

Cross-modality fusing complementary information from different modalities effectively improves object detection performance, making it more useful and robust for a wider range of applications. Existing fusion strategies combine different…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Wenhao Dong , Haodong Zhu , Shaohui Lin , Xiaoyan Luo , Yunhang Shen , Xuhui Liu , Juan Zhang , Guodong Guo , Baochang Zhang

Video Question Answering (VQA) in long videos poses the key challenge of extracting relevant information and modeling long-range dependencies from many redundant frames. The self-attention mechanism provides a general solution for sequence…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Md Mohaiminul Islam , Tushar Nagarajan , Huiyu Wang , Gedas Bertasius , Lorenzo Torresani

In recent years, Transformers-based models have made significant progress in the field of image restoration by leveraging their inherent ability to capture complex contextual features. Recently, Mamba models have made a splash in the field…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Juan Wen , Weiyan Hou , Luc Van Gool , Radu Timofte

Many real-world computer vision tasks, such as depth completion, must handle inputs with arbitrarily shaped regions of missing or invalid data. For Convolutional Neural Networks (CNNs), Partial Convolutions solved this by a mask-aware…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Ignasi Mas , Ramon Morros , Javier-Ruiz Hidalgo , Ivan Huerta

Large-scale text-to-image diffusion models have achieved unprecedented success in image generation and editing. However, extending this success to video editing remains challenging. Recent video editing efforts have adapted pretrained…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Mingshu Cai , Yixuan Li , Osamu Yoshie , Yuya Ieiri

In the field of low-light image enhancement, both traditional Retinex methods and advanced deep learning techniques such as Retinexformer have shown distinct advantages and limitations. Traditional Retinex methods, designed to mimic the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Jiesong Bai , Yuhao Yin , Qiyuan He , Yuanxian Li , Xiaofeng Zhang

Facial Beauty Prediction (FBP) is a complex and challenging computer vision task, aiming to model the subjective and intricate nature of human aesthetic perception. While deep learning models, particularly Convolutional Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Djamel Eddine Boukhari

Text-Video Retrieval (TVR) aims to align and associate relevant video content with corresponding natural language queries. Most existing TVR methods are based on large-scale pre-trained vision-language models (e.g., CLIP). However, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Haoran Tang , Meng Cao , Jinfa Huang , Ruyang Liu , Peng Jin , Ge Li , Xiaodan Liang

Recent Vision Mamba (Vim) models exhibit nearly linear complexity in sequence length, making them highly attractive for processing visual data. However, the training methodologies and their potential are still not sufficiently explored. In…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zizheng Huang , Haoxing Chen , Jiaqi Li , Jun Lan , Huijia Zhu , Weiqiang Wang , Limin Wang

A fundamental objective in robot manipulation is to enable models to comprehend visual scenes and execute actions. Although existing Vision-Language-Action (VLA) models for robots can handle a range of basic tasks, they still face…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jiaming Liu , Mengzhen Liu , Zhenyu Wang , Pengju An , Xiaoqi Li , Kaichen Zhou , Senqiao Yang , Renrui Zhang , Yandong Guo , Shanghang Zhang

Underwater Image Enhancement (UIE) techniques aim to address the problem of underwater image degradation due to light absorption and scattering. In recent years, both Convolution Neural Network (CNN)-based and Transformer-based methods have…

Image and Video Processing · Electrical Eng. & Systems 2024-05-27 Zhihao Chen , Yiyuan Ge

Mamba, a State Space Model (SSM) that accelerates training by recasting recurrence as a parallel scan, has recently emerged as a linearly-scaling alternative to self-attention. Because of its unidirectional nature, each state in Mamba only…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Jingwei Zhang , Xi Han , Hong Qin , Mahdi S. Hosseini , Dimitris Samaras