English
Related papers

Related papers: SUM: Saliency Unification through Mamba for Visual…

200 papers

Video summarization is an effective way to facilitate video searching and browsing. Most of existing systems employ encoder-decoder based recurrent neural networks, which fail to explicitly diversify the system-generated summary frames…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Ping Li , Qinghao Ye , Luming Zhang , Li Yuan , Xianghua Xu , Ling Shao

Multi-modality image fusion, particularly infrared and visible, plays a crucial role in integrating diverse modalities to enhance scene understanding. Although early research prioritized visual quality, preserving fine details and adapting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Guanyao Wu , Haoyu Liu , Hongming Fu , Yichuan Peng , Jinyuan Liu , Xin Fan , Risheng Liu

Capturing long-range dependencies (LRD) efficiently is a core challenge in visual recognition, and state-space models (SSMs) have recently emerged as a promising alternative to self-attention for addressing it. However, adapting SSMs into…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yunusa Haruna , Adamu Lawan , Shamsuddeen Hassan Muhammad , Jiaquan Zhang , Chaoning Zhang

We introduce VideoMamba, a novel adaptation of the pure Mamba architecture, specifically designed for video recognition. Unlike transformers that rely on self-attention mechanisms leading to high computational costs by quadratic complexity,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jinyoung Park , Hee-Seon Kim , Kangwook Ko , Minbeom Kim , Changick Kim

Temporal video grounding (TVG) is a critical task in video content understanding, requiring precise alignment between video content and natural language instructions. Despite significant advancements, existing methods face challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Wenrui Li , Xiaopeng Hong , Ruiqin Xiong , Xiaopeng Fan

Recently, the philosophy of visual saliency and attention has started to gain popularity in the robotics community. Therefore, this paper aims to mimic this mechanism in SLAM framework by using saliency prediction model. Comparing with…

Robotics · Computer Science 2020-12-23 Ke Wang , Sai Ma , Junlan Chen , Jianbo Lu

Robot grasping, whether handling isolated objects, cluttered items, or stacked objects, plays a critical role in industrial and service applications. However, current visual grasp detection methods based on Convolutional Neural Networks…

Robotics · Computer Science 2025-03-11 Songsong Xiong , Hamidreza Kasaei

Multi-modal fusion is crucial for Internet of Things (IoT) perception, widely deployed in smart homes, intelligent transport, industrial automation, and healthcare. However, existing systems often face challenges: high model complexity…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Weiqi Yang , Xu Zhou , Jingfu Guan , Hao Du , Tianyu Bai

General networks for 3D medical image segmentation have recently undergone extensive exploration. Behind the exceptional performance of these networks lies a significant demand for a large volume of pixel-level annotated data, which is…

Image and Video Processing · Electrical Eng. & Systems 2024-09-16 Hualiang Wang , Yiqun Lin , Xinpeng Ding , Xiaomeng Li

Efficient long-context language modeling remains a significant challenge in Natural Language Processing (NLP). While Transformers dominate language tasks, they struggle with long sequences due to quadratic computational complexity in…

In recent years, Transformers have become the de-facto architecture for sequence modeling on text and a variety of multi-dimensional data, such as images and video. However, the use of self-attention layers in a Transformer incurs…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Shufan Li , Harkanwar Singh , Aditya Grover

Deep learning has profoundly transformed remote sensing, yet prevailing architectures like Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) remain constrained by critical trade-offs: CNNs suffer from limited receptive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Muyi Bao , Shuchang Lyu , Zhaoyang Xu , Huiyu Zhou , Jinchang Ren , Shiming Xiang , Xiangtai Li , Guangliang Cheng

Reliable 3D object detection is fundamental to autonomous driving, and multimodal fusion algorithms using cameras and LiDAR remain a persistent challenge. Cameras provide dense visual cues but ill posed depth; LiDAR provides a precise 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Venkatraman Narayanan , Bala Sai , Rahul Ahuja , Pratik Likhar , Varun Ravi Kumar , Senthil Yogamani

Medical image segmentation is essential in diagnostics, treatment planning, and healthcare, with deep learning offering promising advancements. Notably, the convolutional neural network (CNN) excels in capturing local image features,…

Image and Video Processing · Electrical Eng. & Systems 2024-07-30 Chao Ma , Ziyang Wang

State-space models (SSMs) have recently shown promise in capturing long-range dependencies with subquadratic computational complexity, making them attractive for various applications. However, purely SSM-based models face critical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Abdelrahman Shaker , Syed Talal Wasim , Salman Khan , Juergen Gall , Fahad Shahbaz Khan

Convolutional neural networks (CNNs) and transformers are widely employed in constructing UNet architectures for medical image segmentation tasks. However, CNNs struggle to model long-range dependencies, while transformers suffer from…

Image and Video Processing · Electrical Eng. & Systems 2025-03-26 Shaolei Zhang , Jinyan Liu , Tianyi Qian , Xuesong Li

Quality assessment of images and videos emphasizes both local details and global semantics, whereas general data sampling methods (e.g., resizing, cropping or grid-based fragment) fail to catch them simultaneously. To address the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Yongxu Liu , Yinghui Quan , Guoyao Xiao , Aobo Li , Jinjian Wu

Existing deraining Transformers employ self-attention mechanisms with fixed-range windows or along channel dimensions, limiting the exploitation of non-local receptive fields. In response to this issue, we introduce a novel dual-branch…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Shangquan Sun , Wenqi Ren , Juxiang Zhou , Jianhou Gan , Rui Wang , Xiaochun Cao

Transformers have proven effective in language modeling but are limited by high computational and memory demands that grow quadratically with input sequence length. State space models (SSMs) offer a promising alternative by reducing…

Hardware Architecture · Computer Science 2025-08-06 Dongho Yoon , Gungyu Lee , Jaewon Chang , Yunjae Lee , Dongjae Lee , Minsoo Rhu

State Space Models (SSMs), especially recent Mamba architecture, have achieved remarkable success in sequence modeling tasks. However, extending SSMs to computer vision remains challenging due to the non-sequential structure of visual data…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Puskal Khadka , KC Santosh