English
Related papers

Related papers: MambaOcc: Visual State Space Model for BEV-based O…

200 papers

Existing vision-based 3D occupancy prediction methods are inherently limited in accuracy due to their exclusive reliance on street-view imagery, neglecting the potential benefits of incorporating satellite views. We propose SA-Occ, the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Chen Chen , Zhirui Wang , Taowei Sheng , Yi Jiang , Yundu Li , Peirui Cheng , Luning Zhang , Kaiqiang Chen , Yanfeng Hu , Xue Yang , Xian Sun

Panoptic occupancy poses a novel challenge by aiming to integrate instance occupancy and semantic occupancy within a unified framework. However, there is still a lack of efficient solutions for panoptic occupancy. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Zichen Yu , Changyong Shu , Qianpu Sun , Yifan Bian , Xiaobao Wei , Jiangyong Yu , Zongdai Liu , Dawei Yang , Hui Li , Yan Chen

Recent efforts on image restoration have focused on developing "all-in-one" models that can handle different degradation types and levels within single model. However, most of mainstream Transformer-based ones confronted with dilemma…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Aiwen Jiang , Hourong Chen , Zhiwen Chen , Jihua Ye , Mingwen Wang

Longitudinal analysis of sequential radiological images is hampered by a fundamental data challenge: how to effectively model a sequence of high-resolution images captured at irregular time intervals. This data structure contains…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Zhengbo Zhou , Dooman Arefan , Margarita Zuley , Shandong Wu

The advent of Transformer and Mamba-based architectures has significantly advanced 3D medical image segmentation by enabling global contextual modeling, a capability traditionally limited in Convolutional Neural Networks (CNNs). However,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Duy D. Nguyen , Phat T. Tran-Truong

Transformer-based trajectory optimization methods have demonstrated exceptional performance in offline Reinforcement Learning (offline RL). Yet, it poses challenges due to substantial parameter size and limited scalability, which is…

Machine Learning · Computer Science 2024-10-29 Yang Dai , Oubo Ma , Longfei Zhang , Xingxing Liang , Shengchao Hu , Mengzhu Wang , Shouling Ji , Jincai Huang , Li Shen

Inferring the 3D structure of a scene from a single image is an ill-posed and challenging problem in the field of vision-centric autonomous driving. Existing methods usually employ neural radiance fields to produce voxelized 3D occupancy,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Yi Feng , Yu Han , Xijing Zhang , Tanghui Li , Yanting Zhang , Rui Fan

The resolution of voxel queries significantly influences the quality of view transformation in camera-based 3D occupancy prediction. However, computational constraints and the practical necessity for real-time deployment require smaller…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Gyeongrok Oh , Sungjune Kim , Heeju Ko , Hyung-gun Chi , Jinkyu Kim , Dongwook Lee , Daehyun Ji , Sungjoon Choi , Sujin Jang , Sangpil Kim

Occupancy prediction, aiming at predicting the occupancy status within voxelized 3D environment, is quickly gaining momentum within the autonomous driving community. Mainstream occupancy prediction works first discretize the 3D environment…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jiabao Wang , Zhaojiang Liu , Qiang Meng , Liujiang Yan , Ke Wang , Jie Yang , Wei Liu , Qibin Hou , Ming-Ming Cheng

Voice user interfaces (VUIs) have facilitated the efficient interactions between humans and machines through spoken commands. Since real-word acoustic scenes are complex, speech enhancement plays a critical role for robust VUI. Transformer…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-12 Moran Chen , Qiquan Zhang , Mingjiang Wang , Xiangyu Zhang , Hexin Liu , Eliathamby Ambikairaiah , Deying Chen

Mamba-based vision models have gained extensive attention as a result of being computationally more efficient than attention-based models. However, spatial redundancy still exists in these models, represented by token and block redundancy.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Mengxuan Wu , Zekai Li , Zhiyuan Liang , Moyang Li , Xuanlei Zhao , Samir Khaki , Zheng Zhu , Xiaojiang Peng , Konstantinos N. Plataniotis , Kai Wang , Wangbo Zhao , Yang You

Location information is pivotal for the automation and intelligence of terminal devices and edge-cloud IoT systems, such as autonomous vehicles and augmented reality. However, achieving reliable positioning across diverse IoT applications…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Jialu Wang , Kaichen Zhou , Andrew Markham , Niki Trigoni

3D semantic occupancy prediction is a pivotal task in autonomous driving, providing a dense and fine-grained understanding of the surrounding environment, yet single-modality methods face trade-offs between camera semantics and LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 A. Enes Doruk , Hasan F. Ates

Vision-centric semantic occupancy prediction plays a crucial role in autonomous driving, which requires accurate and reliable predictions from low-cost sensors. Although having notably narrowed the accuracy gap with LiDAR, there is still…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Song Wang , Zhongdao Wang , Jiawei Yu , Wentong Li , Bailan Feng , Junbo Chen , Jianke Zhu

Transformer-based methods for 3D human pose estimation face significant computational challenges due to the quadratic growth of self-attention mechanism complexity with sequence length. Recently, the Mamba model has substantially reduced…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Zenghao Zheng , Lianping Yang , Jinshan Pan , Hegui Zhu

State space models (SSMs) have emerged as an efficient alternative to transformer-based models, offering linear complexity that scales better than transformers. One of the latest advances in SSMs, Mamba, introduces a selective scan…

Machine Learning · Computer Science 2025-03-03 Junpeng Wang , Chin-Chia Michael Yeh , Uday Singh Saini , Mahashweta Das

Deep learning, particularly convolutional neural networks (CNNs) and Transformers, has significantly advanced 3D medical image segmentation. While CNNs are highly effective at capturing local features, their limited receptive fields may…

Image and Video Processing · Electrical Eng. & Systems 2024-09-20 Chenyuan Bian , Nan Xia , Xia Yang , Feifei Wang , Fengjiao Wang , Bin Wei , Qian Dong

Accurate traffic flow prediction is crucial for optimizing traffic management, enhancing road safety, and reducing environmental impacts. Existing models face challenges with long sequence data, requiring substantial memory and…

Machine Learning · Computer Science 2024-05-10 Zhiqi Shao , Xusheng Yao , Ze Wang , Junbin Gao

This paper introduces VMatcher, a hybrid Mamba-Transformer network for semi-dense feature matching between image pairs. Learning-based feature matching methods, whether detector-based or detector-free, achieve state-of-the-art performance…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ali Youssef

Mamba is an effective state space model with linear computation complexity. It has recently shown impressive efficiency in dealing with high-resolution inputs across various vision tasks. In this paper, we reveal that the powerful Mamba…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Dongchen Han , Ziyi Wang , Zhuofan Xia , Yizeng Han , Yifan Pu , Chunjiang Ge , Jun Song , Shiji Song , Bo Zheng , Gao Huang