English
Related papers

Related papers: Beyond Mamba: Enhancing State-space Models with De…

200 papers

Image classification remains a fundamental yet challenging task in computer vision, particularly when fine-grained feature extraction and background noise suppression are required simultaneously. Conventional convolutional neural networks,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Wentao Jiang , Yuanchan Xu , Heng Yuan

State space models (SSMs) have emerged as an efficient alternative to Transformer models for language modeling, offering linear computational complexity and constant memory usage as context length increases. However, despite their…

Computation and Language · Computer Science 2025-04-23 Zhifan Ye , Kejing Xia , Yonggan Fu , Xin Dong , Jihoon Hong , Xiangchi Yuan , Shizhe Diao , Jan Kautz , Pavlo Molchanov , Yingyan Celine Lin

Extracting actionable knowledge from industrial visual data is fundamentally bottlenecked by extreme class imbalance and the prohibitive computational complexity of modern foundation models. In semi-conductor manufacturing, identifying…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Satwik Sai Prakash Sahoo , Jyoti Prakash Sahoo , Ting Wang , Subrota Kumar Mondal

State space models (SSMs) have emerged as an efficient alternative to transformer-based models, offering linear complexity that scales better than transformers. One of the latest advances in SSMs, Mamba, introduces a selective scan…

Machine Learning · Computer Science 2025-03-03 Junpeng Wang , Chin-Chia Michael Yeh , Uday Singh Saini , Mahashweta Das

Multi-scale detection plays an important role in object detection models. However, researchers usually feel blank on how to reasonably configure detection heads combining multi-scale features at different input resolutions. We find that…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yi Shi , Jiang Wu , Shixuan Zhao , Gangyao Gao , Tao Deng , Hongmei Yan

Many problems in computer networking rely on parsing collections of network traces (e.g., traffic prioritization, intrusion detection). Unfortunately, the availability and utility of these collections is limited due to privacy concerns,…

Networking and Internet Architecture · Computer Science 2024-06-06 Andrew Chu , Xi Jiang , Shinan Liu , Arjun Bhagoji , Francesco Bronzino , Paul Schmitt , Nick Feamster

Hyperspectral image (HSI) classification faces challenges such as high-dimensional data, limited training samples, and spectral redundancy, which often lead to overfitting and insufficient generalization capability. This paper proposes a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Guandong Li , Mengxia Ye

Accurate organ and lesion segmentation is a critical prerequisite for computer-aided diagnosis. Convolutional Neural Networks (CNNs), constrained by their local receptive fields, often struggle to capture complex global anatomical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Haodong Chen , Xianfei Han , Qwen

Transformers have become foundational for visual tasks such as object detection, semantic segmentation, and video understanding, but their quadratic complexity in attention mechanisms presents scalability challenges. To address these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Fady Ibrahim , Guangjun Liu , Guanghui Wang

Vision Mamba offers linear complexity for long visual sequences, yet its performance depends critically on how a two-dimensional patch grid is serialized into a one-dimensional state-space recurrence. Raster-style scans disrupt spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Bo Li , Haoke Xiao , Lv Tang

Metal artifact significantly degrades Computed Tomography (CT) image quality, impeding accurate clinical diagnosis. However, existing deep learning approaches, such as CNN and Transformer, often fail to explicitly capture the directional…

Image and Video Processing · Electrical Eng. & Systems 2026-02-09 Bowen Ning , Zekun Zhou , Xinyi Zhong , Zhongzhen Wang , HongXin Wu , HaiTao Wang , Liu Shi , Qiegen Liu

State Space Models (SSMs), particularly Mamba, have shown potential in long-term time series forecasting. However, existing Mamba-based architectures often struggle with datasets characterized by non-stationary patterns. A key observation…

Machine Learning · Computer Science 2026-02-11 Ruxuan Chen , Fang Sun

Transparent and reflective objects pose significant challenges for depth sensors, resulting in incomplete depth information that adversely affects downstream robotic perception and manipulation tasks. To address this issue, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Guanghu Xie , Yonglong Zhang , Zhiduo Jiang , Yang Liu , Zongwu Xie , Baoshi Cao , Hong Liu

Traffic flow estimation (TFE) is crucial for urban intelligent traffic systems. While traditional on-road detectors are hindered by limited coverage and high costs, cloud computing and data mining of vehicular network data, such as driving…

Artificial Intelligence · Computer Science 2024-07-12 Doncheng Yuan , Jianzhe Xue , Jinshan Su , Wenchao Xu , Haibo Zhou

The dynamic range limitation of conventional RGB cameras reduces global contrast and causes loss of high-frequency details such as textures and edges in complex traffic environments (e.g., nighttime driving, tunnels), hindering…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Zhanwen Liu , Yujing Sun , Yang Wang , Nan Yang , Shengbo Eben Li , Xiangmo Zhao

Autonomous driving systems demand trajectory planners that not only model the inherent uncertainty of future motions but also respect complex temporal dependencies and underlying physical laws. While diffusion-based generative models excel…

Robotics · Computer Science 2026-02-03 Hang Zhou , Qiang Zhang , Peiran Liu , Yihao Qin , Zhaoxu Yan , Yiding Ji

The advent of Transformer and Mamba-based architectures has significantly advanced 3D medical image segmentation by enabling global contextual modeling, a capability traditionally limited in Convolutional Neural Networks (CNNs). However,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Duy D. Nguyen , Phat T. Tran-Truong

Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module. Many subquadratic-time architectures such as linear attention,…

Machine Learning · Computer Science 2024-06-03 Albert Gu , Tri Dao

Domain Adaptive Object Detection (DAOD) aims to transfer detectors from a labeled source domain to an unlabeled target domain. Existing DAOD methods employ multi-granularity feature alignment to learn domain-invariant representations.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Haochen Li , Rui Zhang , Hantao Yao , Xin Zhang , Yifan Hao , Shaohui Peng , Yongwei Zhao , Ling Li

Medical time series are central to healthcare, enabling continuous monitoring and supporting timely clinical decisions. Despite recent progress, existing methods struggle to jointly model local-global dynamics and handle nonstationarities…

Machine Learning · Computer Science 2026-05-26 Da Zhang , Bingyu Li , Zhiyuan Zhao , Hongyuan Zhang , Junyu Gao , Xuelong Li