English
Related papers

Related papers: MambaDSF: Multi-Scale SSM with Dilated Feature Fus…

200 papers

Existing Transformer-based models for point cloud analysis suffer from quadratic complexity, leading to compromised point cloud resolution and information loss. In contrast, the newly proposed Mamba model, based on state space models (SSM),…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xu Han , Yuan Tang , Zhaoxuan Wang , Xianzhi Li

Multimodal semantic learning plays a critical role in embodied intelligence, especially when robots perceive their surroundings, understand human instructions, and make intelligent decisions. However, the field faces technical challenges…

Robotics · Computer Science 2025-09-24 Zeyi Kang , Liang He , Yanxin Zhang , Zuheng Ming , Kaixing Zhao

Transformers have revolutionized deep learning across various tasks, including audio representation learning, due to their powerful modeling capabilities. However, they often suffer from quadratic complexity in both GPU memory usage and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-06 Siavash Shams , Sukru Samet Dindar , Xilin Jiang , Nima Mesgarani

Previous research on lightweight models has primarily focused on CNNs and Transformer-based designs. CNNs, with their local receptive fields, struggle to capture long-range dependencies, while Transformers, despite their global modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Haoyang He , Jiangning Zhang , Yuxuan Cai , Hongxu Chen , Xiaobin Hu , Zhenye Gan , Yabiao Wang , Chengjie Wang , Yunsheng Wu , Lei Xie

Capturing an all-in-focus image with a single camera is difficult since the depth of field of the camera is usually limited. An alternative method to obtain the all-in-focus image is to fuse several images focusing at different depths.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Haoyu Ma , Qingmin Liao , Juncheng Zhang , Shaojun Liu , Jing-Hao Xue

Mamba, a special case of the State Space Model, is gaining popularity as an alternative to template-based deep learning approaches in medical image analysis. While transformers are powerful architectures, they have drawbacks, including…

In recent years, robust matching methods using deep learning-based approaches have been actively studied and improved in computer vision tasks. However, there remains a persistent demand for both robust and fast matching techniques. To…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Kihwan Ryoo , Hyungtae Lim , Hyun Myung

Numerous CNN-Transformer hybrid models rely on high-complexity global attention mechanisms to capture long-range dependencies, which introduces non-linear computational complexity and leads to significant resource consumption. Although…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Dayu Tan , Ziwei Zhang , Yansan Su , Xin Peng , Yike Dai , Chunhou Zheng , Weimin Zhong

Multi-modal medical image synthesis is pivotal for alleviating clinical data scarcity, yet existing methods fail to reconcile global anatomical consistency with high-fidelity local detail. We propose FermatSyn, which addresses three…

Image and Video Processing · Electrical Eng. & Systems 2026-03-02 Feng Yuan

Multi-modality image fusion aims to integrate the merits of images from different sources and render high-quality fusion images. However, existing feature extraction and fusion methods are either constrained by inherent local reduction bias…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Chenguang Zhu , Shan Gao , Huafeng Chen , Guangqian Guo , Chaowei Wang , Yaoxing Wang , Chen Shu Lei , Quanjiang Fan

Recent advances in speech enhancement have shown that models combining Mamba and attention mechanisms yield superior cross-corpus generalization performance. At the same time, integrating Mamba in a U-Net structure has yielded…

Sound · Computer Science 2026-01-22 Nikolai Lund Kühne , Jesper Jensen , Jan Østergaard , Zheng-Hua Tan

The realm of Mamba for vision has been advanced in recent years to strike for the alternatives of Vision Transformers (ViTs) that suffer from the quadratic complexity. While the recurrent scanning mechanism of Mamba offers computational…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Masakazu Yoshimura , Teruaki Hayashi , Yuki Hoshino , Wei-Yao Wang , Takeshi Ohashi

Quad Bayer demosaicing is the central challenge for enabling the widespread application of Hybrid Event-based Vision Sensors (HybridEVS). Although existing learning-based methods that leverage long-range dependency modeling have achieved…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Shiyang Zhou , Haijin Zeng , Yunfan Lu , Tong Shao , Ke Tang , Yongyong Chen , Jie Liu , Jingyong Su

Panoptic segmentation requires the simultaneous recognition of countable thing instances and amorphous stuff regions, placing joint demands on long-range context modelling, multi-scale feature representation, and efficient dense prediction.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Qing Cheng , Damiano Bertolini , Wei Zhang , Dong Wang , Niclas Zeller , Daniel Cremers

In the coded aperture snapshot spectral imaging system, Deep Unfolding Networks (DUNs) have made impressive progress in recovering 3D hyperspectral images (HSIs) from a single 2D measurement. However, the inherent nonlinear and ill-posed…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Mengjie Qin , Yuchao Feng , Zongliang Wu , Yulun Zhang , Xin Yuan

Change detection (CD) has extensive applications and is a crucial method for identifying and localizing target changes. In recent years, various CD methods represented by convolutional neural network (CNN) and transformer have achieved…

Image and Video Processing · Electrical Eng. & Systems 2026-03-11 Chengming Wang , Peng Duan , Jinjiang Li

Fake artefacts for discriminating between bonafide and fake audio can exist in both short- and long-range segments. Therefore, combining local and global feature information can effectively discriminate between bonafide and fake audio. This…

The estimation of underwater sound velocity distribution serves as a critical basis for facilitating effective underwater communication and precise positioning, given that variations in sound velocity influence the path of signal…

Signal Processing · Electrical Eng. & Systems 2026-04-10 Pengfei Wu , Wei Huang , Yujie Shi , Hao Zhang

Underwater Instance Segmentation (UIS) tasks are crucial for underwater complex scene detection. Mamba, as an emerging state space model with inherently linear complexity and global receptive fields, is highly suitable for processing image…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Runmin Cong , Zongji Yu , Hao Fang , Haoyan Sun , Sam Kwong

Recent State Space Models (SSM), especially Mamba, have demonstrated impressive performance in visual modeling and possess superior model efficiency. However, the application of Mamba to visual tasks suffers inferior performance due to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Fei Xie , Jiahao Nie , Yujin Tang , Wenkang Zhang , Hongshen Zhao