English
Related papers

Related papers: MAMBA4D: Efficient Long-Sequence Point Cloud Video…

200 papers

Recently, State Space Models (SSMs), with Mamba as a prime example, have shown great promise for long-range dependency modeling with linear complexity. Then, Vision Mamba and the subsequent architectures are presented successively, and they…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Zhongping Ji

Multimodal fusion has made great progress in the field of remote sensing image classification due to its ability to exploit the complementary spatial-spectral information. Deep learning methods such as CNN and Transformer have been widely…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Qingyu Wang , Xue Jiang , Guozheng Xu

Efficiently modeling large 2D contexts is essential for various fields including Giga-Pixel Whole Slide Imaging (WSI) and remote sensing. Transformer-based models offer high parallelism but face challenges due to their quadratic complexity…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Jingwei Zhang , Anh Tien Nguyen , Xi Han , Vincent Quoc-Huy Trinh , Hong Qin , Dimitris Samaras , Mahdi S. Hosseini

Multimodal Large Language Models (MLLMs) have attracted much attention for their multifunctionality. However, traditional Transformer architectures incur significant overhead due to their secondary computational complexity. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Wenjun Huang , Jiakai Pan , Jiahao Tang , Yanyu Ding , Yifei Xing , Yuhe Wang , Zhengzhuo Wang , Jianguo Hu

Multi-modal learning that combines pathological images with genomic data has significantly enhanced the accuracy of survival prediction. Nevertheless, existing methods have not fully utilized the inherent hierarchical structure within both…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Ying Chen , Jiajing Xie , Yuxiang Lin , Yuhang Song , Wenxian Yang , Rongshan Yu

Video super-resolution remains a major challenge in low-level vision tasks. To date, CNN- and Transformer-based methods have delivered impressive results. However, CNNs are limited by local receptive fields, while Transformers struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Dinh Phu Tran , Dao Duy Hung , Daeyoung Kim

Efficiently modeling sequences with infinite context length has long been a challenging problem. Previous approaches have either suffered from quadratic computational complexity or limited extrapolation ability in length generalization. In…

Computation and Language · Computer Science 2025-03-03 Liliang Ren , Yang Liu , Yadong Lu , Yelong Shen , Chen Liang , Weizhu Chen

Recently, state space models (SSM), particularly Mamba, have attracted significant attention from scholars due to their ability to effectively balance computational efficiency and performance. However, most existing visual Mamba methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Leiye Liu , Miao Zhang , Jihao Yin , Tingwei Liu , Wei Ji , Yongri Piao , Huchuan Lu

With the prevalence of Multimodal Large Language Models(MLLMs), autonomous driving has encountered new opportunities and challenges. In particular, multi-modal video understanding is critical to interactively analyze what will happen in the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Siran Chen , Yuxiao Luo , Yue Ma , Yu Qiao , Yali Wang

Long-term forecasting of chaotic systems remains a fundamental challenge due to the intrinsic sensitivity to initial conditions and the complex geometry of strange attractors. Conventional approaches, such as reservoir computing, typically…

Machine Learning · Computer Science 2025-09-29 Chang Liu , Bohao Zhao , Jingtao Ding , Huandong Wang , Yong Li

Recent advancements in State Space Models, notably Mamba, have demonstrated superior performance over the dominant Transformer models, particularly in reducing the computational complexity from quadratic to linear. Yet, difficulties in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Fei Xie , Weijia Zhang , Zhongdao Wang , Chao Ma

With the evolution of large language models, traditional Transformer models become computationally demanding for lengthy sequences due to the quadratic growth in computation with respect to the sequence length. Mamba, emerging as a…

Machine Learning · Computer Science 2024-08-22 Haoran Xu , Ziqian Liu , Rong Fu , Zhongling Su , Zerui Wang , Zheng Cai , Zhilin Pei , Xingcheng Zhang

Multimodal medical image fusion integrates complementary information from different imaging modalities to enhance diagnostic accuracy and treatment planning. While deep learning methods have advanced performance, existing approaches face…

Image and Video Processing · Electrical Eng. & Systems 2025-08-06 Meng Zhou , Farzad Khalvati

Voice user interfaces (VUIs) have facilitated the efficient interactions between humans and machines through spoken commands. Since real-word acoustic scenes are complex, speech enhancement plays a critical role for robust VUI. Transformer…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-12 Moran Chen , Qiquan Zhang , Mingjiang Wang , Xiangyu Zhang , Hexin Liu , Eliathamby Ambikairaiah , Deying Chen

Multivariate time series forecasting is fundamental to numerous domains such as energy, finance, and environmental monitoring, where complex temporal dependencies and cross-variable interactions pose enduring challenges. Existing…

Machine Learning · Computer Science 2026-05-15 Xingsheng Chen , Xianpei Mu , Deyu Yi , Yilin Yuan , Xingwei He , Bo Gao , Regina Zhang , Pietro Lio , Siu-Ming Yiu

Semantic segmentation of remote sensing imagery is a fundamental task in computer vision, supporting a wide range of applications such as land use classification, urban planning, and environmental monitoring. However, this task is often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Qinfeng Zhu , Han Li , Liang He , Lei Fan

Existing diffusion-based video super-resolution (VSR) methods are susceptible to introducing complex degradations and noticeable artifacts into high-resolution videos due to their inherent randomness. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Shijun Shi , Jing Xu , Lijing Lu , Zhihang Li , Kai Hu

A fundamental challenge in point cloud object detection lies in the conflict between the extreme sparsity of distant points and the need for remote context understanding. The existing methods typically use 1D serialization to expand the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Bingwen Qiu , Yuan Liu , Junqi Bai , Tong Jiang , Ben Liang , Fangzhou Chen , Xiubao Sui , Qian Chen

Medical video segmentation gains increasing attention in clinical practice due to the redundant dynamic references in video frames. However, traditional convolutional neural networks have a limited receptive field and transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Yijun Yang , Zhaohu Xing , Lequan Yu , Chunwang Huang , Huazhu Fu , Lei Zhu

Multi-modal medical image synthesis involves nonlinear transformation of tissue signals between source and target modalities, where tissues exhibit contextual interactions across diverse spatial distances. As such, the utility of a network…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Omer F. Atli , Bilal Kabas , Fuat Arslan , Arda C. Demirtas , Mahmut Yurt , Onat Dalmaz , Tolga Çukur