English
Related papers

Related papers: MambaMixer: Efficient Selective State Space Models…

200 papers

Achieving both high accuracy and topological continuity in road segmentation from satellite imagery is a critical goal for applications ranging from urban planning to disaster response. State-of-the-art methods often rely on Vision…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jules Decaestecker , Nicolas Vigne

Real-time object detection is a fundamental but challenging task in computer vision, particularly when computational resources are limited. Although YOLO-series models have set strong benchmarks by balancing speed and accuracy, the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Xiaochun Lei , Siqi Wu , Weilin Wu , Zetao Jiang

Large Vision-Language Models (LVLMs) have demonstrated remarkable performance across a wide range of multimodal tasks. However, fine-tuning these models for domain-specific applications remains a computationally intensive challenge. This…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Chee Ng , Yuen Fung

In the post-deep learning era, the Transformer architecture has demonstrated its powerful performance across pre-trained big models and various downstream tasks. However, the enormous computational demands of this architecture have deterred…

Extracting actionable knowledge from industrial visual data is fundamentally bottlenecked by extreme class imbalance and the prohibitive computational complexity of modern foundation models. In semi-conductor manufacturing, identifying…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Satwik Sai Prakash Sahoo , Jyoti Prakash Sahoo , Ting Wang , Subrota Kumar Mondal

Transformers have revolutionized deep learning across various tasks, including audio representation learning, due to their powerful modeling capabilities. However, they often suffer from quadratic complexity in both GPU memory usage and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-06 Siavash Shams , Sukru Samet Dindar , Xilin Jiang , Nima Mesgarani

In the field of biomedical image analysis, the quest for architectures capable of effectively capturing long-range dependencies is paramount, especially when dealing with 3D image segmentation, classification, and landmark detection.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Haifan Gong , Luoyao Kang , Yitao Wang , Xiang Wan , Haofeng Li

State-space models (SSMs) have recently emerged as a compelling alternative to Transformers for sequence modeling tasks. This paper presents a theoretical generalization analysis of selective SSMs, the core architectural component behind…

Machine Learning · Computer Science 2025-11-05 Arya Honarpisheh , Mustafa Bozdag , Octavia Camps , Mario Sznaier

MambaVoiceCloning (MVC) asks whether the conditioning path of diffusion-based TTS can be made fully SSM-only at inference, removing all attention and explicit RNN-style recurrence layers across text, rhythm, and prosody, while preserving or…

Sound · Computer Science 2026-04-02 Sahil Kumar , Namrataben Patel , Honggang Wang , Youshan Zhang

Recent advancements in diffusion models have significantly improved symbolic music generation. However, most approaches rely on transformer-based architectures with self-attention mechanisms, which are constrained by quadratic computational…

Sound · Computer Science 2026-03-04 Shenghua Yuan , Xing Tang , Jiatao Chen , Tianming Xie , Jing Wang , Bing Shi

Multispectral fusion object detection is a critical task for edge-based maritime surveillance and remote sensing, demanding both high inference efficiency and robust feature representation for high-resolution inputs. However, current State…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Qianqian Zhang , Leon Tabaro , Ahmed M. Abdelmoniem , Junshe An

Noise is an inevitable aspect of point cloud acquisition, necessitating filtering as a fundamental task within the realm of 3D vision. Existing learning-based filtering methods have shown promising capabilities on small-scale synthetic or…

Multimedia · Computer Science 2025-01-10 Qingyuan Zhou , Weidong Yang , Ben Fei , Jingyi Xu , Rui Zhang , Keyi Liu , Yeqi Luo , Ying He

Existing RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture. Nonetheless, these methods mainly adopt imagepair appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Simiao Lai , Chang Liu , Jiawen Zhu , Ben Kang , Yang Liu , Dong Wang , Huchuan Lu

Predicting user preferences and sequential dependencies based on historical behavior is the core goal of sequential recommendation. Although attention-based models have shown effectiveness in this field, they often struggle with inference…

Machine Learning · Computer Science 2024-06-11 Yuda Wang , Xuxin He , Shengxin Zhu

Sequential Recommenders have been widely applied in various online services, aiming to model users' dynamic interests from their sequential interactions. With users increasingly engaging with online platforms, vast amounts of lifelong user…

Information Retrieval · Computer Science 2024-03-26 Jiyuan Yang , Yuanzi Li , Jingyu Zhao , Hanbing Wang , Muyang Ma , Jun Ma , Zhaochun Ren , Mengqi Zhang , Xin Xin , Zhumin Chen , Pengjie Ren

Transformer-based embedding models suffer from quadratic computational and linear memory complexity, limiting their utility for long sequences. We propose recurrent architectures as an efficient alternative, introducing a vertically chunked…

Computation and Language · Computer Science 2026-04-21 Tobias Grantner , Emanuel Sallinger , Martin Flechl

The Mamba-based image restoration backbones have recently demonstrated significant potential in balancing global reception and computational efficiency. However, the inherent causal modeling limitation of Mamba, where each token depends…

Image and Video Processing · Electrical Eng. & Systems 2025-03-12 Hang Guo , Yong Guo , Yaohua Zha , Yulun Zhang , Wenbo Li , Tao Dai , Shu-Tao Xia , Yawei Li

Recently, state space models (SSM), particularly Mamba, have attracted significant attention from scholars due to their ability to effectively balance computational efficiency and performance. However, most existing visual Mamba methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Leiye Liu , Miao Zhang , Jihao Yin , Tingwei Liu , Wei Ji , Yongri Piao , Huchuan Lu

Online video super-resolution (VSR) is an important technique for many real-world video processing applications, which aims to restore the current high-resolution video frame based on temporally previous frames. Most of the existing online…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Qiang Zhu , Xiandong Meng , Yuxian Jiang , Fan Zhang , David Bull , Shuyuan Zhu , Bing Zeng , Ronggang Wang

Vision Foundation Models (VFMs) and Vision-Language Models (VLMs) have gained traction in Domain Generalized Semantic Segmentation (DGSS) due to their strong generalization capabilities. However, existing DGSS methods often rely exclusively…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Xin Zhang , Robby T. Tan