English
Related papers

Related papers: MedMambaLite: Hardware-Aware Mamba for Medical Ima…

200 papers

Venous thromboembolism (VTE) is a critical cardiovascular condition, encompassing deep vein thrombosis (DVT) and pulmonary embolism (PE). Accurate and timely identification of VTE is essential for effective medical care. This study builds…

Machine Learning · Computer Science 2024-08-20 Jamie Deng , Yusen Wu , Yelena Yesha , Phuong Nguyen

The proliferation of complex deep learning (DL) models has revolutionized various applications, including computer vision-based solutions, prompting their integration into real-time systems. However, the resource-intensive nature of these…

Hardware Architecture · Computer Science 2024-06-26 Tushar Prasanna Swaminathan , Christopher Silver , Thangarajah Akilan

Diffusion models have become the most popular approach for high-quality image generation, but their high computational cost still remains a significant challenge. To address this problem, we propose U-Shape Mamba (USM), a novel diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Alex Ergasti , Filippo Botti , Tomaso Fontanini , Claudio Ferrari , Massimo Bertozzi , Andrea Prati

Underwater images often suffer from severe degradation, such as color distortion, low contrast, and blurred details, due to light absorption and scattering in water. While learning-based methods like CNNs and Transformers have shown…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Tejeswar Pokuri , Shivarth Rai

Transformers have revolutionized deep learning across various tasks, including audio representation learning, due to their powerful modeling capabilities. However, they often suffer from quadratic complexity in both GPU memory usage and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-06 Siavash Shams , Sukru Samet Dindar , Xilin Jiang , Nima Mesgarani

Accurate medical image segmentation is an integral part of the medical image analysis pipeline that requires the ability to merge local and global information. While vision transformers are able to capture global interactions using vanilla…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Elisha Dayag , Nhat Thanh Tran , Jack Xin

Medical image segmentation plays an important role in various clinical applications; however, existing deep learning models face trade-offs between efficiency and accuracy. Convolutional Neural Networks (CNNs) capture local details well but…

Image and Video Processing · Electrical Eng. & Systems 2025-10-20 Saqib Qamar , Mohd Fazil , Parvez Ahmad , Shakir Khan , Abu Taha Zamani

In the field of self-supervised depth estimation, Convolutional Neural Networks (CNNs) and Transformers have traditionally been dominant. However, both architectures struggle with efficiently handling long-range dependencies due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Ionuţ Grigore , Călin-Adrian Popa

Transformer has been extensively explored for hyperspectral image (HSI) classification. However, transformer poses challenges in terms of speed and memory usage because of its quadratic computational complexity. Recently, the Mamba model…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Yapeng Li , Yong Luo , Lefei Zhang , Zengmao Wang , Bo Du

State Space Models (SSMs), like recent Mamba2, have achieved remarkable performance and received extensive attention. However, deploying Mamba2 on resource-constrained edge devices encounters many problems: severe outliers within the linear…

Hardware Architecture · Computer Science 2025-07-29 Aotao Wang , Haikuo Shao , Shaobo Ma , Zhongfeng Wang

In the field of low-light image enhancement, both traditional Retinex methods and advanced deep learning techniques such as Retinexformer have shown distinct advantages and limitations. Traditional Retinex methods, designed to mimic the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Jiesong Bai , Yuhao Yin , Qiyuan He , Yuanxian Li , Xiaofeng Zhang

In the past decade, Convolutional Neural Networks (CNNs) and Transformers have achieved wide applicaiton in semantic segmentation tasks. Although CNNs with Transformer models greatly improve performance, the global context modeling remains…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Feixiang Du , Shengkun Wu

Medical image segmentation is essential in diagnostics, treatment planning, and healthcare, with deep learning offering promising advancements. Notably, the convolutional neural network (CNN) excels in capturing local image features,…

Image and Video Processing · Electrical Eng. & Systems 2024-07-30 Chao Ma , Ziyang Wang

In the field of biomedical image analysis, the quest for architectures capable of effectively capturing long-range dependencies is paramount, especially when dealing with 3D image segmentation, classification, and landmark detection.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Haifan Gong , Luoyao Kang , Yitao Wang , Xiang Wan , Haofeng Li

Multimodal Large Language Models (MLLMs) have attracted much attention for their multifunctionality. However, traditional Transformer architectures incur significant overhead due to their secondary computational complexity. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Wenjun Huang , Jiakai Pan , Jiahao Tang , Yanyu Ding , Yifei Xing , Yuhe Wang , Zhengzhuo Wang , Jianguo Hu

Recently, infrared small target detection (ISTD) has made significant progress, thanks to the development of basic models. Specifically, the models combining CNNs with transformers can successfully extract both local and global features.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Tianxiang Chen , Zi Ye , Zhentao Tan , Tao Gong , Yue Wu , Qi Chu , Bin Liu , Nenghai Yu , Jieping Ye

Spatial-Spectral Mamba (SSM) improves computational efficiency and captures long-range dependencies, addressing Transformer limitations. However, traditional Mamba models overlook rich spectral information in HSIs and struggle with high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Muhammad Ahmad , Muhammad Hassaan Farooq Butt , Muhammad Usama , Hamad Ahmed Altuwaijri , Manuel Mazzara , Salvatore Distefano

In recent years, Transformers-based models have made significant progress in the field of image restoration by leveraging their inherent ability to capture complex contextual features. Recently, Mamba models have made a splash in the field…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Juan Wen , Weiyan Hou , Luc Van Gool , Radu Timofte

Image deblurring is a critical stage in mobile image signal processing pipelines, where the ability to restore fine structures and textures must be balanced with real-time constraints on edge devices. While recent deep networks such as…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 Srinivas Miriyala , Sowmya Vajrala , Sravanth Kodavanti

Widely used traditional supervised deep learning methods require a large number of training samples but often fail to generalize on unseen datasets. Therefore, a more general application of any trained model is quite limited for medical…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Rabindra Khadga , Debesh Jha , Steven Hicks , Vajira Thambawita , Michael A. Riegler , Sharib Ali , Pål Halvorsen