English
Related papers

Related papers: Mamba or RWKV: Exploring High-Quality and High-Eff…

200 papers

Convolutional Neural Networks (CNNs) and Transformers have been the most popular architectures for biomedical image segmentation, but both of them have limited ability to handle long-range dependencies because of inherent locality or…

Image and Video Processing · Electrical Eng. & Systems 2024-01-10 Jun Ma , Feifei Li , Bo Wang

Mamba has recently gained widespread attention as a backbone model for point cloud modeling, leveraging a state-space architecture that enables efficient global sequence modeling with linear complexity. However, its lack of local inductive…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Xuanyu Lin , Xiaona Zeng , Xianwei Zheng , Xutao Li

Ultrasound imaging frequently encounters challenges, such as those related to elevated noise levels, diminished spatiotemporal resolution, and the complexity of anatomical structures. These factors significantly hinder the model's ability…

Image and Video Processing · Electrical Eng. & Systems 2025-01-14 Xiaoxian Yang , Qi Wang , Kaiqi Zhang , Ke Wei , Jun Lyu , Lingchao Chen

Inspired by the tremendous success of Large Language Models (LLMs), existing Radiology report generation methods attempt to leverage large models to achieve better performance. They usually adopt a Transformer to extract the visual features…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Xiao Wang , Yuehang Li , Fuling Wang , Shiao Wang , Chuanfu Li , Bo Jiang

The recently proposed segment anything model (SAM) has made a significant influence in many computer vision tasks. It is becoming a foundation step for many high-level tasks, like image segmentation, image caption, and image editing.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Xu Zhao , Wenchao Ding , Yongqi An , Yinglong Du , Tao Yu , Min Li , Ming Tang , Jinqiao Wang

Panoptic segmentation requires the simultaneous recognition of countable thing instances and amorphous stuff regions, placing joint demands on long-range context modelling, multi-scale feature representation, and efficient dense prediction.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Qing Cheng , Damiano Bertolini , Wei Zhang , Dong Wang , Niclas Zeller , Daniel Cremers

In this paper, we propose a new architecture, called Deform-Mamba, for MR image super-resolution. Unlike conventional CNN or Transformer-based super-resolution approaches which encounter challenges related to the local respective field or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Zexin Ji , Beiji Zou , Xiaoyan Kui , Pierre Vera , Su Ruan

The Segment Anything Model (SAM) is a foundational model for image segmentation tasks, known for its strong generalization across diverse applications. However, its impressive performance comes with significant computational and resource…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Xiaorui Sun , Jun Liu , Heng Tao Shen , Xiaofeng Zhu , Ping Hu

In the era of large-scale pre-trained models, effectively adapting general knowledge to specific affective computing tasks remains a challenge, particularly regarding computational efficiency and multimodal heterogeneity. While…

Artificial Intelligence · Computer Science 2026-03-20 Yan Li , Yifei Xing , Xiangyuan Lan , Xin Li , Haifeng Chen , Dongmei Jiang

Hyperspectral image (HSI) classification is pivotal in the remote sensing (RS) field, particularly with the advancement of deep learning techniques. Sequential models, adapted from the natural language processing (NLP) field such as…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Weilian Zhou , Sei-Ichiro Kamata , Haipeng Wang , Man-Sing Wong , Huiying , Hou

Brain tumors exhibit high heterogeneity in morphology and multimodal contrast, making manual slice-by-slice de lineation time-consuming and experience-dependent, thus necessitating efficient and stable automated segmentation methods. To…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Hanjun Tao , Hua Wang , Fan Zhang

The goal of style transfer is, given a content image and a style source, generating a new image preserving the content but with the artistic representation of the style source. Most of the state-of-the-art architectures use transformers or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Filippo Botti , Alex Ergasti , Leonardo Rossi , Tomaso Fontanini , Claudio Ferrari , Massimo Bertozzi , Andrea Prati

Multi-modal MRI offers valuable complementary information for diagnosis and treatment; however, its utility is limited by prolonged scanning times. To accelerate the acquisition process, a practical approach is to reconstruct images of the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Jing Zou , Lanqing Liu , Qi Chen , Shujun Wang , Zhanli Hu , Xiaohan Xing , Jing Qin

The Mamba layer offers an efficient selective state space model (SSM) that is highly effective in modeling multiple domains, including NLP, long-range sequence processing, and computer vision. Selective SSMs are viewed as dual models, in…

Machine Learning · Computer Science 2024-04-02 Ameen Ali , Itamar Zimerman , Lior Wolf

Acquiring high-quality annotated data for medical image segmentation is tedious and costly. Semi-supervised segmentation techniques alleviate this burden by leveraging unlabeled data to generate pseudo labels. Recently, advanced state space…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Shumeng Li , Jian Zhang , Lei Qi , Luping Zhou , Yinghuan Shi , Yang Gao

Diffusion language models (DLMs) have emerged as a promising alternative to autoregressive (AR) generation, yet their reliance on Transformer backbones limits inference efficiency due to quadratic attention or KV-cache overhead. We…

Machine Learning · Computer Science 2026-03-02 Vaibhav Singh , Oleksiy Ostapenko , Pierre-André Noël , Eugene Belilovsky , Torsten Scholak

Skin lesion segmentation is a crucial method for identifying early skin cancer. In recent years, both convolutional neural network (CNN) and Transformer-based methods have been widely applied. Moreover, combining CNN and Transformer…

Image and Video Processing · Electrical Eng. & Systems 2024-09-18 Shun Zou , Mingya Zhang , Bingjian Fan , Zhengyi Zhou , Xiuguo Zou

The accelerated MRI reconstruction poses a challenging ill-posed inverse problem due to the significant undersampling in k-space. Deep neural networks, such as CNNs and ViTs, have shown substantial performance improvements for this task…

Image and Video Processing · Electrical Eng. & Systems 2025-04-01 Yucong Meng , Zhiwei Yang , Zhijian Song , Yonghong Shi

Vision Mamba has emerged as a promising and efficient alternative to Vision Transformers, yet its efficiency remains fundamentally constrained by the number of input tokens. Existing token reduction approaches typically adopt token pruning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Shanhui Liu , Rui Xu , Yunke Wang

The Vision Transformer (ViT) model has long struggled with the challenge of quadratic complexity, a limitation that becomes especially critical in unmanned aerial vehicle (UAV) tracking systems, where data must be processed in real time. In…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Bingxi Liu , Calvin Chen , Junhao Li , Guyang Yu , Haoqian Song , Xuchen Liu , Jinqiang Cui , Hong Zhang