中文
相关论文

相关论文: The Lighter The Better: Rethinking Transformers in…

200 篇论文

Deep neural networks have been a prevailing technique in the field of medical image processing. However, the most popular convolutional neural networks (CNNs) based methods for medical image segmentation are imperfect because they model…

计算机视觉与模式识别 · 计算机科学 2022-05-02 Zhuangzhuang Zhang , Weixiong Zhang

Real world images often have highly imbalanced content density. Some areas are very uniform, e.g., large patches of blue sky, while other areas are scattered with many small objects. Yet, the commonly used successive grid downsampling…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Chen Ziwen , Kaushik Patnaik , Shuangfei Zhai , Alvin Wan , Zhile Ren , Alex Schwing , Alex Colburn , Li Fuxin

Transformers have made remarkable progress towards modeling long-range dependencies within the medical image analysis domain. However, current transformer-based models suffer from several disadvantages: (1) existing methods fail to capture…

计算机视觉与模式识别 · 计算机科学 2022-12-16 Chenyu You , Ruihan Zhao , Fenglin Liu , Siyuan Dong , Sandeep Chinchali , Ufuk Topcu , Lawrence Staib , James S. Duncan

In medical image segmentation, specialized computer vision techniques, notably transformers grounded in attention mechanisms and residual networks employing skip connections, have been instrumental in advancing performance. Nonetheless,…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Fuchen Zheng , Xuhang Chen , Weihuang Liu , Haolun Li , Yingtie Lei , Jiahui He , Chi-Man Pun , Shounjun Zhou

The segmentation of medical images is important for the improvement and creation of healthcare systems, particularly for early disease detection and treatment planning. In recent years, the use of convolutional neural networks (CNNs) and…

图像与视频处理 · 电气工程与系统科学 2024-01-12 Siddharth Tiwari

Accurate and computationally efficient 3D medical image segmentation remains a critical challenge in clinical workflows. Transformer-based architectures often demonstrate superior global contextual modeling but at the expense of excessive…

图像与视频处理 · 电气工程与系统科学 2026-02-19 Kavyansh Tyagi , Vishwas Rathi , Puneet Goyal

Recent advances in transformer-based models have drawn attention to exploring these techniques in medical image segmentation, especially in conjunction with the U-Net model (or its variants), which has shown great success in medical image…

图像与视频处理 · 电气工程与系统科学 2021-10-22 Xiangyi Yan , Hao Tang , Shanlin Sun , Haoyu Ma , Deying Kong , Xiaohui Xie

The adoption of Vision Transformers (ViTs) based architectures represents a significant advancement in 3D Medical Image (MI) segmentation, surpassing traditional Convolutional Neural Network (CNN) models by enhancing global contextual…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Shehan Perera , Pouyan Navard , Alper Yilmaz

Segmentation of 3D medical images is a critical task for accurate diagnosis and treatment planning. Convolutional neural networks (CNNs) have dominated the field, achieving significant success in 3D medical image segmentation. However, CNNs…

图像与视频处理 · 电气工程与系统科学 2025-02-11 Canxuan Gang

Deep learning has driven significant advances in medical image analysis, yet its adoption in clinical practice remains constrained by the large size and lack of transparency in modern models. Advances in interpretability techniques such as…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Nikita Malik , Pratinav Seth , Neeraj Kumar Singh , Chintan Chitroda , Vinay Kumar Sankarapu

The Segment Anything Model (SAM) has recently gained popularity in the field of image segmentation due to its impressive capabilities in various segmentation tasks and its prompt-based interface. However, recent studies and individual…

计算机视觉与模式识别 · 计算机科学 2024-01-01 Junde Wu , Wei Ji , Yuanpei Liu , Huazhu Fu , Min Xu , Yanwu Xu , Yueming Jin

Visual segmentation seeks to partition images, video frames, or point clouds into multiple segments or groups. This technique has numerous real-world applications, such as autonomous driving, image editing, robot sensing, and medical…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Xiangtai Li , Henghui Ding , Haobo Yuan , Wenwei Zhang , Jiangmiao Pang , Guangliang Cheng , Kai Chen , Ziwei Liu , Chen Change Loy

Window-based transformers have demonstrated outstanding performance in super-resolution tasks due to their adaptive modeling capabilities through local self-attention (SA). However, they exhibit higher computational complexity and inference…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Zhenyu Hu , Wanjie Sun

Massively pre-trained transformer models are computationally expensive to fine-tune, slow for inference, and have large storage requirements. Recent approaches tackle these shortcomings by training smaller models, dynamically reducing the…

机器学习 · 计算机科学 2021-10-07 Andreas Rücklé , Gregor Geigle , Max Glockner , Tilman Beck , Jonas Pfeiffer , Nils Reimers , Iryna Gurevych

Vision Transformers (ViTs) have demonstrated strong performance across a wide range of vision tasks, yet their substantial computational and memory demands hinder efficient deployment on resource-constrained mobile and edge devices. Pruning…

计算机视觉与模式识别 · 计算机科学 2026-01-07 Zhibo Wang , Zuoyuan Zhang , Xiaoyi Pang , Qile Zhang , Xuanyi Hao , Shuguo Zhuo , Peng Sun

Vision Transformer shows great superiority in medical image segmentation due to the ability in learning long-range dependency. For medical image segmentation from 3D data, such as computed tomography (CT), existing methods can be broadly…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Sucheng Ren , Xiaomeng Li

Most recent scribble-supervised segmentation methods commonly adopt a CNN framework with an encoder-decoder architecture. Despite its multiple benefits, this framework generally can only capture small-range feature dependency for the…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Zihan Li , Yuan Zheng , Dandan Shan , Shuzhou Yang , Qingde Li , Beizhan Wang , Yuanting Zhang , Qingqi Hong , Dinggang Shen

The remarkable performance of the Transformer architecture in natural language processing has recently also triggered broad interest in Computer Vision. Among other merits, Transformers are witnessed as capable of learning long-range…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Reza Azad , Amirhossein Kazerouni , Moein Heidari , Ehsan Khodapanah Aghdam , Amirali Molaei , Yiwei Jia , Abin Jose , Rijo Roy , Dorit Merhof

Transformers have achieved remarkable success in medical image analysis owing to their powerful capability to use flexible self-attention mechanism. However, due to lacking intrinsic inductive bias in modeling visual structural information,…

图像与视频处理 · 电气工程与系统科学 2022-11-18 Yiyue Hu , Lei Zhang , Nan Mu , Lei Liu

NLP(natural language processsing) has achieved great success through the transformer model.However, the model has hundreds of millions or billions parameters,which is huge burden for its deployment on personal computer or small scale of…

信息检索 · 计算机科学 2024-08-26 TianChen Wang