English
Related papers

Related papers: Contextual Attention Network: Transformer Meets U-…

200 papers

Convolutional Neural Networks (CNNs) model long-range dependencies by deeply stacking convolution operations with small window sizes, which makes the optimizations difficult. This paper presents region-based non-local (RNL) operations as a…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Guoxi Huang , Adrian G. Bors

Image restoration (IR) is a long-standing task to recover a high-quality image from its corrupted observation. Recently, transformer-based algorithms and some attention-based convolutional neural networks (CNNs) have presented promising…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Fangwei Hao , Ji Du , Weiyun Liang , Jing Xu , Xiaoxuan Xu

Medical ultrasound image segmentation presents a formidable challenge in the realm of computer vision. Traditional approaches rely on Convolutional Neural Networks (CNNs) and Transformer-based methods to address the intricacies of medical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Weixin Xu , Ziliang Wang

The UNet architecture, based on Convolutional Neural Networks (CNN), has demonstrated its remarkable performance in medical image analysis. However, it faces challenges in capturing long-range dependencies due to the limited receptive…

Image and Video Processing · Electrical Eng. & Systems 2023-07-28 Liang Xu , Mingxiao Chen , Yi Cheng , Pengfei Shao , Shuwei Shen , Peng Yao , Ronald X. Xu

Transformer with self-attention has led to the revolutionizing of natural language processing field, and recently inspires the emergence of Transformer-style architecture design with competitive results in numerous computer vision tasks.…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Yehao Li , Ting Yao , Yingwei Pan , Tao Mei

Accurate spatio-temporal prediction is crucial for the sustainable development of smart cities. However, current approaches often struggle to capture important spatio-temporal relationships, particularly overlooking global relations among…

Machine Learning · Computer Science 2024-11-12 Ashutosh Sao , Simon Gottschalk

Convolutional Neural Networks (CNNs) have revolutionized the understanding of visual content. This is mainly due to their ability to break down an image into smaller pieces, extract multi-scale localized features and compose them to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zachary Wharton , Ardhendu Behera , Asish Bera

Accurate medical image segmentation is essential for clinical quantification, disease diagnosis, treatment planning and many other applications. Both convolution-based and transformer-based u-shaped architectures have made significant…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Libin Lan , Pengzhou Cai , Lu Jiang , Xiaojuan Liu , Yongmei Li , Yudong Zhang

Automated medical image segmentation is becoming increasingly crucial to modern clinical practice, driven by the growing demand for precise diagnosis, the push towards personalized treatment plans, and the advancements in machine learning…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Tan-Hanh Pham , Xianqi Li , Kim-Doang Nguyen

In recent years, computer-aided diagnosis has become an increasingly popular topic. Methods based on convolutional neural networks have achieved good performance in medical image segmentation and classification. Due to the limitations of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Yao Chang , Hu Menghan , Zhai Guangtao , Zhang Xiao-Ping

Multi-organ segmentation is one of most successful applications of deep learning in medical image analysis. Deep convolutional neural nets (CNNs) have shown great promise in achieving clinically applicable image segmentation performance on…

Image and Video Processing · Electrical Eng. & Systems 2020-12-18 Hao Tang , Xingwei Liu , Kun Han , Shanlin Sun , Narisu Bai , Xuming Chen , Huang Qian , Yong Liu , Xiaohui Xie

Although convolutional neural networks (CNNs) are promoting the development of medical image semantic segmentation, the standard model still has some shortcomings. First, the feature mapping from the encoder and decoder sub-networks in the…

Image and Video Processing · Electrical Eng. & Systems 2020-12-22 Yutong Cai , Yong Wang

Convolutional Neural Networks (CNNs) have advanced existing medical systems for automatic disease diagnosis. However, there are still concerns about the reliability of deep medical diagnosis systems against the potential threats of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Omid Nejati Manzari , Hamid Ahmadabadi , Hossein Kashiani , Shahriar B. Shokouhi , Ahmad Ayatollahi

Despite the widespread adoption of transformers in medical applications, the exploration of multi-scale learning through transformers remains limited, while hierarchical representations are considered advantageous for computer-aided medical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Xiaoya Tang , Bodong Zhang , Man Minh Ho , Beatrice S. Knudsen , Tolga Tasdizen

Medical image segmentation plays a crucial role in advancing healthcare systems for disease diagnosis and treatment planning. The u-shaped architecture, popularly known as U-Net, has proven highly successful for various medical image…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Jieneng Chen , Jieru Mei , Xianhang Li , Yongyi Lu , Qihang Yu , Qingyue Wei , Xiangde Luo , Yutong Xie , Ehsan Adeli , Yan Wang , Matthew Lungren , Lei Xing , Le Lu , Alan Yuille , Yuyin Zhou

In recent years, significant advancements have been made in deep learning for medical image segmentation, particularly with convolutional neural networks (CNNs) and transformer models. However, CNNs face limitations in capturing long-range…

Image and Video Processing · Electrical Eng. & Systems 2025-10-28 Juntao Jiang , Jiangning Zhang , Weixuan Liu , Muxuan Gao , Xiaobin Hu , Zhucun Xue , Yong Liu , Shuicheng Yan

Accurate segmentation of the region of interest in medical images can provide an essential pathway for devising effective treatment plans for life-threatening diseases. It is still challenging for U-Net, and its state-of-the-art variants,…

Image and Video Processing · Electrical Eng. & Systems 2024-04-09 Md. Rayhan Ahmed , Adnan Ferdous Ashrafi , Raihan Uddin Ahmed , Swakkhar Shatabda , A. K. M. Muzahidul Islam , Salekul Islam

Convolutional neural networks (CNNs) excel in local feature extraction while Transformers are superior in processing global semantic information. By leveraging the strengths of both, hybrid Transformer-CNN networks have become the major…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Xu Ma , Mengsheng Chen , Junhui Zhang , Lijuan Song , Fang Du , Zhenhua Yu

Medical image segmentation plays an important role in computer-aided diagnosis. Existing methods mainly utilize spatial attention to highlight the region of interest. However, due to limitations of medical imaging devices, medical images…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Jiaxuan Li , Qing Xu , Xiangjian He , Ziyu Liu , Daokun Zhang , Ruili Wang , Rong Qu , Guoping Qiu

Despite the growing success of Convolution neural networks (CNN) in the recent past in the task of scene segmentation, the standard models lack some of the important features that might result in sub-optimal segmentation outputs. The widely…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Soham Chattopadhyay , Hritam Basak