English
Related papers

Related papers: TransLK-Net: Entangling Transformer and Large Kern…

200 papers

Convolutional neural networks (CNN) have demonstrated outstanding Compressed Sensing (CS) performance compared to traditional, hand-crafted methods. However, they are broadly limited in terms of generalisability, inductive bias and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Marlon Bran Lorenzana , Craig Engstrom , Shekhar S. Chandra

Convolutional neural networks (CNNs) evaluate short-range correlations in input images which progress along the layers, whereas vision transformer (ViT) architectures evaluate long-range correlations, using repeated transformer encoders…

Machine Learning · Computer Science 2025-04-10 Ella Koresh , Ronit D. Gross , Yuval Meir , Yarden Tzach , Tal Halevi , Ido Kanter

The Vision Transformer (ViT) leverages the Transformer's encoder to capture global information by dividing images into patches and achieves superior performance across various computer vision tasks. However, the self-attention mechanism of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Tianxiao Zhang , Wenju Xu , Bo Luo , Guanghui Wang

We present a novel method that extends the self-attention mechanism of a vision transformer (ViT) for more accurate object detection across diverse datasets. ViTs show strong capability for image understanding tasks such as object…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Tan Nguyen , Coy D. Heldermon , Corey Toler-Franklin

Convolutional blocks have played a crucial role in advancing medical image segmentation by excelling in dense prediction tasks. However, their inability to effectively capture long-range dependencies has limited their performance.…

Image and Video Processing · Electrical Eng. & Systems 2026-03-17 Siddhartha Mallick , Aayushman Ghosh , Jayanta Paul , Jaya Sil

Medical image segmentation plays a crucial role in assisting healthcare professionals with accurate diagnoses and enabling automated diagnostic processes. Traditional convolutional neural networks (CNNs) often struggle with capturing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Phuong-Nam Tran , Nhat Truong Pham , Duc Ngoc Minh Dang , Eui-Nam Huh , Choong Seon Hong

In recent years, significant advancements have been made in deep learning for medical image segmentation, particularly with convolutional neural networks (CNNs) and transformer models. However, CNNs face limitations in capturing long-range…

Image and Video Processing · Electrical Eng. & Systems 2025-10-28 Juntao Jiang , Jiangning Zhang , Weixuan Liu , Muxuan Gao , Xiaobin Hu , Zhucun Xue , Yong Liu , Shuicheng Yan

The accurate segmentation of medical images is critical for various healthcare applications. Convolutional neural networks (CNNs), especially Fully Convolutional Networks (FCNs) like U-Net, have shown remarkable success in medical image…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Omid Nejati Manzari , Javad Mirzapour Kaleybar , Hooman Saadat , Shahin Maleki

Medical image segmentation plays a vital role in various clinical applications, enabling accurate delineation and analysis of anatomical structures or pathological regions. Traditional CNNs have achieved remarkable success in this field.…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Seyed M. R. Modaresi , Aomar Osmani , Mohammadreza Razzazi , Abdelghani Chibani

Vision transformer (ViT) has recently shown its strong capability in achieving comparable results to convolutional neural networks (CNNs) on image classification. However, vanilla ViT simply inherits the same architecture from the natural…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Chun-Fu Chen , Rameswar Panda , Quanfu Fan

Medical image segmentation is crucial for the development of computer-aided diagnostic and therapeutic systems, but still faces numerous difficulties. In recent years, the commonly used encoder-decoder architecture based on CNNs has been…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Davoud Saadati , Omid Nejati Manzari , Sattar Mirzakuchaki

Accurate segmentation of organs or lesions from medical images is crucial for reliable diagnosis of diseases and organ morphometry. In recent years, convolutional encoder-decoder solutions have achieved substantial progress in the field of…

Image and Video Processing · Electrical Eng. & Systems 2022-07-12 Bingzhi Chen , Yishu Liu , Zheng Zhang , Guangming Lu , Adams Wai Kin Kong

In clinical practice, medical image analysis often requires efficient execution on resource-constrained mobile devices. However, existing mobile models-primarily optimized for natural images-tend to perform poorly on medical tasks due to…

Image and Video Processing · Electrical Eng. & Systems 2025-08-05 Fenghe Tang , Bingkun Nian , Jianrui Ding , Wenxin Ma , Quan Quan , Chengqi Dong , Jie Yang , Wei Liu , S. Kevin Zhou

Brain tumor segmentation models have aided diagnosis in recent years. However, they face MRI complexity and variability challenges, including irregular shapes and unclear boundaries, leading to noise, misclassification, and incomplete…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Ruoxin Wang , Tianyi Tang , Haiming Du , Yuxuan Cheng , Yu Wang , Lingjie Yang , Xiaohui Duan , Yunfang Yu , Yu Zhou , Donglong Chen

The convolutional neural network-based methods have become more and more popular for medical image segmentation due to their outstanding performance. However, they struggle with capturing long-range dependencies, which are essential for…

Image and Video Processing · Electrical Eng. & Systems 2024-01-30 Hongkun Sun , Jing Xu , Yuping Duan

Large Language Models (LLMs), known for their versatility in textual data, are increasingly being explored for their potential to enhance medical image segmentation, a crucial task for accurate diagnostic imaging. This study explores…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Gurucharan Marthi Krishna Kumar , Aman Chadha , Janine Mendola , Amir Shmuel

Vision Transformers (ViT) have recently emerged as a powerful alternative to convolutional networks (CNNs). Although hybrid models attempt to bridge the gap between these two architectures, the self-attention layers they rely on induce a…

Machine Learning · Computer Science 2021-06-11 Stéphane d'Ascoli , Levent Sagun , Giulio Biroli , Ari Morcos

Accurate skin-lesion segmentation remains a key technical challenge for computer-aided diagnosis of skin cancer. Convolutional neural networks, while effective, are constrained by limited receptive fields and thus struggle to model…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Pengyang Yu , Haoquan Wang , Gerard Marks , Tahar Kechadi , Laurence T. Yang , Sahraoui Dhelim , Nyothiri Aung

Vision Transformers (ViTs) have shown impressive performance but still require a high computation cost as compared to convolutional neural networks (CNNs), one reason is that ViTs' attention measures global similarities and thus has a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Haoran You , Yunyang Xiong , Xiaoliang Dai , Bichen Wu , Peizhao Zhang , Haoqi Fan , Peter Vajda , Yingyan Celine Lin

Vision Transformers (ViTs) have revolutionized computer vision by leveraging self-attention to model long-range dependencies. However, ViTs face challenges such as high computational costs due to the quadratic scaling of self-attention and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Zhoujie Qian