English
Related papers

Related papers: Semantic Segmentation using Vision Transformers: A…

200 papers

Vision Transformer(ViT) is one of the most widely used models in the computer vision field with its great performance on various tasks. In order to fully utilize the ViT-based architecture in various applications, proper visualization…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Saebom Leem , Hyunseok Seo

Vision Transformers (ViTs) can learn strong image-level representations while their patch representations become less effective for dense prediction during prolonged training. We revisit this dense degradation phenomenon and argue that it…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Linxiang Su

In recent years, the scientific community has focused on the development of CAD tools that could improve bone fractures' classification, mostly based on Convolutional Neural Network (CNN). However, the discerning accuracy of fractures'…

Artificial Intelligence · Computer Science 2021-10-27 Leonardo Tanzi , Andrea Audisio , Giansalvo Cirrincione , Alessandro Aprato , Enrico Vezzetti

Semantic segmentation with deep learning has achieved great progress in classifying the pixels in the image. However, the local location information is usually ignored in the high-level feature extraction by the deep learning, which is…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Yi Lu , Yaran Chen , Dongbin Zhao , Jianxin Chen

Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) are two dominant models for image analysis. While CNNs excel at extracting multi-scale features and ViTs effectively capture global dependencies, both suffer from high…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Shicheng Yin , Kaixuan Yin , Weixing Chen , Enbo Huang , Yang Liu

Skin lesion segmentation (SLS) plays an important role in skin lesion analysis. Vision transformers (ViTs) are considered an auspicious solution for SLS, but they require more training data compared to convolutional neural networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Siyi Du , Nourhan Bayasi , Ghassan Hamarneh , Rafeef Garbi

Vision transformers (ViTs) have emerged as a prevalent architecture for vision tasks owing to their impressive performance. However, when it comes to handling long token sequences, especially in dense prediction tasks that require…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Jin Li , Yaoming Wang , Xiaopeng Zhang , Bowen Shi , Dongsheng Jiang , Chenglin Li , Wenrui Dai , Hongkai Xiong , Qi Tian

Intrigued by the inherent ability of the human visual system to identify salient regions in complex scenes, attention mechanisms have been seamlessly integrated into various Computer Vision (CV) tasks. Building upon this paradigm, Vision…

Semantic segmentation plays a vital role in computer vision tasks, enabling precise pixel-level understanding of images. In this paper, we present a comprehensive library for semantic segmentation, which contains implementations of popular…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Divam Gupta

Semantic segmentation using deep neural networks has been widely explored to generate high-level contextual information for autonomous vehicles. To acquire a complete $180^\circ$ semantic understanding of the forward surroundings, we…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Wei Zhou , Alex Zyner , Stewart Worrall , Eduardo Nebot

Semantic segmentation is a critical task in computer vision aiming to identify and classify individual pixels in an image, with numerous applications in for example autonomous driving and medical image analysis. However, semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Halil Ibrahim Aysel , Xiaohao Cai , Adam Prügel-Bennett

Cell instance segmentation is a fundamental task in digital pathology with broad clinical applications. Recently, vision foundation models, which are predominantly based on Vision Transformers (ViTs), have achieved remarkable success in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Yang Yang , Xijie Xu , Yixun Zhou , Jie Zheng

Convolutional neural networks (CNNs) achieved the state-of-the-art performance in medical image segmentation due to their ability to extract highly complex feature representations. However, it is argued in recent studies that traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Zhendi Gong , Andrew P. French , Guoping Qiu , Xin Chen

This paper proposes a convolutional neural network that can fuse high-level prior for semantic image segmentation. Motivated by humans' vision recognition system, our key design is a three-layer generative structure consisting of high-level…

Computer Vision and Pattern Recognition · Computer Science 2015-11-24 Haitian Zheng , Yebin Liu , Mengqi Ji , Feng Wu , Lu Fang

With the increasing popularity and the increasing size of vision transformers (ViTs), there has been an increasing interest in making them more efficient and less computationally costly for deployment on edge devices with limited computing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Phuoc-Hoan Charles Le , Xinlin Li

Semantic segmentation is a challenging task since it requires excessively more low-level spatial information of the image compared to other computer vision problems. The accuracy of pixel-level classification can be affected by many…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Zülfiye Kütük , Görkem Algan

Artificial intelligence (AI) techniques for image-based segmentation have garnered much attention in recent years. Convolutional neural networks (CNNs) have shown impressive results and potential towards fully automated segmentation in…

Medical Physics · Physics 2021-11-17 Fereshteh Yousefirizi , Abhinav K. Jha , Julia Brosch-Lenz , Babak Saboury , Arman Rahmim

Convolutional Neural Networks (CNNs) have reigned for a decade as the de facto approach to automated medical image diagnosis. Recently, vision transformers (ViTs) have appeared as a competitive alternative to CNNs, yielding similar levels…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Christos Matsoukas , Johan Fredin Haslum , Magnus Söderberg , Kevin Smith

Transformer, an attention-based encoder-decoder model, has already revolutionized the field of natural language processing (NLP). Inspired by such significant achievements, some pioneering works have recently been done on employing…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Yang Liu , Yao Zhang , Yixin Wang , Feng Hou , Jin Yuan , Jiang Tian , Yang Zhang , Zhongchao Shi , Jianping Fan , Zhiqiang He

Most recent semantic segmentation methods adopt a fully-convolutional network (FCN) with an encoder-decoder architecture. The encoder progressively reduces the spatial resolution and learns more abstract/semantic visual concepts with larger…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Sixiao Zheng , Jiachen Lu , Hengshuang Zhao , Xiatian Zhu , Zekun Luo , Yabiao Wang , Yanwei Fu , Jianfeng Feng , Tao Xiang , Philip H. S. Torr , Li Zhang