English
Related papers

Related papers: Transformer-Based Visual Segmentation: A Survey

200 papers

The adoption of Vision Transformers (ViTs) based architectures represents a significant advancement in 3D Medical Image (MI) segmentation, surpassing traditional Convolutional Neural Network (CNN) models by enhancing global contextual…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Shehan Perera , Pouyan Navard , Alper Yilmaz

In recent years, vision transformers (ViTs) have emerged as powerful and promising techniques for computer vision tasks such as image classification, object detection, and segmentation. Unlike convolutional neural networks (CNNs), which…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shaibal Saha , Lanyu Xu

Image segmentation, the process of partitioning an image into meaningful regions, plays a pivotal role in computer vision and medical imaging applications. Unsupervised segmentation, particularly in the absence of labeled data, remains a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Kovvuri Sai Gopal Reddy , Bodduluri Saran , A. Mudit Adityaja , Saurabh J. Shigwan , Nitin Kumar

Semantic image segmentation is one of fastest growing areas in computer vision with a variety of applications. In many areas, such as robotics and autonomous vehicles, semantic image segmentation is crucial, since it provides the necessary…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Georgios Takos

The hybrid architecture of convolutional neural networks (CNNs) and Transformer are very popular for medical image segmentation. However, it suffers from two challenges. First, although a CNNs branch can capture the local image features…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Tao Lei , Rui Sun , Xuan Wang , Yingbo Wang , Xi He , Asoke Nandi

Over the past decade, Deep Convolutional Neural Networks have been widely adopted for medical image segmentation and shown to achieve adequate performance. However, due to the inherent inductive biases present in the convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Jeya Maria Jose Valanarasu , Poojan Oza , Ilker Hacihaliloglu , Vishal M. Patel

From the autonomous car driving to medical diagnosis, the requirement of the task of image segmentation is everywhere. Segmentation of an image is one of the indispensable tasks in computer vision. This task is comparatively complicated…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Farhana Sultana , Abu Sufian , Paramartha Dutta

As a special type of transformer, Vision Transformers (ViTs) are used to various computer vision applications (CV), such as image recognition. There are several potential problems with convolutional neural networks (CNNs) that can be solved…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Sonain Jamil , Md. Jalil Piran , Oh-Jin Kwon

Automated medical image segmentation is becoming increasingly crucial to modern clinical practice, driven by the growing demand for precise diagnosis, the push towards personalized treatment plans, and the advancements in machine learning…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Tan-Hanh Pham , Xianqi Li , Kim-Doang Nguyen

The quality of patient care associated with diagnostic radiology is proportionate to a physician workload. Segmentation is a fundamental limiting precursor to both diagnostic and therapeutic procedures. Advances in machine learning (ML) aim…

Image and Video Processing · Electrical Eng. & Systems 2022-08-30 Ahmed Ghorbel , Ahmed Aldahdooh , Shadi Albarqouni , Wassim Hamidouche

Critical research about camera-and-LiDAR-based semantic object segmentation for autonomous driving significantly benefited from the recent development of deep learning. Specifically, the vision transformer is the novel ground-breaker that…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Junyi Gu , Mauro Bellone , Tomáš Pivoňka , Raivo Sell

Vision transformers are effective deep learning models for vision tasks, including medical image segmentation. However, they lack efficiency and translational invariance, unlike convolutional neural networks (CNNs). To model long-range…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 Liam Chalcroft , Ruben Lourenço Pereira , Mikael Brudfors , Andrew S. Kayser , Mark D'Esposito , Cathy J. Price , Ioannis Pappas , John Ashburner

The machine learning community has been overwhelmed by a plethora of deep learning based approaches. Many challenging computer vision tasks such as detection, localization, recognition and segmentation of objects in unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Swarnendu Ghosh , Nibaran Das , Ishita Das , Ujjwal Maulik

Semantic segmentation necessitates approaches that learn high-level characteristics while dealing with enormous amounts of data. Convolutional neural networks (CNNs) can learn unique and adaptive features to achieve this aim. However, due…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Hasan AlMarzouqi , Lyes Saad Saoud

Medical image segmentation allows quantifying target structure size and shape, aiding in disease diagnosis, prognosis, surgery planning, and comprehension.Building upon recent advancements in foundation Vision-Language Models (VLMs) from…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Kanchan Poudel , Manish Dhakal , Prasiddha Bhandari , Rabin Adhikari , Safal Thapaliya , Bishesh Khanal

Dynamic attention mechanism and global modeling ability make Transformer show strong feature learning ability. In recent years, Transformer has become comparable to CNNs methods in computer vision. This review mainly investigates the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Yuting Yang , Licheng Jiao , Xu Liu , Fang Liu , Shuyuan Yang , Zhixi Feng , Xu Tang

Image semantic segmentation is more and more being of interest for computer vision and machine learning researchers. Many applications on the rise need accurate and efficient segmentation mechanisms: autonomous driving, indoor navigation,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Alberto Garcia-Garcia , Sergio Orts-Escolano , Sergiu Oprea , Victor Villena-Martinez , Jose Garcia-Rodriguez

Convolutional Neural Networks (CNNs), architectures consisting of convolutional layers, have been the standard choice in vision tasks. Recent studies have shown that Vision Transformers (VTs), architectures based on self-attention modules,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Kishaan Jeeveswaran , Senthilkumar Kathiresan , Arnav Varma , Omar Magdy , Bahram Zonooz , Elahe Arani

The Transformer architecture has achieved significant success in natural language processing, motivating its adaptation to computer vision tasks. Unlike convolutional neural networks, vision transformers inherently capture long-range…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Zherui Zhang , Rongtao Xu , Jie Zhou , Changwei Wang , Xingtian Pei , Wenhao Xu , Jiguang Zhang , Li Guo , Longxiang Gao , Wenbo Xu , Shibiao Xu

Convolutional neural networks (CNNs) achieved the state-of-the-art performance in medical image segmentation due to their ability to extract highly complex feature representations. However, it is argued in recent studies that traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Zhendi Gong , Andrew P. French , Guoping Qiu , Xin Chen