English
Related papers

Related papers: Native Segmentation Vision Transformers

200 papers

We introduce dense vision transformers, an architecture that leverages vision transformers in place of convolutional networks as a backbone for dense prediction tasks. We assemble tokens from various stages of the vision transformer into…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 René Ranftl , Alexey Bochkovskiy , Vladlen Koltun

While visual autoregressive modeling (VAR) strategies have shed light on image generation with the autoregressive models, their potential for segmentation, a task that requires precise low-level spatial perception, remains unexplored.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Rongkun Zheng , Lu Qi , Xi Chen , Yi Wang , Kun Wang , Hengshuang Zhao

Weakly-supervised semantic segmentation under image tags supervision is a challenging task as it directly associates high-level semantic to low-level appearance. To bridge this gap, in this paper, we propose an iterative bottom-up and…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 Xiang Wang , Shaodi You , Xi Li , Huimin Ma

Vision transformer has achieved impressive performance for many vision tasks. However, it may suffer from high redundancy in capturing local features for shallow layers. Local self-attention or early-stage convolutions are thus utilized,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Huaibo Huang , Xiaoqiang Zhou , Jie Cao , Ran He , Tieniu Tan

The quality of patient care associated with diagnostic radiology is proportionate to a physician workload. Segmentation is a fundamental limiting precursor to both diagnostic and therapeutic procedures. Advances in machine learning (ML) aim…

Image and Video Processing · Electrical Eng. & Systems 2022-08-30 Ahmed Ghorbel , Ahmed Aldahdooh , Shadi Albarqouni , Wassim Hamidouche

Unsupervised semantic segmentation aims to obtain high-level semantic representation on low-level visual features without manual annotations. Most existing methods are bottom-up approaches that try to group pixels into regions based on…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Zhaoyuan Yin , Pichao Wang , Fan Wang , Xianzhe Xu , Hanling Zhang , Hao Li , Rong Jin

Semantic segmentation has a broad range of applications in a variety of domains including land coverage analysis, autonomous driving, and medical image analysis. Convolutional neural networks (CNN) and Vision Transformers (ViTs) provide the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Hans Thisanke , Chamli Deshan , Kavindu Chamith , Sachith Seneviratne , Rajith Vidanaarachchi , Damayanthi Herath

Transformers have become a common foundation across deep learning, yet 3D scene understanding still relies on specialized backbones with strong domain priors. This keeps the field isolated from the broader Transformer ecosystem, limiting…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Kadir Yilmaz , Adrian Kruse , Tristan Höfer , Daan de Geus , Bastian Leibe

Unsupervised semantic segmentation aims to categorize each pixel in an image into a corresponding class without the use of annotated data. It is a widely researched area as obtaining labeled datasets is expensive. While previous works in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Yau Shing Jonathan Cheung , Xi Chen , Lihe Yang , Hengshuang Zhao

This paper presents a novel approach for segmenting moving objects in unconstrained environments using guided convolutional neural networks. This guiding process relies on foreground masks from independent algorithms (i.e. state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Diego Ortego , Kevin McGuinness , Juan C. SanMiguel , Eric Arazo , José M. Martínez , Noel E. O'Connor

The goal of self-supervised visual representation learning is to learn strong, transferable image representations, with the majority of research focusing on object or scene level. On the other hand, representation learning at part level has…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Subhabrata Choudhury , Iro Laina , Christian Rupprecht , Andrea Vedaldi

We propose an approach to instance-level image segmentation that is built on top of category-level segmentation. Specifically, for each pixel in a semantic category mask, its corresponding instance bounding box is predicted using a deep…

Computer Vision and Pattern Recognition · Computer Science 2016-05-24 Zifeng Wu , Chunhua Shen , Anton van den Hengel

Image segmentation is a fundamental and challenging problem in computer vision with applications spanning multiple areas, such as medical imaging, remote sensing, and autonomous vehicles. Recently, convolutional neural networks (CNNs) have…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Ali Hatamizadeh

The emergence of vision transformers (ViTs) in image classification has shifted the methodologies for visual representation learning. In particular, ViTs learn visual representation at full receptive field per layer across all the image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Li Zhang , Jiachen Lu , Sixiao Zheng , Xinxuan Zhao , Xiatian Zhu , Yanwei Fu , Tao Xiang , Jianfeng Feng , Philip H. S. Torr

Semantic segmentation is a key computer vision task that has been actively researched for decades. In recent years, supervised methods have reached unprecedented accuracy, however they require many pixel-level annotations for every new…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Nir Zabari , Yedid Hoshen

Semantic segmentation necessitates approaches that learn high-level characteristics while dealing with enormous amounts of data. Convolutional neural networks (CNNs) can learn unique and adaptive features to achieve this aim. However, due…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Hasan AlMarzouqi , Lyes Saad Saoud

We introduce an approach to integrate segmentation information within a convolutional neural network (CNN). This counter-acts the tendency of CNNs to smooth information across regions and increases their spatial precision. To obtain…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Adam W. Harley , Konstantinos G. Derpanis , Iasonas Kokkinos

Language-driven image segmentation is a fundamental task in vision-language understanding, requiring models to segment regions of an image corresponding to natural language expressions. Traditional methods approach this as a discriminative…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Yuhao Chen , Shubin Chen , Liang Lin , Guangrun Wang

The Transformer architecture has achieved significant success in natural language processing, motivating its adaptation to computer vision tasks. Unlike convolutional neural networks, vision transformers inherently capture long-range…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Zherui Zhang , Rongtao Xu , Jie Zhou , Changwei Wang , Xingtian Pei , Wenhao Xu , Jiguang Zhang , Li Guo , Longxiang Gao , Wenbo Xu , Shibiao Xu

Recently, a variety of vision transformers have been developed as their capability of modeling long-range dependency. In current transformer-based backbones for medical image segmentation, convolutional layers were replaced with pure…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Huimin Huang , Shiao Xie1 , Lanfen Lin , Yutaro Iwamoto , Xianhua Han , Yen-Wei Chen , Ruofeng Tong