English
Related papers

Related papers: SeMask: Semantically Masked Transformers for Seman…

200 papers

The hematology analytics used for detection and classification of small blood components is a significant challenge. In particular, when objects exists as small pixel-sized entities in a large context of similar objects. Deep learning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 H. Martin Gillis , Ming Hill , Paul Hollensen , Alan Fine , Thomas Trappenberg

We introduce semantic form mid-tuning, an approach for transferring semantic knowledge from semantic meaning representations into transformer-based language encoders. In mid-tuning, we learn to align the text of general sentences -- not…

Computation and Language · Computer Science 2021-10-15 Mohammad Umair , Francis Ferraro

Most approaches for semantic segmentation use only information from color cameras to parse the scenes, yet recent advancements show that using depth data allows to further improve performances. In this work, we focus on transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Francesco Barbato , Giulia Rizzoli , Pietro Zanuttigh

High-resolution semantic segmentation requires substantial computational resources. Traditional approaches in the field typically downscale the input images before processing and then upscale the low-resolution outputs back to their…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Ritambhara Singh , Abhishek Jain , Pietro Perona , Shivani Agarwal , Junfeng Yang

Deep neural networks have enabled major progresses in semantic segmentation. However, even the most advanced neural architectures suffer from important limitations. First, they are vulnerable to catastrophic forgetting, i.e. they perform…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Fabio Cermelli , Massimiliano Mancini , Samuel Rota Buló , Elisa Ricci , Barbara Caputo

Semantic segmentation usually benefits from global contexts, fine localisation information, multi-scale features, etc. To advance Transformer-based segmenters with these aspects, we present a simple yet powerful semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Lihua Fu , Haoyue Tian , Xiangping Bryce Zhai , Pan Gao , Xiaojiang Peng

Semantic segmentation has been widely investigated in the community, in which the state of the art techniques are based on supervised models. Those models have reported unprecedented performance at the cost of requiring a large set of high…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Rihuan Ke , Angelica Aviles-Rivero , Saurabh Pandey , Saikumar Reddy , Carola-Bibiane Schönlieb

Semantic segmentation of remotely sensed urban scene images is required in a wide range of practical applications, such as land cover mapping, urban change detection, environmental protection, and economic assessment.Driven by rapid…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Libo Wang , Rui Li , Ce Zhang , Shenghui Fang , Chenxi Duan , Xiaoliang Meng , Peter M. Atkinson

Point cloud understanding aims to acquire robust and general feature representations from unlabeled data. Masked point modeling-based methods have recently shown significant performance across various downstream tasks. These pre-training…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Yixin Zha , Chuxin Wang , Wenfei Yang , Tianzhu Zhang

Multi-task learning has proven to be effective in improving the performance of correlated tasks. Most of the existing methods use a backbone to extract initial features with independent branches for each task, and the exchange of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Diogo Nunes Goncalves , Jose Marcato Junior , Pedro Zamboni , Hemerson Pistori , Jonathan Li , Keiller Nogueira , Wesley Nunes Goncalves

Weakly supervised semantic segmentation (WSSS) must learn dense masks from noisy, under-specified cues. We revisit the SegFormer decoder and show that three small, synergistic changes make weak supervision markedly more effective-without…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Ali Torabi , Sanjog Gaihre , Yaqoob Majeed

Open-vocabulary semantic segmentation aims to segment an image into semantic regions according to text descriptions, which may not have been seen during training. Recent two-stage methods first generate class-agnostic mask proposals and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Feng Liang , Bichen Wu , Xiaoliang Dai , Kunpeng Li , Yinan Zhao , Hang Zhang , Peizhao Zhang , Peter Vajda , Diana Marculescu

The encoder-decoder framework is state-of-the-art for offline semantic image segmentation. Since the rise in autonomous systems, real-time computation is increasingly desirable. In this paper, we introduce fast segmentation convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-02-13 Rudra P K Poudel , Stephan Liwicki , Roberto Cipolla

Compression artifacts from standard video codecs often degrade perceptual quality. We propose a lightweight, semantic-aware pre-processing framework that enhances perceptual fidelity by selectively addressing these distortions. Our method…

Image and Video Processing · Electrical Eng. & Systems 2026-02-02 Han-Yu Lin , Li-Wei Chen , Hung-Shin Lee

Prior works have demonstrated that implicit representations trained only for reconstruction tasks typically generate encodings that are not useful for semantic tasks. In this work, we propose a method that contextualises the encodings of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Theo W. Costain , Kejie Li , Victor A. Prisacariu

We study the problem of improving the efficiency of segmentation transformers by using disparate amounts of computation for different parts of the image. Our method, PAUMER, accomplishes this by pausing computation for patches that are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Evann Courdier , Prabhu Teja Sivaprasad , François Fleuret

Masked image modeling (MIM) with transformer backbones has recently been exploited as a powerful self-supervised pre-training technique. The existing MIM methods adopt the strategy to mask random patches of the image and reconstruct the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Zhaohu Xing , Lei Zhu , Lequan Yu , Zhiheng Xing , Liang Wan

In this paper, we propose Suppression-Enhancing Mask based attention and Interactive Channel transformatiON (SEMICON) to learn binary hash codes for dealing with large-scale fine-grained image retrieval tasks. In SEMICON, we first develop a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Yang Shen , Xuhao Sun , Xiu-Shen Wei , Qing-Yuan Jiang , Jian Yang

The use of self-supervised pre-training has emerged as a promising approach to enhance the performance of many different visual tasks. In this context, recent approaches have employed the Masked Image Modeling paradigm, which pre-trains a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Lorenzo Baraldi , Roberto Amoroso , Marcella Cornia , Lorenzo Baraldi , Andrea Pilzer , Rita Cucchiara

Transformers, known for their attention mechanisms, have proven highly effective in focusing on critical elements within complex data. This feature can effectively be used to address the time-varying channels in wireless communication…

Machine Learning · Computer Science 2024-12-03 Matin Mortaheb , Mohammad A. Amir Khojastepour , Sennur Ulukus