English
Related papers

Related papers: Rethinking Decoders for Transformer-based Semantic…

200 papers

The recent vision transformer(i.e.for image classification) learns non-local attentive interaction of different patch tokens. However, prior arts miss learning the cross-scale dependencies of different pixels, the semantic correspondence of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Yuanfeng Ji , Ruimao Zhang , Huijie Wang , Zhen Li , Lingyun Wu , Shaoting Zhang , Ping Luo

We propose an end-to-end image compression and analysis model with Transformers, targeting to the cloud-based image classification application. Instead of placing an existing Transformer-based image classification model directly after an…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Yuanchao Bai , Xu Yang , Xianming Liu , Junjun Jiang , Yaowei Wang , Xiangyang Ji , Wen Gao

We present SegNeXt, a simple convolutional network architecture for semantic segmentation. Recent transformer-based models have dominated the field of semantic segmentation due to the efficiency of self-attention in encoding spatial…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Meng-Hao Guo , Cheng-Ze Lu , Qibin Hou , Zhengning Liu , Ming-Ming Cheng , Shi-Min Hu

Convolutional neural networks (CNNs) achieved the state-of-the-art performance in medical image segmentation due to their ability to extract highly complex feature representations. However, it is argued in recent studies that traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Zhendi Gong , Andrew P. French , Guoping Qiu , Xin Chen

Traditional transformer-based semantic segmentation relies on quantized embeddings. However, our analysis reveals that autoencoder accuracy on segmentation mask using quantized embeddings (e.g. VQ-VAE) is 8% lower than continuous-valued…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Masud Ahmed , Zahid Hasan , Syed Arefinul Haque , Abu Zaher Md Faridee , Sanjay Purushotham , Suya You , Nirmalya Roy

Semantic compression, a compression scheme where the distortion metric, typically MSE, is replaced with semantic fidelity metrics, tends to become more and more popular. Most recent semantic compression schemes rely on the foundation model…

Image and Video Processing · Electrical Eng. & Systems 2024-12-09 Tom Bachard , Thomas Maugey

We study semantic compression for text where meanings contained in the text are conveyed to a source decoder, e.g., for classification. The main motivator to move to such an approach of recovering the meaning without requiring exact…

Information Theory · Computer Science 2023-09-20 Emrecan Kutay , Aylin Yener

We propose a privacy-preserving semantic-segmentation method for applying perceptual encryption to images used for model training in addition to test images. This method also provides almost the same accuracy as models without any…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Homare Sueyoshi , Kiyoshi Nishikawa , Hitoshi Kiya

Experimental evidence indicates that simple models outperform complex deep networks on many unsupervised similarity tasks. We provide a simple yet rigorous explanation for this behaviour by introducing the concept of an optimal…

Artificial Intelligence · Computer Science 2018-05-10 Vitalii Zhelezniak , Dan Busbridge , April Shen , Samuel L. Smith , Nils Y. Hammerla

Although deep learning greatly improves the performance of semantic segmentation, its success mainly lies in object central areas without accurate edges. As superpixels are a popular and effective auxiliary to preserve object edges, in this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Zhiwei Xu , Thalaiyasingam Ajanthan , Richard Hartley

Weakly supervised semantic segmentation (WSSS) with only image-level supervision is a challenging task. Most existing methods exploit Class Activation Maps (CAM) to generate pixel-level pseudo labels for supervised training. However, due to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Ruiwen Li , Zheda Mai , Chiheb Trabelsi , Zhibo Zhang , Jongseong Jang , Scott Sanner

The hematology analytics used for detection and classification of small blood components is a significant challenge. In particular, when objects exists as small pixel-sized entities in a large context of similar objects. Deep learning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 H. Martin Gillis , Ming Hill , Paul Hollensen , Alan Fine , Thomas Trappenberg

Surface crack segmentation poses a challenging computer vision task as background, shape, colour and size of cracks vary. In this work we propose optimized deep encoder-decoder methods consisting of a combination of techniques which yield…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Jacob König , Mark Jenkins , Mike Mannion , Peter Barrie , Gordon Morison

Image Captioning, or the automatic generation of descriptions for images, is one of the core problems in Computer Vision and has seen considerable progress using Deep Learning Techniques. We propose to use Inception-ResNet Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Sulabh Katiyar , Samir Kumar Borgohain

The recent researches in Deep Convolutional Neural Network have focused their attention on improving accuracy that provide significant advances. However, if they were limited to classification tasks, nowadays with contributions from…

Computer Vision and Pattern Recognition · Computer Science 2017-11-16 Geraldin Nanfack , Azeddine Elhassouny , Rachid Oulad Haj Thami

Segmentation maps of medical images annotated by medical experts contain rich spatial information. In this paper, we propose to decompose annotation maps to learn disentangled and richer feature transforms for segmentation problems in…

Image and Video Processing · Electrical Eng. & Systems 2019-06-10 Yizhe Zhang , Michael T. C. Ying , Danny Z. Chen

Extracting dense representations for terms and phrases is a task of great importance for knowledge discovery platforms targeting highly-technical fields. Dense representations are used as features for downstream components and have multiple…

Computation and Language · Computer Science 2023-05-26 Francesco Fusco , Diego Antognini

The extraction of text in high quality is essential for text-based document analysis tasks like Document Classification or Named Entity Recognition. Unfortunately, this is not always ensured, as poor scan quality and the resulting artifacts…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 David Kreuzer , Michael Munz

It is well believed that Transformer performs better in semantic segmentation compared to convolutional neural networks. Nevertheless, the original Vision Transformer may lack of inductive biases of local neighborhoods and possess a high…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Wentao Shi , Jing Xu , Pan Gao

Camera sensors have been widely used in intelligent robotic systems. Developing camera sensors with high sensing efficiency has always been important to reduce the power, memory, and other related resources. Inspired by recent success on…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Bowen Zhang , Zhijin Qin , Geoffrey Ye Li