English
Related papers

Related papers: VT-Former: Efffcient Transformer-based Decoder for…

200 papers

One critical component in lossy deep image compression is the entropy model, which predicts the probability distribution of the quantized latent representation in the encoding and decoding modules. Previous works build entropy models upon…

Image and Video Processing · Electrical Eng. & Systems 2023-03-16 Yichen Qian , Ming Lin , Xiuyu Sun , Zhiyu Tan , Rong Jin

Vision Transformers (ViT) have achieved remarkable success in large-scale image recognition. They split every 2D image into a fixed number of patches, each of which is treated as a token. Generally, representing an image with more tokens…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Yulin Wang , Rui Huang , Shiji Song , Zeyi Huang , Gao Huang

Error correction codes are an integral part of communication applications, boosting the reliability of transmission. The optimal decoding of transmitted codewords is the maximum likelihood rule, which is NP-hard due to the curse of…

Information Theory · Computer Science 2021-02-22 Nir Raviv , Avi Caciularu , Tomer Raviv , Jacob Goldberger , Yair Be'ery

Deep learning-based image compression has made great progresses recently. However, many leading schemes use serial context-adaptive entropy model to improve the rate-distortion (R-D) performance, which is very slow. In addition, the…

Image and Video Processing · Electrical Eng. & Systems 2023-09-07 Haisheng Fu , Feng Liang , Jie Liang , Yongqiang Wang , Guohe Zhang , Jingning Han

This paper studies 3D low-dose computed tomography (CT) imaging. Although various deep learning methods were developed in this context, typically they focus on 2D images and perform denoising due to low-dose and deblurring for…

Image and Video Processing · Electrical Eng. & Systems 2024-01-10 Zhihao Chen , Chuang Niu , Qi Gao , Ge Wang , Hongming Shan

This paper analyzes the design and competitiveness of four neural network (NN) architectures recently proposed as decoders for forward error correction (FEC) codes. We first consider the so-called single-label neural network (SLNN) and the…

Signal Processing · Electrical Eng. & Systems 2026-01-28 Yuncheng Yuan , Péter Scheepers , Lydia Tasiou , Yunus Can Gültekin , Federico Corradi , Alex Alvarado

We present a novel usage of Transformers to make image classification interpretable. Unlike mainstream classifiers that wait until the last fully connected layer to incorporate class information to make predictions, we investigate a…

Variable count is among the main scalability bottlenecks for transformer modeling in multivariate time series (MTS) data. On top of this, a growing consensus in the field points to indiscriminate inter-variable mixing as a potential source…

Machine Learning · Computer Science 2025-09-25 Hunjae Lee , Corey Clark

With the development of Internet of Things (IoT) systems, precise long-term forecasting method is requisite for decision makers to evaluate current statuses and formulate future policies. Currently, Transformer and MLP are two paradigms for…

Machine Learning · Computer Science 2023-12-12 Li Shen , Yuning Wei , Yangzhu Wang , Hongguang Li

Transformers, the de-facto standard for language modeling, have been recently applied for vision tasks. This paper introduces sparse queries for vision transformers to exploit the intrinsic spatial redundancy of natural images and save…

Computer Vision and Pattern Recognition · Computer Science 2023-01-11 Lin Song , Songyang Zhang , Songtao Liu , Zeming Li , Xuming He , Hongbin Sun , Jian Sun , Nanning Zheng

Recent advancements in learning-based Multi-View Stereo (MVS) methods have prominently featured transformer-based models with attention mechanisms. However, existing approaches have not thoroughly investigated the profound influence of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Chenjie Cao , Xinlin Ren , Yanwei Fu

Viterbi Algorithm Decoder Enhanced with Non-transmittable Codewords is one of the best decoding algorithm which effectively improves forward error correction performance. HoweverViterbi decoder enhanced with NTCs is not yet designed to work…

Information Theory · Computer Science 2017-03-31 Kilavo Hassan , Kisangiri Michael , Salehe I. Mrutu

Vision Transformer (ViT) is emerging as the state-of-the-art architecture for image recognition. While recent studies suggest that ViTs are more robust than their convolutional counterparts, our experiments find that ViTs trained on…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Chengzhi Mao , Lu Jiang , Mostafa Dehghani , Carl Vondrick , Rahul Sukthankar , Irfan Essa

Learned video compression (LVC) has witnessed remarkable advancements in recent years. Similar as the traditional video coding, LVC inherits motion estimation/compensation, residual coding and other modules, all of which are implemented…

Image and Video Processing · Electrical Eng. & Systems 2023-09-22 Yanbo Gao , Wenjia Huang , Shuai Li , Hui Yuan , Mao Ye , Siwei Ma

Transformers have been widely used in numerous vision problems especially for visual recognition and detection. Detection transformers are the first fully end-to-end learning systems for object detection, while vision transformers are the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Hwanjun Song , Deqing Sun , Sanghyuk Chun , Varun Jampani , Dongyoon Han , Byeongho Heo , Wonjae Kim , Ming-Hsuan Yang

End-to-end text spotting is a vital computer vision task that aims to integrate scene text detection and recognition into a unified framework. Typical methods heavily rely on Region-of-Interest (RoI) operations to extract local features and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Yukun Zhai , Xiaoqiang Zhang , Xiameng Qin , Sanyuan Zhao , Xingping Dong , Jianbing Shen

A latent-variable model is introduced for text matching, inferring sentence representations by jointly optimizing generative and discriminative objectives. To alleviate typical optimization challenges in latent-variable models for text, we…

Computation and Language · Computer Science 2017-11-23 Dinghan Shen , Yizhe Zhang , Ricardo Henao , Qinliang Su , Lawrence Carin

Visual place recognition (VPR) aims to determine the general geographical location of a query image by retrieving visually similar images from a large geo-tagged database. To obtain a global representation for each place image, most…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Tong Jin , Feng Lu , Shuyu Hu , Chun Yuan , Yunpeng Liu

Data-driven deep learning approaches to image registration can be less accurate than conventional iterative approaches, especially when training data is limited. To address this whilst retaining the fast inference speed of deep learning, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Xi Jia , Alexander Thorley , Wei Chen , Huaqi Qiu , Linlin Shen , Iain B Styles , Hyung Jin Chang , Ales Leonardis , Antonio de Marvao , Declan P. O'Regan , Daniel Rueckert , Jinming Duan

In this paper, we present a neat yet effective transformer-based framework for visual grounding, namely TransVG, to address the task of grounding a language query to the corresponding region onto an image. The state-of-the-art methods,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Jiajun Deng , Zhengyuan Yang , Tianlang Chen , Wengang Zhou , Houqiang Li