English
Related papers

Related papers: Convolutional Transformer-Based Image Compression

200 papers

Convolutional neural networks (CNNs) have achieved state-of-the-art results on many visual recognition tasks. However, current CNN models still exhibit a poor ability to be invariant to spatial transformations of images. Intuitively, with…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Xu Shen , Xinmei Tian , Anfeng He , Shaoyan Sun , Dacheng Tao

In this paper, we consider the image captioning task from a new sequence-to-sequence prediction perspective and propose CaPtion TransformeR (CPTR) which takes the sequentialized raw images as the input to Transformer. Compared to the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Wei Liu , Sihan Chen , Longteng Guo , Xinxin Zhu , Jing Liu

In image fusion, images obtained from different sensors are fused to generate a single image with enhanced information. In recent years, state-of-the-art methods have adopted Convolution Neural Networks (CNNs) to encode meaningful features…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Vibashan VS , Jeya Maria Jose Valanarasu , Poojan Oza , Vishal M. Patel

We propose DepthTCM, a physics-aware end-to-end framework for depth map compression. In our framework of DepthTCM, the high-bit depth map is first converted to a conventional 3-channel image representation losslessly using a method inspired…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Young-Seo Chang , Yatong An , Jae-Sang Hyun

Lossy image compression is generally formulated as a joint rate-distortion optimization to learn encoder, quantizer, and decoder. However, the quantizer is non-differentiable, and discrete entropy estimation usually is required for rate…

Computer Vision and Pattern Recognition · Computer Science 2017-09-20 Mu Li , Wangmeng Zuo , Shuhang Gu , Debin Zhao , David Zhang

In recent developments in the field of Computer Vision, a rise is seen in the use of transformer-based architectures. They are surpassing the state-of-the-art set by CNN architectures in accuracy but on the other hand, they are…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Durvesh Malpure , Onkar Litake , Rajesh Ingle

Transformer plays an increasingly important role in various computer vision areas and remarkable achievements have also been made in point cloud analysis. Since they mainly focus on point-wise transformer, an adaptive channel encoding…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Guoquan Xu , Hezhi Cao , Yifan Zhang , Yanxin Ma , Jianwei Wan , Ke Xu

Ground-to-aerial geolocalization refers to localizing a ground-level query image by matching it to a reference database of geo-tagged aerial imagery. This is very challenging due to the huge perspective differences in visual appearances and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Teng Wang , Shujuan Fan , Daikun Liu , Changyin Sun

Benefiting from powerful convolutional neural networks (CNNs), learning-based image inpainting methods have made significant breakthroughs over the years. However, some nature of CNNs (e.g. local prior, spatially shared parameters) limit…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Ye Deng , Siqi Hui , Sanping Zhou , Deyu Meng , Jinjun Wang

Motivated by the success of Transformers in natural language processing (NLP) tasks, there emerge some attempts (e.g., ViT and DeiT) to apply Transformers to the vision domain. However, pure Transformer architectures often require a large…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Kun Yuan , Shaopeng Guo , Ziwei Liu , Aojun Zhou , Fengwei Yu , Wei Wu

Convolutional neural networks show outstanding results in a variety of computer vision tasks. However, a neural network architecture design usually faces a trade-off between model performance and computational/memory complexity. For some…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Pavel Kaloshin

Convolutional Neural Networks (CNNs) are known for requiring extensive computational resources, and quantization is among the best and most common methods for compressing them. While aggressive quantization (i.e., less than 4-bits) performs…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Shahaf E. Finder , Yair Zohav , Maor Ashkenazi , Eran Treister

An increasing share of captured images and videos are transmitted for storage and remote analysis by computer vision algorithms, rather than to be viewed by humans. Contrary to traditional standard codecs with engineered tools, neural…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Lahiru D. Chamain , Fabien Racapé , Jean Bégaint , Akshay Pushparaja , Simon Feltman

Image inpainting has made significant advances in recent years. However, it is still challenging to recover corrupted images with both vivid textures and reasonable structures. Some specific methods only tackle regular textures while losing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Qiaole Dong , Chenjie Cao , Yanwei Fu

Surface defect detection is an extremely crucial step to ensure the quality of industrial products. Nowadays, convolutional neural networks (CNNs) based on encoder-decoder architecture have achieved tremendous success in various defect…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Junpu Wang , Guili Xu , Fuju Yan , Jinjin Wang , Zhengsheng Wang

The remarkable performance of the Transformer architecture in natural language processing has recently also triggered broad interest in Computer Vision. Among other merits, Transformers are witnessed as capable of learning long-range…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Reza Azad , Amirhossein Kazerouni , Moein Heidari , Ehsan Khodapanah Aghdam , Amirali Molaei , Yiwei Jia , Abin Jose , Rijo Roy , Dorit Merhof

Hyperspectral image has become increasingly crucial due to its abundant spectral information. However, It has poor spatial resolution with the limitation of the current imaging mechanism. Nowadays, many convolutional neural networks have…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Jin-Fan Hu , Ting-Zhu Huang , Liang-Jian Deng

Efficient point cloud compression is fundamental to enable the deployment of virtual and mixed reality applications, since the number of points to code can range in the order of millions. In this paper, we present a novel data-driven…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Maurice Quach , Giuseppe Valenzise , Frederic Dufaux

In this paper, we present Uformer, an effective and efficient Transformer-based architecture for image restoration, in which we build a hierarchical encoder-decoder network using the Transformer block. In Uformer, there are two core…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Zhendong Wang , Xiaodong Cun , Jianmin Bao , Wengang Zhou , Jianzhuang Liu , Houqiang Li

Depth completion aims to predict dense depth maps with sparse depth measurements from a depth sensor. Currently, Convolutional Neural Network (CNN) based models are the most popular methods applied to depth completion tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Jian Qian , Miao Sun , Ashley Lee , Jie Li , Shenglong Zhuo , Patrick Yin Chiang