中文
相关论文

相关论文: Transformer for Image Quality Assessment

200 篇论文

Transformers have been recently adapted for large scale image classification, achieving high scores shaking up the long supremacy of convolutional neural networks. However the optimization of image transformers has been little studied so…

计算机视觉与模式识别 · 计算机科学 2021-04-08 Hugo Touvron , Matthieu Cord , Alexandre Sablayrolles , Gabriel Synnaeve , Hervé Jégou

Image-text matching is an interesting and fascinating task in modern AI research. Despite the evolution of deep-learning-based image and text processing systems, multi-modal matching remains a challenging problem. In this work, we consider…

计算机视觉与模式识别 · 计算机科学 2021-01-27 Nicola Messina , Fabrizio Falchi , Andrea Esuli , Giuseppe Amato

The recently developed vision transformer (ViT) has achieved promising results on image classification compared to convolutional neural networks. Inspired by this, in this paper, we study how to learn multi-scale feature representations in…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Chun-Fu Chen , Quanfu Fan , Rameswar Panda

While Transformer has achieved remarkable performance in various high-level vision tasks, it is still challenging to exploit the full potential of Transformer in image restoration. The crux lies in the limited depth of applying Transformer…

计算机视觉与模式识别 · 计算机科学 2021-12-09 Haobo Ji , Xin Feng , Wenjie Pei , Jinxing Li , Guangming Lu

Fine-grained visual classification (FGVC) which aims at recognizing objects from subcategories is a very challenging task due to the inherently subtle inter-class differences. Most existing works mainly tackle this problem by reusing the…

计算机视觉与模式识别 · 计算机科学 2021-12-03 Ju He , Jie-Neng Chen , Shuai Liu , Adam Kortylewski , Cheng Yang , Yutong Bai , Changhu Wang

Motivated by the efficiency investigation of the Tranformer-based transform coding framework, namely SwinT-ChARM, we propose to enhance the latter, as first, with a more straightforward yet effective Tranformer-based channel-wise…

计算机视觉与模式识别 · 计算机科学 2023-07-13 Ahmed Ghorbel , Wassim Hamidouche , Luce Morin

Transformers have become the dominant architecture for sequence modeling tasks such as natural language processing or audio processing, and they are now even considered for tasks that are not naturally sequential such as image…

机器学习 · 计算机科学 2024-03-05 Jorg Bornschein , Yazhe Li , Amal Rannen-Triki

Transformer-based methods have shown impressive performance in low-level vision tasks, such as image super-resolution. However, we find that these networks can only utilize a limited spatial range of input information through attribution…

图像与视频处理 · 电气工程与系统科学 2023-03-21 Xiangyu Chen , Xintao Wang , Jiantao Zhou , Yu Qiao , Chao Dong

Recently, Transformers have gained significant popularity in image restoration tasks such as image super-resolution and denoising, owing to their superior performance. However, balancing performance and computational burden remains a…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Leheng Zhang , Wei Long , Yawei Li , Xingyu Zhou , Xiaorui Zhao , Shuhang Gu

In recent computer vision research, the advent of the Vision Transformer (ViT) has rapidly revolutionized various architectural design efforts: ViT achieved state-of-the-art image classification performance using self-attention found in…

计算机视觉与模式识别 · 计算机科学 2023-01-13 Yuki Tatsunami , Masato Taki

In this paper, we present a hybrid X-shaped vision Transformer, named Xformer, which performs notably on image denoising tasks. We explore strengthening the global representation of tokens from different scopes. In detail, we adopt two…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Jiale Zhang , Yulun Zhang , Jinjin Gu , Jiahua Dong , Linghe Kong , Xiaokang Yang

Document image enhancement is a fundamental and important stage for attaining the best performance in any document analysis assignment because there are many degradation situations that could harm document images, making it more difficult…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Risab Biswas , Swalpa Kumar Roy , Umapada Pal

Fine-grained image recognition is challenging because discriminative clues are usually fragmented, whether from a single image or multiple images. Despite their significant improvements, most existing methods still focus on the most…

多媒体 · 计算机科学 2022-06-07 Xinda Liu , Lili Wang , Xiaoguang Han

Recently many works attempt to develop image compression models based on deep learning architectures, where the uniform scalar quantizer (SQ) is commonly applied to the feature maps between the encoder and decoder. In this paper, we propose…

图像与视频处理 · 电气工程与系统科学 2020-01-28 Binglin Li , Mohammad Akbari , Jie Liang , Yang Wang

Currently, vision encoder models like Vision Transformers (ViTs) typically excel at image recognition tasks but cannot simultaneously support text recognition like human visual recognition. To address this limitation, we propose UNIT, a…

计算机视觉与模式识别 · 计算机科学 2024-09-09 Yi Zhu , Yanpeng Zhou , Chunwei Wang , Yang Cao , Jianhua Han , Lu Hou , Hang Xu

In this paper, we propose a privacy-preserving image classification method that is based on the combined use of encrypted images and the vision transformer (ViT). The proposed method allows us not only to apply images without visual…

计算机视觉与模式识别 · 计算机科学 2022-05-25 Zheng Qi , AprilPyone MaungMaung , Yuma Kinoshita , Hitoshi Kiya

Image fusion is a technique to integrate information from multiple source images with complementary information to improve the richness of a single image. Due to insufficient task-specific training data and corresponding ground truth, most…

计算机视觉与模式识别 · 计算机科学 2022-01-20 Linhao Qu , Shaolei Liu , Manning Wang , Shiman Li , Siqi Yin , Qin Qiao , Zhijian Song

The extraction of a scene graph with objects as nodes and mutual relationships as edges is the basis for a deep understanding of image content. Despite recent advances, such as message passing and joint classification, the detection of…

计算机视觉与模式识别 · 计算机科学 2021-07-22 Rajat Koner , Suprosanna Shit , Volker Tresp

In image fusion, images obtained from different sensors are fused to generate a single image with enhanced information. In recent years, state-of-the-art methods have adopted Convolution Neural Networks (CNNs) to encode meaningful features…

计算机视觉与模式识别 · 计算机科学 2022-12-06 Vibashan VS , Jeya Maria Jose Valanarasu , Poojan Oza , Vishal M. Patel

Visual (image, video) quality assessments can be modelled by visual features in different domains, e.g., spatial, frequency, and temporal domains. Perceptual mechanisms in the human visual system (HVS) play a crucial role in generation of…

图像与视频处理 · 电气工程与系统科学 2022-08-23 Junyong You , Zheng Zhang