English
Related papers

Related papers: Transformer based Pluralistic Image Completion wit…

200 papers

Generative Adversarial Network (GAN) inversion have demonstrated excellent performance in image inpainting that aims to restore lost or damaged image texture using its unmasked content. Previous GAN inversion-based methods usually utilize…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Libo Zhang , Yongsheng Yu , Jiali Yao , Heng Fan

Vector quantised variational autoencoders (VQ-VAE) are characterised by three main components: 1) encoding visual data, 2) assigning $k$ different vectors in the so-called embedding space, and 3) decoding the learnt features. While images…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Arash Akbarinia , Raquel Gil-Rodríguez , Alban Flachot , Matteo Toscani

The Transformer architecture has achieved significant success in natural language processing, motivating its adaptation to computer vision tasks. Unlike convolutional neural networks, vision transformers inherently capture long-range…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Zherui Zhang , Rongtao Xu , Jie Zhou , Changwei Wang , Xingtian Pei , Wenhao Xu , Jiguang Zhang , Li Guo , Longxiang Gao , Wenbo Xu , Shibiao Xu

Image demoir\'eing remains a challenging task due to the complex interplay between texture corruption and color distortions caused by moir\'e patterns. Existing methods, especially those relying on direct image-to-image restoration, often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Xiaoyang Liu , Bolin Qiu , Jiezhang Cao , Zheng Chen , Yulun Zhang , Xiaokang Yang

Blind Image Quality Assessment (BIQA) is a fundamental task in computer vision, which however remains unresolved due to the complex distortion conditions and diversified image contents. To confront this challenge, we in this paper propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Guanyi Qin , Runze Hu , Yutao Liu , Xiawu Zheng , Haotian Liu , Xiu Li , Yan Zhang

Transformer-based entropy models have gained prominence in recent years due to their superior ability to capture long-range dependencies in probability distribution estimation compared to convolution-based methods. However, previous…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Daxin Li , Yuanchao Bai , Kai Wang , Junjun Jiang , Xianming Liu , Wen Gao

Text-to-image personalization aims to teach a pre-trained diffusion model to reason about novel, user provided concepts, embedding them into new scenes guided by natural language prompts. However, current personalization approaches struggle…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Rinon Gal , Moab Arar , Yuval Atzmon , Amit H. Bermano , Gal Chechik , Daniel Cohen-Or

Vision Transformers are at the heart of the current surge of interest in foundation models for histopathology. They process images by breaking them into smaller patches following a regular grid, regardless of their content. Yet, not all…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Clément Grisi , Geert Litjens , Jeroen van der Laak

Current image-to-image translation methods formulate the task with conditional generation models, leading to learning only the recolorization or regional changes as being constrained by the rich structural information provided by the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Yu-Jie Chen , Shin-I Cheng , Wei-Chen Chiu , Hung-Yu Tseng , Hsin-Ying Lee

Transformer, as a strong and flexible architecture for modelling long-range relations, has been widely explored in vision tasks. However, when used in video inpainting that requires fine-grained representation, existed method still suffers…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Rui Liu , Hanming Deng , Yangyi Huang , Xiaoyu Shi , Lewei Lu , Wenxiu Sun , Xiaogang Wang , Jifeng Dai , Hongsheng Li

With the achievements of Transformer in the field of natural language processing, the encoder-decoder and the attention mechanism in Transformer have been applied to computer vision. Recently, in multiple tasks of computer vision (image…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Rui-Yang Ju , Ting-Yu Lin , Jen-Shiun Chiang , Jia-Hao Jian , Yu-Shian Lin , Liu-Rui-Yi Huang

The perturbation test remains the go-to evaluation approach for explanation methods in computer vision. This evaluation method has a major drawback of test-time distribution shift due to pixel-masking that is not present in the training…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Lokesh Badisa , Sumohana S. Channappayya

While Transformer has achieved remarkable performance in various high-level vision tasks, it is still challenging to exploit the full potential of Transformer in image restoration. The crux lies in the limited depth of applying Transformer…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Haobo Ji , Xin Feng , Wenjie Pei , Jinxing Li , Guangming Lu

Compressive imaging is an emerging application of compressed sensing, devoted to acquisition, encoding and reconstruction of images using random projections as measurements. In this paper we propose a novel method to provide a scalable…

Information Theory · Computer Science 2013-10-07 Diego Valsesia , Enrico Magli

Blind face restoration is a challenging task due to the unknown and complex degradation. Although face prior-based methods and reference-based methods have recently demonstrated high-quality results, the restored images tend to contain…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Guojing Ge , Qi Song , Guibo Zhu , Yuting Zhang , Jinglu Chen , Miao Xin , Ming Tang , Jinqiao Wang

Image restoration aims to recover the high-quality images from their degraded observations. Since most existing methods have been dedicated into single degradation removal, they may not yield optimal results on other types of degradations,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Hu Gao , Depeng Dang

Recently, unsupervised exemplar-based image-to-image translation, conditioned on a given exemplar without the paired data, has accomplished substantial advancements. In order to transfer the information from an exemplar to an input image,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Wonwoong Cho , Sungha Choi , David Keetae Park , Inkyu Shin , Jaegul Choo

Transformer-based methods have achieved remarkable results in image super-resolution tasks because they can capture non-local dependencies in low-quality input images. However, this feature-intensive modeling approach is computationally…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Wei Long , Xingyu Zhou , Leheng Zhang , Shuhang Gu

In generative modeling, tokenization simplifies complex data into compact, structured representations, creating a more efficient, learnable space. For high-dimensional visual data, it reduces redundancy and emphasizes key features for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Long Zhao , Sanghyun Woo , Ziyu Wan , Yandong Li , Han Zhang , Boqing Gong , Hartwig Adam , Xuhui Jia , Ting Liu

Following the major successes of self-attention and Transformers for image analysis, we investigate the use of such attention mechanisms in the context of Image Quality Assessment (IQA) and propose a novel full-reference IQA method, Vision…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Andrei Chubarau , James Clark