English
Related papers

Related papers: Transformer based Pluralistic Image Completion wit…

200 papers

Vectorized quantum block encoding provides a way to embed classical data into Hilbert space, offering a pathway for quantum models, such as Quantum Transformers (QT), that replace classical self-attention with quantum circuit simulations to…

Quantum Physics · Physics 2025-09-05 Ziqing Guo , Ziwen Pan , Alex Khan , Jan Balewski

We consider the problem of image representation for the tasks of unsupervised learning and semi-supervised learning. In those learning tasks, the raw image vectors may not provide enough representation for their intrinsic structures due to…

Machine Learning · Computer Science 2014-02-20 Yiyi Liao , Yue Wang , Yong Liu

We present a new encoder-decoder Vision Transformer architecture, Patcher, for medical image segmentation. Unlike standard Vision Transformers, it employs Patcher blocks that segment an image into large patches, each of which is further…

Image and Video Processing · Electrical Eng. & Systems 2023-05-31 Yanglan Ou , Ye Yuan , Xiaolei Huang , Stephen T. C. Wong , John Volpi , James Z. Wang , Kelvin Wong

The Transformer architecture has witnessed a rapid development in recent years, outperforming the CNN architectures in many computer vision tasks, as exemplified by the Vision Transformers (ViT) for image classification. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Yu Fu , TianYang Xu , XiaoJun Wu , Josef Kittler

PICNet pioneered the generation of multiple and diverse results for image completion task, but it required a careful balance between $\mathcal{KL}$ loss (diversity) and reconstruction loss (quality), resulting in a limited diversity and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Chuanxia Zheng , Guoxian Song , Tat-Jen Cham , Jianfei Cai , Dinh Phung , Linjie Luo

Image inpainting is the task of plausibly restoring missing pixels within a hole region that is to be removed from a target image. Most existing technologies exploit patch similarities within the image, or leverage large-scale training data…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Yuqian Zhou , Connelly Barnes , Eli Shechtman , Sohrab Amirghodsi

Pluralistic Image Inpainting (PII) offers multiple plausible solutions for restoring missing parts of images and has been successfully applied to various applications including image editing and object removal. Recently, VQGAN-based methods…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Kyungri Park , Woohwan Jung

Transformers, known for their attention mechanisms, have proven highly effective in focusing on critical elements within complex data. This feature can effectively be used to address the time-varying channels in wireless communication…

Machine Learning · Computer Science 2024-12-03 Matin Mortaheb , Mohammad A. Amir Khojastepour , Sennur Ulukus

Transformer is a new kind of neural architecture which encodes the input data as powerful features via the attention mechanism. Basically, the visual transformers first divide the input images into several local patches and then calculate…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Kai Han , An Xiao , Enhua Wu , Jianyuan Guo , Chunjing Xu , Yunhe Wang

Despite the limited availability and quantum volume of quantum computers, quantum image representation is a widely researched area. Currently developed methods use quantum entanglement to encode information about pixel positions. These…

Quantum Physics · Physics 2023-11-09 Krzysztof Werner , Kamil Wereszczyński , Rafał Potempa , Krzysztof Cyran

Variational Convertor-Encoder (VCE) converts an image to various styles; we present this novel architecture for the problem of one-shot generalization and its transfer to new tasks not seen before without additional training. We also…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Chengshuai Li , Shuai Han , Jianping Xing

Image outpainting, which is well studied with Convolution Neural Network (CNN) based framework, has recently drawn more attention in computer vision. However, CNNs rely on inherent inductive biases to achieve effective sample learning,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Kai Yao , Penglei Gao , Xi Yang , Kaizhu Huang , Jie Sun , Rui Zhang

Graph-structured scene descriptions can be efficiently used in generative models to control the composition of the generated image. Previous approaches are based on the combination of graph convolutional networks and adversarial methods for…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Renato Sortino , Simone Palazzo , Concetto Spampinato

We propose an end-to-end image compression and analysis model with Transformers, targeting to the cloud-based image classification application. Instead of placing an existing Transformer-based image classification model directly after an…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Yuanchao Bai , Xu Yang , Xianming Liu , Junjun Jiang , Yaowei Wang , Xiangyang Ji , Wen Gao

Humans can often count unfamiliar objects by observing visual repetition and composition, rather than relying only on object categories. However, many exemplar-free counting models struggle in such situations and may overcount when objects…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Md Tanvir Hossain , Akif Islam , Mohd Ruhul Ameen

Integration of diverse visual prompts like clicks, scribbles, and boxes in interactive image segmentation significantly facilitates users' interaction as well as improves interaction efficiency. However, existing studies primarily encode…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Xu Zhang , Kailun Yang , Jiacheng Lin , Jin Yuan , Zhiyong Li , Shutao Li

Variational autoencoders (VAEs) are fundamental for generative modeling and image reconstruction, yet their performance often struggles to maintain high fidelity in reconstructions. This study introduces a hybrid model, quantum variational…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Farina Riaz , Fakhar Zaman , Hajime Suzuki , Sharif Abuadbba , David Nguyen

Transformers, a groundbreaking architecture proposed for Natural Language Processing (NLP), have also achieved remarkable success in Computer Vision. A cornerstone of their success lies in the attention mechanism, which models relationships…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jaihyun Lew , Soohyuk Jang , Jaehoon Lee , Seungryong Yoo , Eunji Kim , Saehyung Lee , Jisoo Mok , Siwon Kim , Sungroh Yoon

Transformer-based models have achieved remarkable results in low-level vision tasks including image super-resolution (SR). However, early Transformer-based approaches that rely on self-attention within non-overlapping windows encounter…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Cansu Korkmaz , A. Murat Tekalp

In this paper, we propose an image quality transformer (IQT) that successfully applies a transformer architecture to a perceptual full-reference image quality assessment (IQA) task. Perceptual representation becomes more important in image…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Manri Cheon , Sung-Jun Yoon , Byungyeon Kang , Junwoo Lee