English
Related papers

Related papers: Quantum Masked Autoencoders for Vision Learning

200 papers

Existing methods for learning 3D representations are deep neural networks trained and tested on classical hardware. Quantum machine learning architectures, despite their theoretically predicted advantages in terms of speed and the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Lakshika Rathi , Edith Tretschk , Christian Theobalt , Rishabh Dabral , Vladislav Golyanik

Vector-Quantized Variational Autoencoders (VQ-VAE)[1] provide an unsupervised model for learning discrete representations by combining vector quantization and autoencoders. In this paper, we study the use of VQ-VAE for representation…

Image and Video Processing · Electrical Eng. & Systems 2019-03-05 Hanwei Wu , Markus Flierl

Deep autoencoder has been extensively used for anomaly detection. Training on the normal data, the autoencoder is expected to produce higher reconstruction error for the abnormal inputs than the normal ones, which is adopted as a criterion…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Dong Gong , Lingqiao Liu , Vuong Le , Budhaditya Saha , Moussa Reda Mansour , Svetha Venkatesh , Anton van den Hengel

Quantum machine learning consists in taking advantage of quantum computations to generate classical data. A potential application of quantum machine learning is to harness the power of quantum computers for generating classical data, a…

Low-dose computed tomography (LDCT) reduces the X-ray radiation but compromises image quality with more noises and artifacts. A plethora of transformer models have been developed recently to improve LDCT image quality. However, the success…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Dayang Wang , Yongshun Xu , Shuo Han , Hengyong Yu

Masked Autoencoders (MAEs) have emerged as a dominant strategy for self-supervised representation learning in natural images, where models are pre-trained to reconstruct masked patches with a pixel-wise mean squared error (MSE) between…

Image and Video Processing · Electrical Eng. & Systems 2025-07-16 Chetan Madan , Aarjav Satia , Soumen Basu , Pankaj Gupta , Usha Dutta , Chetan Arora

We propose Masked Capsule Autoencoders (MCAE), the first Capsule Network that utilises pretraining in a modern self-supervised paradigm, specifically the masked image modelling framework. Capsule Networks have emerged as a powerful…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Miles Everett , Mingjun Zhong , Georgios Leontidis

We present a novel masked image modeling (MIM) approach, context autoencoder (CAE), for self-supervised representation pretraining. We pretrain an encoder by making predictions in the encoded representation space. The pretraining tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Xiaokang Chen , Mingyu Ding , Xiaodi Wang , Ying Xin , Shentong Mo , Yunhao Wang , Shumin Han , Ping Luo , Gang Zeng , Jingdong Wang

Masked Autoencoders (MAE) have been popular paradigms for large-scale vision representation pre-training. However, MAE solely reconstructs the low-level RGB signals after the decoder and lacks supervision upon high-level semantics for the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Peng Gao , Renrui Zhang , Rongyao Fang , Ziyi Lin , Hongyang Li , Hongsheng Li , Qiao Yu

Masked autoencoder (MAE) is a promising self-supervised pre-training technique that can improve the representation learning of a neural network without human intervention. However, applying MAE directly to volumetric medical images poses…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Jia-Xin Zhuang , Luyang Luo , Hao Chen

This paper explores improvements to the masked image modeling (MIM) paradigm. The MIM paradigm enables the model to learn the main object features of the image by masking the input image and predicting the masked part by the unmasked part.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Jiawei Mao , Xuesong Yin , Yuanqi Chang , Honggu Zhou

Anomaly Detection (AD) defines the task of identifying observations or events that deviate from typical - or normal - patterns, a critical capability in IT security for recognizing incidents such as system misconfigurations, malware…

Unsupervised multivariate time series (MTS) representation learning aims to extract compact and informative representations from raw sequences without relying on labels, enabling efficient transfer to diverse downstream tasks. In this…

Machine Learning · Computer Science 2025-09-22 Yi Xu , Yitian Zhang , Yun Fu

This research explores the integration of quantum data embedding techniques into classical machine learning (ML) algorithms, aiming to assess the performance enhancements and computational implications across a spectrum of models. We…

Quantum Physics · Physics 2023-11-20 Minati Rath , Hema Date

Masked autoencoder (MAE), a simple and effective self-supervised learning framework based on the reconstruction of masked image regions, has recently achieved prominent success in a variety of vision tasks. Despite the emergence of…

Machine Learning · Computer Science 2023-06-09 Lingjing Kong , Martin Q. Ma , Guangyi Chen , Eric P. Xing , Yuejie Chi , Louis-Philippe Morency , Kun Zhang

Masked image modeling (MIM) has been recognized as a strong self-supervised pre-training approach in the vision domain. However, the mechanism and properties of the learned representations by such a scheme, as well as how to further enhance…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Kevin Zhang , Zhiqiang Shen

Masked Autoencoders (MAEs) have emerged as a powerful pretraining technique for vision foundation models. Despite their effectiveness, they require extensive hyperparameter tuning (masking ratio, patch size, encoder/decoder layers) when…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Anthony Bisulco , Rahul Ramesh , Randall Balestriero , Pratik Chaudhari

Quantum machine learning (QML) shows promise for analyzing quantum data. A notable example is the use of quantum convolutional neural networks (QCNNs), implemented as specific types of quantum circuits, to recognize phases of matter. In…

Quantum Physics · Physics 2025-01-07 Chukwudubem Umeano , Annie E. Paine , Vincent E. Elfving , Oleksandr Kyriienko

Self-supervised models allow (pre-)training on unlabeled data and therefore have the potential to overcome the need for large annotated cohorts. One leading self-supervised model is the masked autoencoder (MAE) which was developed on…

Image and Video Processing · Electrical Eng. & Systems 2023-03-13 Daniel M. Lang , Eli Schwartz , Cosmin I. Bercea , Raja Giryes , Julia A. Schnabel

Federated learning is a specific distributed learning paradigm in which a central server aggregates updates from multiple clients' local models, thereby enabling the server to learn without requiring clients to upload their private data,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yuchen He , Xiangfeng Wang