English
Related papers

Related papers: Patch-aware Vector Quantized Codebook Learning for…

200 papers

Variational autoencoders (VAEs) are a popular class of deep generative models with many variants and a wide range of applications. Improvements upon the standard VAE mostly focus on the modelling of the posterior distribution over the…

Machine Learning · Computer Science 2022-11-02 James Langley , Miguel Monteiro , Charles Jones , Nick Pawlowski , Ben Glocker

Learning interpretable representations of data remains a central challenge in deep learning. When training a deep generative model, the observed data are often associated with certain categorical labels, and, in parallel with learning to…

Machine Learning · Computer Science 2019-10-01 Yifan Xue , Michael Ding , Xinghua Lu

Semi-supervised learning is attracting increasing attention due to the fact that datasets of many domains lack enough labeled data. Variational Auto-Encoder (VAE), in particular, has demonstrated the benefits of semi-supervised learning.…

Machine Learning · Computer Science 2018-12-04 Yang Li , Quan Pan , Suhang Wang , Haiyun Peng , Tao Yang , Erik Cambria

In this paper, we address the problem of image anomaly detection and segmentation. Anomaly detection involves making a binary decision as to whether an input image contains an anomaly, and anomaly segmentation aims to locate the anomaly on…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jihun Yi , Sungroh Yoon

We propose an out-of-distribution detection method that combines density and restoration-based approaches using Vector-Quantized Variational Auto-Encoders (VQ-VAEs). The VQ-VAE model learns to encode images in a categorical latent space.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Sergio Naval Marimont , Giacomo Tarroni

Unsupervised anomaly detection and localization, as of one the most practical and challenging problems in computer vision, has received great attention in recent years. From the time the MVTec AD dataset was proposed to the present, new…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Ye Zheng , Xiang Wang , Yu Qi , Wei Li , Liwei Wu

Uncovering emergent concepts across transformer layers remains a significant challenge because the residual stream linearly mixes and duplicates information, obscuring how features evolve within large language models. Current research…

Machine Learning · Computer Science 2025-07-18 Ankur Garg , Xuemin Yu , Hassan Sajjad , Samira Ebrahimi Kahou

In quantised autoencoders, images are usually split into local patches, each encoded by one token. This representation is redundant in the sense that the same number of tokens is spend per region, regardless of the visual information…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Tim Elsner , Paula Usinger , Victor Czech , Gregor Kobsik , Yanjiang He , Isaak Lim , Leif Kobbelt

This paper aims to conduct a comparative analysis of contemporary Variational Autoencoder (VAE) architectures employed in anomaly detection, elucidating their performance and behavioral characteristics within this specific task. The…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Huy Hoang Nguyen , Cuong Nhat Nguyen , Xuan Tung Dao , Quoc Trung Duong , Dzung Pham Thi Kim , Minh-Tan Pham

Contrastive self-supervised learning has emerged as a promising approach to unsupervised visual representation learning. In general, these methods learn global (image-level) representations that are invariant to different views (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Pedro O. Pinheiro , Amjad Almahairi , Ryan Y. Benmalek , Florian Golemo , Aaron Courville

Video anomaly detection (VAD) plays a critical role in public safety applications such as intelligent surveillance. However, the rarity, unpredictability, and high annotation cost of real-world anomalies make it difficult to scale VAD…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Suhang Cai , Xiaohao Peng , Chong Wang , Xiaojie Cai , Jiangbo Qian

Video Anomaly Detection (VAD), aiming to identify abnormalities within a specific context and timeframe, is crucial for intelligent Video Surveillance Systems. While recent deep learning-based VAD models have shown promising results by…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Hao Shen , Lu Shi , Wanru Xu , Yigang Cen , Linna Zhang , Gaoyun An

As emerging hardware begins to support mixed bit-width arithmetic computation, mixed-precision quantization is widely used to reduce the complexity of neural networks. However, Vision Transformers (ViTs) require complex self-attention…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Junrui Xiao , Zhikai Li , Lianwei Yang , Qingyi Gu

Unsupervised pre-training aims at learning transferable features that are beneficial for downstream tasks. However, most state-of-the-art unsupervised methods concentrate on learning global representations for image-level classification…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Jian Ding , Enze Xie , Hang Xu , Chenhan Jiang , Zhenguo Li , Ping Luo , Gui-Song Xia

Wastewater-based genomic surveillance has emerged as a powerful tool for population-level viral monitoring, offering comprehensive insights into circulating viral variants across entire communities. However, this approach faces significant…

Machine Learning · Computer Science 2025-12-04 Adele Chinda , Richmond Azumah , Hemanth Demakethepalli Venkateswara

Variational Auto-Encoders have often been used for unsupervised pretraining, feature extraction and out-of-distribution and anomaly detection in the medical field. However, VAEs often lack the ability to produce sharp images and learn…

Machine Learning · Computer Science 2019-11-28 David Zimmerer , Jens Petersen , Klaus Maier-Hein

Human observers can learn to recognize new categories of images from a handful of examples, yet doing so with artificial ones remains an open challenge. We hypothesize that data-efficient recognition is enabled by representations which make…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Olivier J. Hénaff , Aravind Srinivas , Jeffrey De Fauw , Ali Razavi , Carl Doersch , S. M. Ali Eslami , Aaron van den Oord

Deep generative models have been demonstrated as problematic in the unsupervised out-of-distribution (OOD) detection task, where they tend to assign higher likelihoods to OOD samples. Previous studies on this issue are usually not…

Machine Learning · Computer Science 2024-01-04 Zezhen Zeng , Bin Liu

We present a coupled Variational Auto-Encoder (VAE) method that improves the accuracy and robustness of the probabilistic inferences on represented data. The new method models the dependency between input feature vectors (images) and weighs…

Machine Learning · Computer Science 2025-11-25 Shichen Cao , Jingjing Li , Kenric P. Nelson , Mark A. Kon

Change detection (CD) identifies scene changes from multi-temporal observations and is widely used in urban development and environmental monitoring. Most existing CD methods rely on supervised learning, making performance strongly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Ziqiang Zhu , Bowei Yang