English
Related papers

Related papers: Transformer-based Autoencoder with ID Constraint f…

200 papers

Transformer-based models attain excellent results and generalize well when trained on sufficient amounts of data. However, constrained by the limited data available in the audio domain, most transformer-based models for audio tasks are…

Sound · Computer Science 2022-04-28 Dading Chong , Helin Wang , Peilin Zhou , Qingcheng Zeng

Anomaly detection on attributed networks aims at finding nodes whose patterns deviate significantly from the majority of reference nodes, which is pervasive in many applications such as network intrusion detection and social spammer…

Machine Learning · Computer Science 2020-02-13 Haoyi Fan , Fengbin Zhang , Zuoyong Li

The proliferation of IoT devices has significantly increased network vulnerabilities, creating an urgent need for effective Intrusion Detection Systems (IDS). Machine Learning-based IDS (ML-IDS) offer advanced detection capabilities but…

Cryptography and Security · Computer Science 2025-02-12 Elvin Li , Zhengli Shang , Onat Gungor , Tajana Rosing

Semi-supervised learning is attracting increasing attention due to the fact that datasets of many domains lack enough labeled data. Variational Auto-Encoder (VAE), in particular, has demonstrated the benefits of semi-supervised learning.…

Machine Learning · Computer Science 2018-12-04 Yang Li , Quan Pan , Suhang Wang , Haiyun Peng , Tao Yang , Erik Cambria

Previous transfer methods for anomaly detection generally assume the availability of labeled data in source or target domains. However, such an assumption is not valid in most real applications where large-scale labeled data are too…

Machine Learning · Computer Science 2021-05-20 Cangning Fan , Fangyi Zhang , Peng Liu , Xiuyu Sun , Hao Li , Ting Xiao , Wei Zhao , Xianglong Tang

In industrial applications, the early detection of malfunctioning factory machinery is crucial. In this paper, we consider acoustic malfunction detection via transfer learning. Contrary to the majority of current approaches which are based…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-19 Robert Müller , Fabian Ritz , Steffen Illium , Claudia Linnhoff-Popien

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of…

Machine Learning · Computer Science 2018-12-18 Jack Klys , Jake Snell , Richard Zemel

Responding to the challenge of detecting unusual radar targets in a well identified environment, innovative anomaly and novelty detection methods keep emerging in the literature. This work aims at presenting a benchmark gathering common and…

Signal Processing · Electrical Eng. & Systems 2021-06-22 Martin Bauw , Santiago Velasco-Forero , Jesus Angulo , Claude Adnet , Olivier Airiau

Imbalanced data classification problem has always been a popular topic in the field of machine learning research. In order to balance the samples between majority and minority class. Oversampling algorithm is used to synthesize new minority…

Machine Learning · Computer Science 2019-09-02 Junyi Zou , Jinliang Zhang , Ping Jiang

Leveraging deep learning models for Anomaly Detection (AD) has seen widespread use in recent years due to superior performances over traditional methods. Recent deep methods for anomalies in images learn better features of normality in an…

Computation and Language · Computer Science 2021-04-13 Andrei Manolache , Florin Brad , Elena Burceanu

We address a practical scenario of anomaly detection for industrial sound data, where the sound of a target machine is corrupted by background noise and interference from neighboring machines. Overcoming this challenge is difficult since…

Sound · Computer Science 2024-09-04 Yunjoo Lee , Jaechang Kim , Jungseul Ok

Anomaly detection techniques are growing in importance at the Large Hadron Collider (LHC), motivated by the increasing need to search for new physics in a model-agnostic way. In this work, we provide a detailed comparative study between a…

High Energy Physics - Phenomenology · Physics 2021-07-28 Jack H. Collins , Pablo Martín-Ramiro , Benjamin Nachman , David Shih

Semi-supervised anomaly detection (SSAD) methods have demonstrated their effectiveness in enhancing unsupervised anomaly detection (UAD) by leveraging few-shot but instructive abnormal instances. However, the dominance of homogeneous normal…

Machine Learning · Computer Science 2023-09-07 Yixuan Zhou , Peiyu Yang , Yi Qu , Xing Xu , Zhe Sun , Andrzej Cichocki

We combine conditional variational autoencoders (VAE) with adversarial censoring in order to learn invariant representations that are disentangled from nuisance/sensitive variations. In this method, an adversarial network attempts to…

Machine Learning · Computer Science 2018-05-22 Ye Wang , Toshiaki Koike-Akino , Deniz Erdogmus

Classic variational autoencoders are used to learn complex data distributions, that are built on standard function approximators. Especially, VAE has shown promise on a lot of complex task. In this paper, a new autoencoder model -…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Qiuyu Zhu , Ruixin Zhang

Anomaly detection is to identify samples that do not conform to the distribution of the normal data. Due to the unavailability of anomalous data, training a supervised deep neural network is a cumbersome task. As such, unsupervised methods…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Vahid Reza Khazaie , Anthony Wong , John Taylor Jewell , Yalda Mohsenzadeh

Recent methods for self-supervised learning can be grouped into two paradigms: contrastive and non-contrastive approaches. Their success can largely be attributed to data augmentation pipelines which generate multiple views of a single…

Machine Learning · Computer Science 2022-02-08 William Falcon , Ananya Harsh Jha , Teddy Koker , Kyunghyun Cho

Dynamical variational autoencoders (DVAEs) are a class of deep generative models with latent variables, dedicated to model time series of high-dimensional data. DVAEs can be considered as extensions of the variational autoencoder (VAE) that…

Sound · Computer Science 2022-10-04 Xiaoyu Bie , Simon Leglaive , Xavier Alameda-Pineda , Laurent Girin

Anomaly detection (AD) plays a vital role across a wide range of domains, but its performance might deteriorate when applied to target domains with limited data. Domain Adaptation (DA) offers a solution by transferring knowledge from a…

Machine Learning · Statistics 2025-08-12 Tran Tuan Kiet , Nguyen Thang Loi , Vo Nguyen Le Duy

We address the challenge of training Vision Transformers (ViTs) when labeled data is scarce but unlabeled data is abundant. We propose Semi-Supervised Masked Autoencoder (SSMAE), a framework that jointly optimizes masked image…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Atik Faysal , Mohammad Rostami , Reihaneh Gh. Roshan , Nikhil Muralidhar , Huaxia Wang