English
Related papers

Related papers: Dimensionality reduction techniques to support ins…

200 papers

Anomaly detection is a prominent data preprocessing step in learning applications for correction and/or removal of faulty data. Automating this data type with the use of autoencoders could increase the quality of the dataset by isolating…

Machine Learning · Computer Science 2020-04-10 Benjamin Smith , Kevin Cant , Gloria Wang

Medical anomaly detection aims to identify abnormal findings using only normal training data, playing a crucial role in health screening and recognizing rare diseases. Reconstruction-based methods, particularly those utilizing autoencoders…

Machine Learning · Computer Science 2024-07-10 Yu Cai , Hao Chen , Kwang-Ting Cheng

Detecting abnormal nodes from attributed networks is of great importance in many real applications, such as financial fraud detection and cyber security. This task is challenging due to both the complex interactions between the anomalous…

Machine Learning · Computer Science 2023-10-02 Jiaqiang Zhang , Senzhang Wang , Songcan Chen

Unsupervised anomaly detection is a challenging task. Autoencoders (AEs) or generative models are often employed to model the data distribution of normal inputs and subsequently identify anomalous, out-of-distribution inputs by high…

Machine Learning · Computer Science 2025-06-12 Yalin Liao , Austin J. Brockmeier

We investigate unsupervised anomaly detection for high-dimensional data and introduce a deep metric learning (DML) based framework. In particular, we learn a distance metric through a deep neural network. Through this metric, we project the…

Machine Learning · Computer Science 2020-05-13 Selim F. Yilmaz , Suleyman S. Kozat

The joint optimization of the reconstruction and classification error is a hard non convex problem, especially when a non linear mapping is utilized. In order to overcome this obstacle, a novel optimization strategy is proposed, in which a…

Machine Learning · Computer Science 2022-11-07 Ioannis A. Nellas , Sotiris K. Tasoulis , Vassilis P. Plagianakos , Spiros V. Georgakopoulos

Many real-world monitoring and surveillance applications require non-trivial anomaly detection to be run in the streaming model. We consider an incremental-learning approach, wherein a deep-autoencoding (DAE) model of what is normal is…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Albert Akhriev , Jakub Marecek

Recently, reconstruction-based anomaly detection was proposed as an effective technique to detect attacks in dynamic industrial control networks. Unlike classical network anomaly detectors that observe the network traffic,…

Cryptography and Security · Computer Science 2020-10-13 Alessandro Erba , Riccardo Taormina , Stefano Galelli , Marcello Pogliani , Michele Carminati , Stefano Zanero , Nils Ole Tippenhauer

Anomaly detection is critically important for intelligent surveillance systems to detect in a timely manner any malicious activities. Many video anomaly detection approaches using deep learning methods focus on a single camera video stream…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Chongke Wu , Sicong Shao , Cihan Tunc , Salim Hariri

This study proposes an automated data mining framework based on autoencoders and experimentally verifies its effectiveness in feature extraction and data dimensionality reduction. Through the encoding-decoding structure, the autoencoder can…

Machine Learning · Computer Science 2024-12-04 Yaxin Liang , Xinshi Li , Xin Huang , Ziqi Zhang , Yue Yao

We present a collection of algorithms which utilize dimensional reduction to perform mesh refinement and study possibly singular solutions of time-dependent partial differential equations. The algorithms are inspired by constructions used…

Numerical Analysis · Mathematics 2007-06-21 Panagiotis Stinis

Anomalies are samples that significantly deviate from the rest of the data and their detection plays a major role in building machine learning models that can be reliably used in applications such as data-driven design and novelty…

Machine Learning · Statistics 2023-06-19 Amin Yousefpour , Mehdi Shishehbor , Zahra Zanjani Foumani , Ramin Bostanabad

Unsupervised dimensionality reduction is one of the commonly used techniques in the field of high dimensional data recognition problems. The deep autoencoder network which constrains the weights to be non-negative, can learn a low…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Anyong Qin , Zhaowei Shang , Zhuolin Tan , Taiping Zhang , Yuan Yan Tang

In the realm of machine learning, the study of anomaly detection and localization within image data has gained substantial traction, particularly for practical applications such as industrial defect detection. While the majority of existing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Wenping Jin , Fei Guo , Li Zhu

Due to the growing amount of data from in-situ sensors in wastewater systems, it becomes necessary to automatically identify abnormal behaviours and ensure high data quality. This paper proposes an anomaly detection method based on a deep…

Signal Processing · Electrical Eng. & Systems 2020-03-09 Stefania Russo , Andy Disch , Frank Blumensaat , Kris Villez

Methods from machine learning are being applied to design Industrial Control Systems resilient to cyber-attacks. Such methods focus on two major areas: the detection of intrusions at the network-level using the information acquired through…

Cryptography and Security · Computer Science 2022-02-25 Muhammad Azmi Umer , Khurum Nazir Junejo , Muhammad Taha Jilani , Aditya P. Mathur

At the crossway of machine learning and data analysis, anomaly detection aims at identifying observations that exhibit abnormal behaviour. Be it measurement errors, disease development, severe weather, production quality default(s) (items)…

Methodology · Statistics 2025-06-06 Romain Valla , Pavlo Mozharovskyi , Florence d'Alché-Buc

Power Delay Profile (PDP) plays a crucial role in wireless communications, providing information on multipath propagation and signal strength variations over time. Accurate detection of peaks within PDP is essential to identify dominant…

Signal Processing · Electrical Eng. & Systems 2026-03-23 Ondrej Zeleny , Radek Zavorka , Ales Prokes , Tomas Fryza , Jaroslaw Wojtun , Jan M. Kelner , Cezary Ziolkowski , Aniruddha Chandra

In unsupervised learning, dimensionality reduction is an important tool for data exploration and visualization. Because these aims are typically open-ended, it can be useful to frame the problem as looking for patterns that are enriched in…

Machine Learning · Statistics 2018-11-16 Kristen Severson , Soumya Ghosh , Kenney Ng

Modern machine learning models (such as deep neural networks and boosting decision tree models) have become increasingly popular in financial market prediction, due to their superior capacity to extract complex non-linear patterns. However,…

Machine Learning · Computer Science 2021-02-02 Chuheng Zhang , Yuanqi Li , Xi Chen , Yifei Jin , Pingzhong Tang , Jian Li