English
Related papers

Related papers: Diminishing Empirical Risk Minimization for Unsupe…

200 papers

Hacking and false data injection from adversaries can threaten power grids' everyday operations and cause significant economic loss. Anomaly detection in power grids aims to detect and discriminate anomalies caused by cyber attacks against…

Machine Learning · Computer Science 2023-03-14 Xijuan Sun , Di Wu , Arnaud Zinflou , Benoit Boulet

Developing simple, sample-efficient learning algorithms for robust classification is a pressing issue in today's tech-dominated world, and current theoretical techniques requiring exponential sample complexity and complicated improper…

Machine Learning · Computer Science 2023-02-07 Robi Bhattacharjee , Max Hopkins , Akash Kumar , Hantao Yu , Kamalika Chaudhuri

Anomaly Detection (AD) is a critical task that involves identifying observations that do not conform to a learned model of normality. Prior work in deep AD is predominantly based on a familiarity hypothesis, where familiar features serve as…

Machine Learning · Computer Science 2024-02-27 Sarath Sivaprasad , Mario Fritz

Spacecraft anomaly detection is critical for mission safety, yet deploying sophisticated models on-board presents significant challenges due to hardware constraints. This paper investigates three approaches for spacecraft telemetry anomaly…

Machine Learning · Computer Science 2026-04-01 Christopher Goetze , Tim Schlippe , Daniel Lakey

The popularity of algorithms based on Extreme Learning Machine (ELM), which can be used to train Single Layer Feedforward Neural Networks (SLFN), has increased in the past years. They have been successfully applied to a wide range of…

Extreme learning machine (ELM) is a new single hidden layer feedback neural network. The weights of the input layer and the biases of neurons in hidden layer are randomly generated, the weights of the output layer can be analytically…

Machine Learning · Computer Science 2018-03-13 Lin Feng , Shuliang Xu , Feilong Wang , Shenglan Liu

This paper proposes a set of new error criteria and learning approaches, Adaptive Normalized Risk-Averting Training (ANRAT), to attack the non-convex optimization problem in training deep neural networks (DNNs). Theoretically, we…

Machine Learning · Computer Science 2016-06-10 Zhiguang Wang , Tim Oates , James Lo

Anomaly detection (AD) involves identifying observations or events that deviate in some way from the rest of the data. Machine learning techniques have shown success in automating this process by detecting hidden patterns and deviations in…

Quantum Physics · Physics 2024-01-04 Kilian Tscharke , Sebastian Issel , Pascal Debus

Real-time lightweight time series anomaly detection has become increasingly crucial in cybersecurity and many other domains. Its ability to adapt to unforeseen pattern changes and swiftly identify anomalies enables prompt responses and…

Machine Learning · Computer Science 2024-07-29 Ming-Chang Lee , Jia-Chun Lin , Sokratis Katsikas

In safety-critical applications of machine learning, it is often desirable for a model to be conservative, abstaining from making predictions on unknown inputs which are not well-represented in the training data. However, detecting unknown…

Machine Learning · Computer Science 2024-06-04 Caroline Choi , Fahim Tajwar , Yoonho Lee , Huaxiu Yao , Ananya Kumar , Chelsea Finn

Due to the intractability of characterizing everything that looks unlike the normal data, anomaly detection (AD) is traditionally treated as an unsupervised problem utilizing only normal samples. However, it has recently been found that…

Computer Vision and Pattern Recognition · Computer Science 2023-01-29 Philipp Liznerski , Lukas Ruff , Robert A. Vandermeulen , Billy Joe Franks , Klaus-Robert Müller , Marius Kloft

The density ratio model (DRM) provides a flexible and useful platform for combining information from multiple sources. In this paper, we consider statistical inference under two-sample DRMs with additional parameters defined through and/or…

Statistics Theory · Mathematics 2021-03-01 Meng Yuan , Pengfei Li , Changbao Wu

Deep anomaly detection is a difficult task since, in high dimensions, it is hard to completely characterize a notion of "differentness" when given only examples of normality. In this paper we propose a novel approach to deep anomaly…

Machine Learning · Computer Science 2020-10-07 Lucas Deecke , Lukas Ruff , Robert A. Vandermeulen , Hakan Bilen

Anomaly detection in images plays a significant role for many applications across all industries, such as disease diagnosis in healthcare or quality assurance in manufacturing. Manual inspection of images, when extended over a monotonously…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Vincent Wilmet , Sauraj Verma , Tabea Redl , Håkon Sandaker , Zhenning Li

Empirical risk minimization is the main tool for prediction problems, but its extension to relational data remains unsolved. We solve this problem using recent ideas from graph sampling theory to (i) define an empirical risk for relational…

Machine Learning · Statistics 2019-02-25 Victor Veitch , Morgane Austern , Wenda Zhou , David M. Blei , Peter Orbanz

Detecting out of distribution (OOD) samples is of paramount importance in all Machine Learning applications. Deep generative modeling has emerged as a dominant paradigm to model complex data distributions without labels. However, prior work…

Machine Learning · Computer Science 2021-01-05 Gowthami Somepalli , Yexin Wu , Yogesh Balaji , Bhanukiran Vinzamuri , Soheil Feizi

This paper describes the use of neural networks to enhance simulations for subsequent training of anomaly-detection systems. Simulations can provide edge conditions for anomaly detection which may be sparse or non-existent in real-world…

Neural and Evolutionary Computing · Computer Science 2020-11-06 Philip Feldman

Anomaly detection in time-series data is crucial for identifying faults, failures, threats, and outliers across a range of applications. Recently, deep learning techniques have been applied to this topic, but they often struggle in…

Machine Learning · Computer Science 2024-01-23 Lixu Wang , Shichao Xu , Xinyu Du , Qi Zhu

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation associated with…

Machine Learning · Computer Science 2020-05-19 Zonghao Huang , Yanmin Gong

Anomaly detection tools and methods enable key analytical capabilities in modern cyberphysical and sensor-based systems. Despite the fast-paced development in deep learning architectures for anomaly detection, model optimization for a given…

Neural and Evolutionary Computing · Computer Science 2024-04-12 Marcin Pietroń , Dominik Żurek , Kamil Faber , Roberto Corizzo