English
Related papers

Related papers: DeepADMR: A Deep Learning based Anomaly Detection …

200 papers

Deep anomaly detection is a difficult task since, in high dimensions, it is hard to completely characterize a notion of "differentness" when given only examples of normality. In this paper we propose a novel approach to deep anomaly…

Machine Learning · Computer Science 2020-10-07 Lucas Deecke , Lukas Ruff , Robert A. Vandermeulen , Hakan Bilen

Next-gen networks require significant evolution of management to enable automation and adaptively adjust network configuration based on traffic dynamics. The advent of software-defined networking (SDN) and programmable switches enables…

Networking and Internet Architecture · Computer Science 2024-02-08 Akshita Abrol , Purnima Murali Mohan , Tram Truong-Huu

Deep learning (DL) has emerged as a crucial tool in network anomaly detection (NAD) for cybersecurity. While DL models for anomaly detection excel at extracting features and learning patterns from data, they are vulnerable to data…

Recent deep neural networks based techniques, especially those equipped with the ability of self-adaptation in the system level such as deep reinforcement learning (DRL), are shown to possess many advantages of optimizing robot learning…

Machine Learning · Computer Science 2021-10-11 Chao-Han Huck Yang , Jun Qi , Pin-Yu Chen , Yi Ouyang , I-Te Danny Hung , Chin-Hui Lee , Xiaoli Ma

Deep reinforcement learning (DRL) has emerged as a promising approach for developing more intelligent autonomous vehicles (AVs). A typical DRL application on AVs is to train a neural network-based driving policy. However, the black-box…

Artificial Intelligence · Computer Science 2023-05-15 Weitao Zhou , Zhong Cao , Nanshan Deng , Kun Jiang , Diange Yang

Autonomous Ground Vehicles (AGVs) are essential tools for a wide range of applications stemming from their ability to operate in hazardous environments with minimal human operator input. Effective motion planning is paramount for successful…

Robotics · Computer Science 2023-09-04 Shathushan Sivashangaran , Azim Eskandarian

This paper explores the method of achieving autonomous navigation of unmanned vehicles through Deep Reinforcement Learning (DRL). The focus is on using the Deep Deterministic Policy Gradient (DDPG) algorithm to address issues in…

Robotics · Computer Science 2024-07-30 Letian Xu , Jiabei Liu , Haopeng Zhao , Tianyao Zheng , Tongzhou Jiang , Lipeng Liu

Deep Reinforcement Learning (DRL) has shown outstanding performance on inducing effective action policies that maximize expected long-term return on many complex tasks. Much of DRL work has been focused on sequences of events with discrete…

Machine Learning · Computer Science 2021-05-07 Yeo Jin Kim , Min Chi

In this paper, we introduce HDPlanner, a deep reinforcement learning (DRL) based framework designed to tackle two core and challenging tasks for mobile robots: autonomous exploration and navigation, where the robot must optimize its…

Robotics · Computer Science 2024-08-08 Jingsong Liang , Yuhong Cao , Yixiao Ma , Hanqi Zhao , Guillaume Sartoretti

Deep reinforcement learning (DRL) has become a dominant deep-learning paradigm for tasks where complex policies are learned within reactive systems. Unfortunately, these policies are known to be susceptible to bugs. Despite significant…

Robotics · Computer Science 2023-01-12 Guy Amir , Davide Corsi , Raz Yerushalmi , Luca Marzari , David Harel , Alessandro Farinelli , Guy Katz

The complexity and scale of IT systems are increasing dramatically, posing many challenges to real-world anomaly detection. Deep learning anomaly detection has emerged, aiming at feature learning and anomaly scoring, which has gained…

Machine Learning · Computer Science 2023-12-05 Xue Yang , Enda Howley , Micheal Schukat

An anomaly detection method based on deep autoencoders is proposed to address anomalies that often occur in enterprise-level ETL data streams. The study first analyzes multiple types of anomalies in ETL processes, including delays, missing…

Machine Learning · Computer Science 2025-11-04 Xin Chen , Saili Uday Gadgil , Kangning Gao , Yi Hu , Cong Nie

Detection of anomalous situations for complex mission-critical systems hold paramount importance when their service continuity needs to be ensured. A major challenge in detecting anomalies from the operational data arises due to the…

Machine Learning · Computer Science 2025-05-20 Shanay Mehta , Shlok Mehendale , Nicole Fernandes , Jyotirmoy Sarkar , Santonu Sarkar , Snehanshu Saha

Anomaly detection (AD) is increasingly recognized as a key component for ensuring the resilience of future communication systems. While deep learning has shown state-of-the-art AD performance, its application in critical systems is hindered…

Machine Learning · Computer Science 2025-10-29 Lukas Schynol , Marius Pesavento

Performing anomaly detection in hybrid systems is a challenging task since it requires analysis of timing behavior and mutual dependencies of both discrete and continuous signals. Typically, it requires modeling system behavior, which is…

Machine Learning · Computer Science 2020-10-30 Nemanja Hranisavljevic , Oliver Niggemann , Alexander Maier

Cyber-attacks are becoming increasingly sophisticated and frequent, highlighting the importance of network intrusion detection systems. This paper explores the potential and challenges of using deep reinforcement learning (DRL) in network…

Cryptography and Security · Computer Science 2026-03-03 Wanrong Yang , Alberto Acuto , Yihang Zhou , Dominik Wojtczak

Efficient anomaly detection and diagnosis in multivariate time-series data is of great importance for modern industrial applications. However, building a system that is able to quickly and accurately pinpoint anomalous observations is a…

Machine Learning · Computer Science 2022-05-17 Shreshth Tuli , Giuliano Casale , Nicholas R. Jennings

A critical bottleneck in deep reinforcement learning (DRL) is sample inefficiency, as training high-performance agents often demands extensive environmental interactions. Model-based reinforcement learning (MBRL) mitigates this by building…

Machine Learning · Computer Science 2025-09-30 Boxuan Zhang , Runqing Wang , Wei Xiao , Weipu Zhang , Jian Sun , Gao Huang , Jie Chen , Gang Wang

Much of the success of single agent deep reinforcement learning (DRL) in recent years can be attributed to the use of experience replay memories (ERM), which allow Deep Q-Networks (DQNs) to be trained efficiently through sampling stored…

Multiagent Systems · Computer Science 2018-02-28 Gregory Palmer , Karl Tuyls , Daan Bloembergen , Rahul Savani

Deep reinforcement learning (DRL) has demonstrated impressive performance in various gaming simulators and real-world applications. In practice, however, a DRL agent may receive faulty observation by abrupt interferences such as black-out,…

Machine Learning · Computer Science 2022-01-26 Chao-Han Huck Yang , I-Te Danny Hung , Yi Ouyang , Pin-Yu Chen