中文
相关论文

相关论文: Deep Actor-Critic Reinforcement Learning for Anoma…

200 篇论文

Recent efforts towards video anomaly detection (VAD) try to learn a deep autoencoder to describe normal event patterns with small reconstruction errors. The video inputs with large reconstruction errors are regarded as anomalies at the test…

计算机视觉与模式识别 · 计算机科学 2021-09-03 Yuandu Lai , Yahong Han , Yaowei Wang

This study presents a benchmark for evaluating action-constrained reinforcement learning (RL) algorithms. In action-constrained RL, each action taken by the learning system must comply with certain constraints. These constraints are crucial…

机器学习 · 计算机科学 2023-06-30 Kazumi Kasaura , Shuwa Miura , Tadashi Kozuno , Ryo Yonetani , Kenta Hoshino , Yohei Hosoe

Existing approaches in reinforcement learning train an agent to learn desired optimal behavior in an environment with rule based surrounding agents. In safety critical applications such as autonomous driving it is crucial that the rule…

计算机视觉与模式识别 · 计算机科学 2025-08-22 Arjun Srinivasan , Anubhav Paras , Aniket Bera

Time series anomaly detection has applications in a wide range of research fields and applications, including manufacturing and healthcare. The presence of anomalies can indicate novel or unexpected events, such as production faults, system…

机器学习 · 计算机科学 2024-09-04 Zahra Zamanzadeh Darban , Geoffrey I. Webb , Shirui Pan , Charu C. Aggarwal , Mahsa Salehi

Anomalies represent deviations from the intended system operation and can lead to decreased efficiency as well as partial or complete system failure. As the causes of anomalies are often unknown due to complex system dynamics, efficient…

机器学习 · 计算机科学 2021-08-31 Benjamin Lindemann , Benjamin Maschler , Nada Sahlab , Michael Weyrich

Anomaly detection seeks to identify unusual phenomena, a central task in science and industry. The task is inherently unsupervised as anomalies are unexpected and unknown during training. Recent advances in self-supervised representation…

机器学习 · 计算机科学 2022-10-20 Tal Reiss , Niv Cohen , Eliahu Horwitz , Ron Abutbul , Yedid Hoshen

In standard Reinforcement Learning (RL) settings, the interaction between the agent and the environment is typically modeled as a Markov Decision Process (MDP), which assumes that the agent observes the system state instantaneously, selects…

机器学习 · 计算机科学 2025-06-18 John Wikman , Alexandre Proutiere , David Broman

Deep Learning (DL) is vulnerable to out-of-distribution and adversarial examples resulting in incorrect outputs. To make DL more robust, several posthoc (or runtime) anomaly detection techniques to detect (and discard) these anomalous…

机器学习 · 计算机科学 2021-02-23 Saikiran Bulusu , Bhavya Kailkhura , Bo Li , Pramod K. Varshney , Dawn Song

This study addresses the problem of dynamic anomaly detection in accounting transactions and proposes a real-time detection method based on a Transformer to tackle the challenges of hidden abnormal behaviors and high timeliness requirements…

机器学习 · 计算机科学 2025-11-18 Yi Wang , Ruoyi Fang , Anzhuo Xie , Hanrui Feng , Jianlin Lai

We developed DeepADMR, a novel neural anomaly detector for the deep reinforcement learning (DRL)-based DeepCQ+ MANET routing policy. The performance of DRL-based algorithms such as DeepCQ+ is only verified within the trained and tested…

网络与互联网体系结构 · 计算机科学 2023-02-28 Alex Yahja , Saeed Kaviani , Bo Ryu , Jae H. Kim , Kevin A. Larson

A key task in Artificial Intelligence is learning effective policies for controlling agents in unknown environments to optimize performance measures. Off-policy learning methods, like Q-learning, allow learners to make optimal decisions…

人工智能 · 计算机科学 2025-10-27 Mingxuan Li , Junzhe Zhang , Elias Bareinboim

Anomaly detection describes methods of finding abnormal states, instances or data points that differ from a normal value space. Industrial processes are a domain where predicitve models are needed for finding anomalous data instances for…

机器学习 · 计算机科学 2022-09-26 Alexander Zeiser , Bas van Stein , Thomas Bäck

Model-based reinforcement learning is an effective approach for controlling an unknown system. It is based on a longstanding pipeline familiar to the control community in which one performs experiments on the environment to collect a…

系统与控制 · 电气工程与系统科学 2024-08-14 Bruce D. Lee , Ingvar Ziemann , George J. Pappas , Nikolai Matni

Anomaly detection is fundamental yet, challenging problem with practical applications in industry. The current approaches neglect the higher-order dependencies within the networks of interconnected sensors in the high-dimensional time…

机器学习 · 计算机科学 2024-08-22 Sakhinana Sagar Srinivas , Rajat Kumar Sarkar , Venkataramana Runkana

Convolutional Neural Network (CNN) techniques have proven to be very useful in image-based anomaly detection applications. CNN can be used as deep features extractor where other anomaly detection techniques are applied on these features.…

机器学习 · 计算机科学 2022-08-15 Sulaiman Aburakhia , Tareq Tayeh , Ryan Myers , Abdallah Shami

Logs have been an imperative resource to ensure the reliability and continuity of many software systems, especially large-scale distributed systems. They faithfully record runtime information to facilitate system troubleshooting and…

软件工程 · 计算机科学 2022-01-12 Zhuangbin Chen , Jinyang Liu , Wenwei Gu , Yuxin Su , Michael R. Lyu

Advanced Persistent Threats (APTs) pose a significant challenge in cybersecurity due to their stealthy and long-term nature. Modern supervised learning methods require extensive labeled data, which is often scarce in real-world…

机器学习 · 计算机科学 2025-11-26 Sidahmed Benabderrahmane , James Cheney , Talal Rahwan

The development of autonomous agents which can interact with other agents to accomplish a given task is a core area of research in artificial intelligence and machine learning. Towards this goal, the Autonomous Agents Research Group…

Logs constitute a form of evidence signaling the operational status of software systems. Automated log anomaly detection is crucial for ensuring the reliability of modern software systems. However, existing approaches face significant…

The continued digitization of societal processes translates into a proliferation of time series data that cover applications such as fraud detection, intrusion detection, and energy management, where anomaly detection is often essential to…