English
Related papers

Related papers: Faults in Deep Reinforcement Learning Programs: A …

200 papers

Reinforcement learning (RL) is attracting attention as an effective way to solve sequential optimization problems that involve high dimensional state/action space and stochastic uncertainties. Many such problems involve constraints…

Machine Learning · Computer Science 2021-04-01 Haeun Yoo , Victor M. Zavala , Jay H. Lee

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The…

Machine Learning · Computer Science 2020-04-01 Thanh Thi Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

This paper presents the first model extraction attack against Deep Reinforcement Learning (DRL), which enables an external adversary to precisely recover a black-box DRL model only from its interaction with the environment. Model extraction…

Machine Learning · Computer Science 2020-12-23 Kangjie Chen , Shangwei Guo , Tianwei Zhang , Xiaofei Xie , Yang Liu

Deep reinforcement learning (DRL) has recently been adopted in a wide range of physics and engineering domains for its ability to solve decision-making problems that were previously out of reach due to a combination of non-linearity and…

Computational Physics · Physics 2024-06-19 Paul Garnier , Jonathan Viquerat , Jean Rabault , Aurélien Larcher , Alexander Kuhnle , Elie Hachem

Deep neural networks (DNNs) have gained significant popularity in recent years, becoming the state of the art in a variety of domains. In particular, deep reinforcement learning (DRL) has recently been employed to train DNNs that realize…

Machine Learning · Computer Science 2021-08-16 Guy Amir , Michael Schapira , Guy Katz

Deep Reinforcement Learning (DRL) systems are increasingly used in safety-critical applications, yet their security remains severely underexplored. This work investigates backdoor attacks, which implant hidden triggers that cause malicious…

Machine Learning · Computer Science 2025-07-08 Sanyam Vyas , Alberto Caron , Chris Hicks , Pete Burnap , Vasilios Mavroudis

Software vulnerability detection is critical in software security because it identifies potential bugs in software systems, enabling immediate remediation and mitigation measures to be implemented before they may be exploited. Automatic…

Software Engineering · Computer Science 2023-06-21 Nima Shiri Harzevili , Alvine Boaye Belle , Junjie Wang , Song Wang , Zhen Ming , Jiang , Nachiappan Nagappan

Deep Learning (DL) has recently achieved tremendous success. A variety of DL frameworks and platforms play a key role to catalyze such progress. However, the differences in architecture designs and implementations of existing frameworks and…

Machine Learning · Computer Science 2019-09-17 Qianyu Guo , Sen Chen , Xiaofei Xie , Lei Ma , Qiang Hu , Hongtao Liu , Yang Liu , Jianjun Zhao , Xiaohong Li

The increasing demand for autonomous systems in complex and dynamic environments has driven significant research into intelligent path planning methodologies. For decades, graph-based search algorithms, linear programming techniques, and…

Deep Learning Systems (DLSs) have been widely applied in safety-critical tasks such as autopilot. However, when a perturbed input is fed into a DLS for inference, the DLS often has incorrect outputs (i.e., faults). DLS testing techniques…

Software Engineering · Computer Science 2024-08-19 Dong Huang , Tsz On Li , Xiaofei Xie , Heming Cui

In this work, we review research studies that combine Reinforcement Learning (RL) and Large Language Models (LLMs), two areas that owe their momentum to the development of deep neural networks. We propose a novel taxonomy of three main…

Computation and Language · Computer Science 2024-08-29 Moschoula Pternea , Prerna Singh , Abir Chakraborty , Yagna Oruganti , Mirco Milletari , Sayli Bapat , Kebei Jiang

Deep learning (DL) has become a key component of modern software. In the "big model" era, the rich features of DL-based software substantially rely on powerful DL models, e.g., BERT, GPT-3, and the recently emerging GPT-4, which are trained…

Software Engineering · Computer Science 2023-05-01 Xuanzhe Liu , Diandian Gu , Zhenpeng Chen , Jinfeng Wen , Zili Zhang , Yun Ma , Haoyu Wang , Xin Jin

Deep Reinforcement Learning (DRL) is vital in various AI applications. DRL algorithms comprise diverse compute kernels, which may not be simultaneously optimized using a homogeneous architecture. However, even with available heterogeneous…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-17 Yuan Meng , Michael Kinsner , Deshanand Singh , Mahesh A Iyer , Viktor Prasanna

The high penetration of distributed energy resources (DERs) in modern smart power systems introduces unforeseen uncertainties for the electricity sector, leading to increased complexity and difficulty in the operation and control of power…

Systems and Control · Electrical Eng. & Systems 2024-09-25 Van-Hai Bui , Srijita Das , Akhtar Hussain , Guilherme Vieira Hollweg , Wencong Su

Digital systems find it challenging to keep up with cybersecurity threats. The daily emergence of more than 560,000 new malware strains poses significant hazards to the digital ecosystem. The traditional malware detection methods fail to…

Cryptography and Security · Computer Science 2025-04-28 Abrar Fahim , Shamik Dey , Md. Nurul Absur , Md Kamrul Siam , Md. Tahmidul Huque , Jafreen Jafor Godhuli

In the rapidly changing healthcare landscape, the implementation of offline reinforcement learning (RL) in dynamic treatment regimes (DTRs) presents a mix of unprecedented opportunities and challenges. This position paper offers a critical…

Machine Learning · Computer Science 2024-06-05 Zhiyao Luo , Yangchen Pan , Peter Watkinson , Tingting Zhu

Deep reinforcement learning (DRL) has achieved significant breakthroughs in various tasks. However, most DRL algorithms suffer a problem of generalizing the learned policy which makes the learning performance largely affected even by minor…

Machine Learning · Computer Science 2019-07-11 Zhengyao Jiang , Shan Luo

Reinforcement learning (RL) algorithms involve the deep nesting of highly irregular computation patterns, each of which typically exhibits opportunities for distributed computation. We argue for distributing RL components in a composable…

Artificial Intelligence · Computer Science 2018-07-02 Eric Liang , Richard Liaw , Philipp Moritz , Robert Nishihara , Roy Fox , Ken Goldberg , Joseph E. Gonzalez , Michael I. Jordan , Ion Stoica

Deep reinforcement learning (DRL) has emerged as a powerful framework for solving sequential decision-making problems, achieving remarkable success in a wide range of applications, including game AI, autonomous driving, biomedicine, and…

Machine Learning · Computer Science 2025-05-14 Yinghan Sun , Hongxi Wang , Hua Chen , Wei Zhang

Deep Reinforcement Learning (DRL) is a frequently employed technique to solve scheduling problems. Although DRL agents ace at delivering viable results in short computing times, their reasoning remains opaque. We conduct a case study where…

Artificial Intelligence · Computer Science 2024-09-02 Daniel Fischer , Hannah M. Hüsener , Felix Grumbach , Lukas Vollenkemper , Arthur Müller , Pascal Reusch