English
Related papers

Related papers: GAIL-PT: A Generic Intelligent Penetration Testing…

200 papers

This paper considers learning robot locomotion and manipulation tasks from expert demonstrations. Generative adversarial imitation learning (GAIL) trains a discriminator that distinguishes expert from agent transitions, and in turn use a…

Machine Learning · Computer Science 2022-06-24 Tianyu Wang , Nikhil Karnwal , Nikolay Atanasov

As a prominent category of imitation learning methods, adversarial imitation learning (AIL) has garnered significant practical success powered by neural network approximation. However, existing theoretical studies on AIL are primarily…

Machine Learning · Computer Science 2024-11-04 Tian Xu , Zhilong Zhang , Ruishuo Chen , Yihao Sun , Yang Yu

While the benefits of 6G-enabled Internet of Things (IoT) are numerous, providing high-speed, low-latency communication that brings new opportunities for innovation and forms the foundation for continued growth in the IoT industry, it is…

Cryptography and Security · Computer Science 2023-04-13 Mohamed Amine Ferrag , Djallel Hamouda , Merouane Debbah , Leandros Maglaras , Abderrahmane Lakas

Compared to reinforcement learning, imitation learning (IL) is a powerful paradigm for training agents to learn control policies efficiently from expert demonstrations. However, in most cases, obtaining demonstration data is costly and…

Machine Learning · Computer Science 2019-03-20 Naijun Liu , Tao Lu , Yinghao Cai , Boyao Li , Shuo Wang

Imitation learning methods have demonstrated considerable success in teaching autonomous systems complex tasks through expert demonstrations. However, a limitation of these methods is their lack of interpretability, particularly in…

Machine Learning · Computer Science 2025-07-21 Wenliang Liu , Danyang Li , Erfan Aasi , Daniela Rus , Roberto Tron , Calin Belta

With increasing numbers of vulnerabilities exposed on the internet, autonomous penetration testing (pentesting) has emerged as a promising research area. Reinforcement learning (RL) is a natural fit for studying this topic. However, two key…

Machine Learning · Computer Science 2025-02-12 Shicheng Zhou , Jingju Liu , Yuliang Lu , Jiahai Yang , Yue Zhang , Jie Chen

The introduction of the generative adversarial imitation learning (GAIL) algorithm has spurred the development of scalable imitation learning approaches using deep neural networks. Many of the algorithms that followed used a similar…

Machine Learning · Computer Science 2023-09-21 Kai Arulkumaran , Dan Ogawa Lillrank

This paper considers key challenges to using reinforcement learning (RL) with attack graphs to automate penetration testing in real-world applications from a systems perspective. RL approaches to automated penetration testing are actively…

Cryptography and Security · Computer Science 2022-06-15 Tyler Cody

Generative Adversarial Imitation Learning (GAIL) stands as a cornerstone approach in imitation learning. This paper investigates the gradient explosion in two types of GAIL: GAIL with deterministic policy (DE-GAIL) and GAIL with stochastic…

Machine Learning · Computer Science 2023-12-19 Wanying Wang , Yichen Zhu , Yirui Zhou , Chaomin Shen , Jian Tang , Zhiyuan Xu , Yaxin Peng , Yangchun Zhang

An open problem in autonomous vehicle safety validation is building reliable models of human driving behavior in simulation. This work presents an approach to learn neural driving policies from real world driving demonstration data. We…

Artificial Intelligence · Computer Science 2023-02-08 Raunak Bhattacharyya , Blake Wulfe , Derek Phillips , Alex Kuefler , Jeremy Morton , Ransalu Senanayake , Mykel Kochenderfer

Imitation learning aims to learn a policy from observing expert demonstrations without access to reward signals from environments. Generative adversarial imitation learning (GAIL) formulates imitation learning as adversarial learning,…

Machine Learning · Computer Science 2024-11-27 Chun-Mao Lai , Hsiang-Chun Wang , Ping-Chun Hsieh , Yu-Chiang Frank Wang , Min-Hung Chen , Shao-Hua Sun

Reinforcement learning for multi-goal robot manipulation tasks poses significant challenges due to the diversity and complexity of the goal space. Techniques such as Hindsight Experience Replay (HER) have been introduced to improve learning…

Robotics · Computer Science 2025-06-17 Yingyi Kuang , Luis J. Manso , George Vogiatzis

Deriving robust control policies for realistic urban navigation scenarios is not a trivial task. In an end-to-end approach, these policies must map high-dimensional images from the vehicle's cameras to low-level actions such as steering and…

Machine Learning · Computer Science 2024-09-06 Gustavo Claudio Karl Couto , Eric Aislan Antonelo

Equipped with various tools and knowledge, GPTs, one kind of customized AI agents based on OpenAI's large language models, have illustrated great potential in many fields, such as writing, research, and programming. Today, the number of…

Cryptography and Security · Computer Science 2025-12-02 Tong Wu , Weibin Wu , Zibin Zheng

Penetration testing is a critical technique for identifying security vulnerabilities, traditionally performed manually by skilled security specialists. This complex process involves gathering information about the target system, identifying…

Cryptography and Security · Computer Science 2025-06-02 Xiangmin Shen , Lingzhi Wang , Zhenyuan Li , Yan Chen , Wencheng Zhao , Dawei Sun , Jiashui Wang , Wei Ruan

We show that a critical vulnerability in adversarial imitation is the tendency of discriminator networks to learn spurious associations between visual features and expert labels. When the discriminator focuses on task-irrelevant features,…

The field of software security testing, more specifically penetration testing, is an activity that requires high levels of expertise and involves many manual testing and analysis steps. This paper explores the potential usage of…

Computation and Language · Computer Science 2023-10-19 Andreas Happe , Jürgen Cito

Embodied agents, such as robots and virtual characters, must continuously select actions to execute tasks effectively, solving complex sequential decision-making problems. Given the difficulty of designing such controllers manually,…

Robotics · Computer Science 2026-05-18 Pedro Santana

Imitation learning (IL) aims to learn a policy from expert demonstrations that minimizes the discrepancy between the learner and expert behaviors. Various imitation learning algorithms have been proposed with different pre-determined…

Machine Learning · Computer Science 2020-11-20 Xin Zhang , Yanhua Li , Ziming Zhang , Zhi-Li Zhang

Advanced Persistent Threats (APTs) represent a significant challenge in cybersecurity due to their sophisticated and stealthy nature. Traditional Intrusion Detection Systems (IDS) often fall short in detecting these multi-stage attacks.…

Cryptography and Security · Computer Science 2025-01-08 Atmane Ayoub Mansour Bahar , Kamel Soaid Ferrahi , Mohamed-Lamine Messai , Hamida Seba , Karima Amrouche