English
Related papers

Related papers: Simplex-enabled Safe Continual Learning Machine

200 papers

This innovative practice WIP paper describes \emph{LITE-SOC}, a lightweight web-based Security Operations Center (SOC) simulator designed for instructor-led cybersecurity education. SOC analysts must triage large volumes of alerts, separate…

Cryptography and Security · Computer Science 2026-05-19 Martin Higgins , Shawn Thompson , Cherry Mangla

We present Barrier-based Simplex (Bb-Simplex), a new, provably correct design for runtime assurance of continuous dynamical systems. Bb-Simplex is centered around the Simplex control architecture, which consists of a high-performance…

Systems and Control · Electrical Eng. & Systems 2024-11-11 Amol Damare , Shouvik Roy , Roshan Sharma , Keith DSouza , Scott A. Smolka , Scott D. Stoller

Accurate and stable feature matching is critical for computer vision tasks, particularly in applications such as Simultaneous Localization and Mapping (SLAM). While recent learning-based feature matching methods have demonstrated promising…

Robotics · Computer Science 2025-04-08 Yuqing Wang , Yan Wang , Hailiang Tang , Xiaoji Niu

Artificial intelligence (AI) and reinforcement learning (RL) have shown significant promise in wireless systems, enabling dynamic spectrum allocation, traffic management, and large-scale Internet of Things (IoT) coordination. However, their…

Networking and Internet Architecture · Computer Science 2026-02-17 Abdikarim Mohamed Ibrahim , Rosdiadee Nordin

Safe Reinforcement Learning (Safe RL) aims to ensure safety when an RL agent conducts learning by interacting with real-world environments where improper actions can induce high costs or lead to severe consequences. In this paper, we…

Machine Learning · Computer Science 2025-05-06 Hanping Zhang , Yuhong Guo

Safety is a critical concern when deploying reinforcement learning agents for realistic tasks. Recently, safe reinforcement learning algorithms have been developed to optimize the agent's performance while avoiding violations of safety…

Machine Learning · Computer Science 2021-01-05 Baiming Chen , Zuxin Liu , Jiacheng Zhu , Mengdi Xu , Wenhao Ding , Ding Zhao

In this work, we propose a hierarchical reinforcement learning (HRL) structure which is capable of performing autonomous vehicle planning tasks in simulated environments with multiple sub-goals. In this hierarchical structure, the network…

Robotics · Computer Science 2019-11-12 Zhiqian Qiao , Zachariah Tyree , Priyantha Mudalige , Jeff Schneider , John M. Dolan

Continual learning aims to provide intelligent agents capable of learning multiple tasks sequentially with neural networks. One of its main challenging, catastrophic forgetting, is caused by the neural networks non-optimal ability to learn…

Machine Learning · Computer Science 2021-01-29 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

Fast and safe voltage regulation algorithms can serve as fundamental schemes for achieving a high level of renewable penetration in the modern distribution power grids. Faced with uncertain or even unknown distribution grid models and…

Systems and Control · Electrical Eng. & Systems 2021-12-01 Yize Chen , Yuanyuan Shi , Daniel Arnold , Sean Peisert

In collaborative human-robot tasks, safety requires not only avoiding collisions but also ensuring safe, intentional physical contact. We present ContactRL, a reinforcement learning (RL) based framework that directly incorporates contact…

Robotics · Computer Science 2025-12-04 Sundas Rafat Mulkana , Ronyu Yu , Tanaya Guha , Emma Li

Learning from real-world robot demonstrations holds promise for interacting with complex real-world environments. However, the complexity and variability of interaction dynamics often cause purely positional controllers to struggle with…

Robotics · Computer Science 2025-11-19 Lai Wei , Xuanbin Peng , Ri-Zhao Qiu , Tianshu Huang , Xuxin Cheng , Xiaolong Wang

In this paper, we consider the important problem of safe exploration in reinforcement learning. While reinforcement learning is well-suited to domains with complex transition dynamics and high-dimensional state-action spaces, an additional…

Machine Learning · Computer Science 2014-02-05 Javier Garcia , Fernando Fernandez

Self-Regulated Learning (SRL), defined as learners' ability to systematically plan, monitor, and regulate their learning activities, is crucial for sustained academic achievement and lifelong learning competencies. Emerging AI developments…

Human-Computer Interaction · Computer Science 2025-12-10 Xinyu Li , Tongguang Li , Lixiang Yan , Yuheng Li , Linxuan Zhao , Mladen Raković , Inge Molenaar , Dragan Gašević , Yizhou Fan

In this paper, we present a Symbolic Reinforcement Learning (SRL) based architecture for safety control of Radio Access Network (RAN) applications. In particular, we provide a purely automated procedure in which a user can specify…

Artificial Intelligence · Computer Science 2022-04-26 Alexandros Nikou , Anusha Mujumdar , Vaishnavi Sundararajan , Marin Orlic , Aneta Vulgarakis Feljan

There is an increasing need of continual learning in dynamic systems, such as the self-driving vehicle, the surveillance drone, and the robotic system. Such a system requires learning from the data stream, training the model to preserve…

Machine Learning · Computer Science 2019-12-23 Xiaocong Du , Gouranga Charan , Frank Liu , Yu Cao

Developing decision-making algorithms for highly automated driving systems remains challenging, since these systems have to operate safely in an open and complex environments. Reinforcement Learning (RL) approaches can learn comprehensive…

Robotics · Computer Science 2025-07-01 M. Youssef Abdelhamid , Lennart Vater , Zlatan Ajanovic

Safety is a crucial property of every robotic platform: any control policy should always comply with actuator limits and avoid collisions with the environment and humans. In reinforcement learning, safety is even more fundamental for…

Robotics · Computer Science 2023-03-02 Puze Liu , Kuo Zhang , Davide Tateo , Snehal Jauhri , Zhiyuan Hu , Jan Peters , Georgia Chalvatzaki

Force control in hydraulic actuators is notoriously difficult due to strong nonlinearities, uncertainties, and the high risks associated with unsafe exploration during learning. This paper investigates safe reinforcement learning (RL) for…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Lucca Maitan , Lucas Toschi , Cícero Zanette , Elisa G. Vergamini , Leonardo F. Santos , Thiago Boaventura

High-mix low-volume (HMLV) industrial assembly, common in small and medium-sized enterprises (SMEs), requires the same precision, safety, and reliability as high-volume automation while remaining flexible to product variation and…

Robotics · Computer Science 2026-03-18 Jannick Stranghöner , Philipp Hartmann , Marco Braun , Sebastian Wrede , Klaus Neumann

Safe deployment of autonomous robots in diverse scenarios requires agents that are capable of efficiently adapting to new environments while satisfying constraints. In this work, we propose a practical and theoretically-justified approach…

Robotics · Computer Science 2022-02-17 Thomas Lew , Apoorva Sharma , James Harrison , Andrew Bylard , Marco Pavone