中文
相关论文

相关论文: Kernel-Based Safe Exploration in Deep Reinforcemen…

200 篇论文

In Interactive Machine Learning (IML), we iteratively make decisions and obtain noisy observations of an unknown function. While IML methods, e.g., Bayesian optimization and active learning, have been successful in applications, on…

机器学习 · 计算机科学 2019-10-31 Matteo Turchetta , Felix Berkenkamp , Andreas Krause

Reinforcement learning is a powerful paradigm for learning optimal policies from experimental data. However, to find optimal policies, most reinforcement learning algorithms explore all possible actions, which may be harmful for real-world…

机器学习 · 统计学 2017-11-15 Felix Berkenkamp , Matteo Turchetta , Angela P. Schoellig , Andreas Krause

We present Revel, a partially neural reinforcement learning (RL) framework for provably safe exploration in continuous state and action spaces. A key challenge for provably safe deep RL is that repeatedly verifying neural networks within a…

机器学习 · 计算机科学 2020-10-27 Greg Anderson , Abhinav Verma , Isil Dillig , Swarat Chaudhuri

This paper presents a safe learning framework that employs an adaptive model learning algorithm together with barrier certificates for systems with possibly nonstationary agent dynamics. To extract the dynamic structure of the model, we use…

机器学习 · 计算机科学 2019-08-07 Motoya Ohnishi , Li Wang , Gennaro Notomista , Magnus Egerstedt

We consider the problem of finding optimal policies for a Markov Decision Process with almost sure constraints on state transitions and action triplets. We define value and action-value functions that satisfy a barrier-based decomposition…

机器学习 · 计算机科学 2020-12-25 Agustin Castellano , Juan Bazerque , Enrique Mallada

There have been numerous advances in reinforcement learning, but the typically unconstrained exploration of the learning process prevents the adoption of these methods in many safety critical applications. Recent work in safe reinforcement…

机器学习 · 计算机科学 2019-10-02 David Isele , Alireza Nakhaei , Kikuo Fujimura

Deep neural policies have recently been installed in a diverse range of settings, from biotechnology to automated financial systems. However, the utilization of deep neural networks to approximate the value function leads to concerns on the…

机器学习 · 计算机科学 2024-06-26 Ezgi Korkmaz

Motivated by applications, we consider here new operator theoretic approaches to Conditional mean embeddings (CME). Our present results combine a spectral analysis-based optimization scheme with the use of kernels, stochastic processes, and…

机器学习 · 计算机科学 2023-05-16 Palle E. T. Jorgensen , Myung-Sin Song , James Tian

Reinforcement learning (RL) has achieved promising results on most robotic control tasks. Safety of learning-based controllers is an essential notion of ensuring the effectiveness of the controllers. Current methods adopt whole consistency…

机器人学 · 计算机科学 2023-07-31 Haotian Xu , Shengjie Wang , Zhaolei Wang , Yunzhe Zhang , Qing Zhuo , Yang Gao , Tao Zhang

In classical reinforcement learning, when exploring an environment, agents accept arbitrary short term loss for long term gain. This is infeasible for safety critical applications, such as robotics, where even a single unsafe action may…

机器学习 · 计算机科学 2017-01-30 Matteo Turchetta , Felix Berkenkamp , Andreas Krause

This paper aims to provide an innovative machine learning-based solution to automate security testing tasks for web applications, ensuring the correct functioning of all components while reducing project maintenance costs. Reinforcement…

In this paper, we consider a way to safely navigate the robots in unknown environments using measurement data from sensory devices. The control barrier function (CBF) is one of the promising approaches to encode safety requirements of the…

系统与控制 · 电气工程与系统科学 2023-08-11 Wataru Hashimoto , Kazumune Hashimoto , Akifumi Wachi , Xun Shen , Masako Kishida , Shigemasa Takai

The lack of a large amount of training data has always been the constraining factor in solving a lot of problems in machine learning, making One Shot Learning one of the most intriguing ideas in machine learning. It aims to learn…

机器学习 · 计算机科学 2020-09-22 Shruti Jadon , Aditya Acrot Srinivasan

We propose an iterative method to safely learn the unmodeled dynamics of a nonlinear system using Bayesian Gaussian process (GP) models with polynomial kernel functions. The method maintains safety by ensuring that the system state stays…

系统与控制 · 电气工程与系统科学 2020-04-03 Alex Devonport , He Yin , Murat Arcak

One of the bottlenecks preventing Deep Reinforcement Learning algorithms (DRL) from real-world applications is how to explore the environment and collect informative transitions efficiently. The present paper describes bounded exploration,…

机器学习 · 计算机科学 2024-12-10 Ting Qiao , Henry Williams , David Valencia , Bruce MacDonald

Exploration is essential for reinforcement learning (RL). To face the challenges of exploration, we consider a reward-free RL framework that completely separates exploration from exploitation and brings new challenges for exploration…

机器学习 · 计算机科学 2020-12-11 Chuheng Zhang , Yuanying Cai , Longbo Huang , Jian Li

Control Barrier Functions (CBFs) provide an elegant framework for constraining nonlinear control system dynamics to remain within an invariant subset of a designated safe set. However, identifying a CBF that balances performance-by…

机器学习 · 计算机科学 2024-11-05 Lakshmideepakreddy Manda , Shaoru Chen , Mahyar Fazlyab

Safety is a fundamental requirement for autonomous systems operating in critical domains. Control barrier functions (CBFs) have been used to design safety filters that minimally alter nominal controls for such systems to maintain their…

人工智能 · 计算机科学 2025-10-27 Yuxuan Yang , Hussein Sibai

We present a novel kernel-based machine learning algorithm for identifying the low-dimensional geometry of the effective dynamics of high-dimensional multiscale stochastic systems. Recently, the authors developed a mathematical framework…

Functional encryption (FE) is a versatile paradigm that enables fine-grained access control over encrypted data. Despite its potential, achieving the gold standard of simulation-based security for FE is impossible in full generality. Known…

密码学与安全 · 计算机科学 2026-03-25 Mohammed Barhoush , Louis Salvail