中文
相关论文

相关论文: From Raw Data to Safety: Reducing Conservatism by …

200 篇论文

Distribution shift is a major obstacle in offline reinforcement learning, which necessitates minimizing the discrepancy between the learned policy and the behavior policy to avoid overestimating rare or unseen actions. Previous conservative…

机器学习 · 计算机科学 2024-06-12 Zeyuan Liu , Kai Yang , Xiu Li

Learning from human demonstrations can facilitate automation but is risky because the execution of the learned policy might lead to collisions and other failures. Adding explicit constraints to avoid unsafe states is generally not possible…

机器人学 · 计算机科学 2018-10-17 Jonathan Lee , Michael Laskey , Roy Fox , Ken Goldberg

Reinforcement learning algorithms typically necessitate extensive exploration of the state space to find optimal policies. However, in safety-critical applications, the risks associated with such exploration can lead to catastrophic…

机器学习 · 计算机科学 2025-02-28 Kaustubh Mani , Vincent Mai , Charlie Gauthier , Annie Chen , Samer Nashed , Liam Paull

Large-scale supervised classification algorithms, especially those based on deep convolutional neural networks (DCNNs), require vast amounts of training data to achieve state-of-the-art performance. Decreasing this data requirement would…

计算机视觉与模式识别 · 计算机科学 2016-06-15 Maya Kabkab , Azadeh Alavi , Rama Chellappa

Current AI/ML methods for data-driven engineering use models that are mostly trained offline. Such models can be expensive to build in terms of communication and computing cost, and they rely on data that is collected over extended periods…

机器学习 · 计算机科学 2021-12-16 Xiaoxuan Wang , Rolf Stadler

This paper prescribes a suite of techniques for off-policy Reinforcement Learning (RL) that simplify the training process and reduce the sample complexity. First, we show that simple Deterministic Policy Gradient works remarkably well as…

机器学习 · 计算机科学 2020-06-30 Rasool Fakoor , Pratik Chaudhari , Alexander J. Smola

Semi-Supervised Learning (SSL) has become a preferred paradigm in many deep learning tasks, which reduces the need for human labor. Previous studies primarily focus on effectively utilising the labelled and unlabeled data to improve…

机器学习 · 计算机科学 2024-10-29 Qian Shao , Jiangrui Kang , Qiyuan Chen , Zepeng Li , Hongxia Xu , Yiwen Cao , Jiajuan Liang , Jian Wu

Flow-based generative models, such as diffusion models and flow matching models, have achieved remarkable success in learning complex data distributions. However, a critical gap remains for their deployment in safety-critical domains: the…

机器学习 · 计算机科学 2026-03-02 Darshan Gadginmath , Ahmed Allibhoy , Fabio Pasqualetti

Deploying reinforcement learning agents in the real world can be challenging due to the risks associated with learning through trial and error. We propose a task-agnostic method that leverages small sets of safe and unsafe demonstrations to…

机器学习 · 计算机科学 2023-05-09 André Correia , Luís Alexandre

Deep Reinforcement Learning (DRL) algorithms have recently made significant strides in improving network performance. Nonetheless, their practical use is still limited in the absence of safe exploration and safe decision-making. In the…

网络与互联网体系结构 · 计算机科学 2024-01-12 Lam Dinh , Pham Tran Anh Quang , Jérémie Leguay

Supervised fine-tuning (SFT) is computationally efficient but often yields inferior generalization compared to reinforcement learning (RL). This gap is primarily driven by RL's use of on-policy data. We propose a framework to bridge this…

机器学习 · 计算机科学 2026-03-17 Miaosen Zhang , Yishan Liu , Shuxia Lin , Xu Yang , Qi Dai , Chong Luo , Weihao Jiang , Peng Hou , Anxiang Zeng , Xin Geng , Baining Guo

Learning-based control approaches have shown great promise in performing complex tasks directly from high-dimensional perception data for real robotic systems. Nonetheless, the learned controllers can behave unexpectedly if the trajectories…

机器人学 · 计算机科学 2023-01-31 Fernando Castañeda , Haruki Nishimura , Rowan McAllister , Koushil Sreenath , Adrien Gaidon

Control tasks with safety requirements under high levels of model uncertainty are increasingly common. Machine learning techniques are frequently used to address such tasks, typically by leveraging model error bounds to specify robust…

机器人学 · 计算机科学 2025-06-13 Alexandre Capone , Ryan Cosner , Aaaron Ames , Sandra Hirche

Learning policy from offline datasets through offline reinforcement learning (RL) holds promise for scaling data-driven decision-making while avoiding unsafe and costly online interactions. However, real-world data collected from sensors or…

机器学习 · 计算机科学 2025-03-04 Jiawei Xu , Rui Yang , Shuang Qiu , Feng Luo , Meng Fang , Baoxiang Wang , Lei Han

Model Predictive Control (MPC) is effective at generating safe control strategies in constrained scenarios, at the cost of computational complexity. This is especially the case in robots that require high sampling rates and have limited…

机器人学 · 计算机科学 2024-09-24 John Viljoen , Wenceslao Shaw Cortez , Jan Drgona , Sebastian East , Masayoshi Tomizuka , Draguna Vrabie

Safe reinforcement learning (RL) with assured satisfaction of hard state constraints during training has recently received a lot of attention. Safety filters, e.g., based on control barrier functions (CBFs), provide a promising way for safe…

机器人学 · 计算机科学 2023-08-30 Yikun Cheng , Pan Zhao , Naira Hovakimyan

The paradigm of decision-making has been revolutionised by reinforcement learning and deep learning. Although this has led to significant progress in domains such as robotics, healthcare, and finance, the use of RL in practice is…

机器学习 · 计算机科学 2026-02-23 Daqian Shao

Recent advances in reinforcement learning (RL) enable its use on increasingly complex tasks, but the lack of formal safety guarantees still limits its application in safety-critical settings. A common practical approach is to augment the RL…

机器学习 · 计算机科学 2026-02-12 Donggeon David Oh , Duy P. Nguyen , Haimin Hu , Jaime F. Fisac

Policy iteration is one of the classical frameworks of reinforcement learning, which requires a known initial stabilizing control. However, finding the initial stabilizing control depends on the known system model. To relax this requirement…

系统与控制 · 电气工程与系统科学 2025-03-20 Dongdong Li , Jiuxiang Dong

This paper introduces a novel two-stage framework for online mitigation of False Data Injection (FDI) signals to improve the resiliency of Networked Control Systems (NCSs) and ensure their safe operation in the presence of malicious…

系统与控制 · 电气工程与系统科学 2025-10-21 Mohammadamin Lari