中文
相关论文

相关论文: Risk Sensitive Dead-end Identification in Safety-C…

200 篇论文

Out-of-distribution (OOD) detection remains challenging for deep learning models, particularly when test-time OOD samples differ significantly from training outliers. We propose OODD, a novel test-time OOD detection method that dynamically…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Yifeng Yang , Lin Zhu , Zewen Sun , Hengyu Liu , Qinying Gu , Nanyang Ye

Distributed DNN inference is becoming increasingly important as the demand for intelligent services at the network edge grows. By leveraging the power of distributed computing, edge devices can perform complicated and resource-hungry…

分布式、并行与集群计算 · 计算机科学 2025-02-25 Xian Peng , Xin Wu , Lianming Xu , Li Wang , Aiguo Fei

Extreme weather frequently cause widespread outages in distribution systems (DSs), demonstrating the importance of hardening strategies for resilience enhancement. However, the well-utilization of real-world outage data with associated…

系统与控制 · 电气工程与系统科学 2025-10-06 Wenlong Shi , Hongyi Li , Zhaoyu Wang

We study offline meta-reinforcement learning, a practical reinforcement learning paradigm that learns from offline data to adapt to new tasks. The distribution of offline data is determined jointly by the behavior policy and the task.…

机器学习 · 计算机科学 2022-06-22 Haoqi Yuan , Zongqing Lu

Extreme events are occurrences whose magnitude and potential cause extensive damage on people, infrastructure, and the environment. Motivated by the extreme nature of the current global health landscape, which is plagued by the coronavirus…

机器学习 · 计算机科学 2021-06-14 Nhuong V. Nguyen , Sybille Legitime

We consider the offline reinforcement learning (RL) setting where the agent aims to optimize the policy solely from the data without further environment interactions. In offline RL, the distributional shift becomes the primary source of…

机器学习 · 计算机科学 2021-06-22 Jongmin Lee , Wonseok Jeon , Byung-Jun Lee , Joelle Pineau , Kee-Eung Kim

Offline reinforcement learning (RL) enables agents to learn policies from fixed datasets, avoiding costly or unsafe environment interactions. However, its effectiveness is often limited by dataset sparsity and the lack of transition overlap…

人工智能 · 计算机科学 2025-07-22 Lu Guo , Yixiang Shan , Zhengbang Zhu , Qifan Liang , Lichang Song , Ting Long , Weinan Zhang , Yi Chang

This paper tackles the problem of mitigating catastrophic risk (which is risk with very low frequency but very high severity) in the context of a sequential decision making process. This problem is particularly challenging due to the…

机器学习 · 计算机科学 2024-07-01 Parisa Davar , Frédéric Godin , Jose Garrido

The safety of learning-enabled cyber-physical systems is compromised by the well-known vulnerabilities of deep neural networks to out-of-distribution (OOD) inputs. Existing literature has sought to monitor the safety of such systems by…

We study the estimation of risk-sensitive policies in reinforcement learning problems defined by a Markov Decision Process (MDPs) whose state and action spaces are countably finite. Prior efforts are predominately afflicted by computational…

机器学习 · 统计学 2020-03-02 Junyu Zhang , Amrit Singh Bedi , Mengdi Wang , Alec Koppel

Neural ordinary differential equations (NODE) have been proposed as a continuous depth generalization to popular deep learning models such as Residual networks (ResNets). They provide parameter efficiency and automate the model selection…

机器学习 · 计算机科学 2021-12-24 Srinivas Anumasa , P. K. Srijith

Detecting out-of-distribution (OOD) data is a fundamental challenge in the deployment of machine learning models. From a security standpoint, this is particularly important because OOD test data can result in misleadingly confident yet…

机器学习 · 计算机科学 2025-02-25 Onat Gungor , Amanda Sofie Rios , Nilesh Ahuja , Tajana Rosing

Due to the inability to interact with the environment, offline reinforcement learning (RL) methods face the challenge of estimating the Out-of-Distribution (OOD) points. Existing methods for addressing this issue either control policy to…

机器学习 · 计算机科学 2024-03-06 Jing Zhang , Chi Zhang , Wenjia Wang , Bing-Yi Jing

Commonly used AI networks are very self-confident in their predictions, even when the evidence for a certain decision is dubious. The investigation of a deep learning model output is pivotal for understanding its decision processes and…

计算机视觉与模式识别 · 计算机科学 2022-11-08 Damian Matuszewski , Ida-Maria Sintorn

Out-of-distribution (OOD) detection is critical for ensuring the reliability of deep learning systems, particularly in safety-critical applications. Likelihood-based deep generative models have historically faced criticism for their…

Neural ordinary differential equations (NODE) have been proposed as a continuous depth generalization to popular deep learning models such as Residual networks (ResNets). They provide parameter efficiency and automate the model selection…

机器学习 · 计算机科学 2021-12-24 Srinivas Anumasa , P. K. Srijith

Many reinforcement learning (RL) problems in practice are offline, learning purely from observational data. A key challenge is how to ensure the learned policy is safe, which requires quantifying the risk associated with different actions.…

机器学习 · 计算机科学 2021-10-28 Yecheng Jason Ma , Dinesh Jayaraman , Osbert Bastani

An important problem that arises in reinforcement learning and Monte Carlo methods is estimating quantities defined by the stationary distribution of a Markov chain. In many real-world applications, access to the underlying transition…

机器学习 · 统计学 2020-02-24 Ruiyi Zhang , Bo Dai , Lihong Li , Dale Schuurmans

Out-of-distribution (OOD) data poses serious challenges in deployed machine learning models as even subtle changes could incur significant performance drops. Being able to estimate a model's performance on test data is important in practice…

机器学习 · 计算机科学 2023-02-13 Yuzhe Lu , Zhenlin Wang , Runtian Zhai , Soheil Kolouri , Joseph Campbell , Katia Sycara

Detecting Out-of-Distribution (OOD) samples in real world visual applications like classification or object detection has become a necessary precondition in today's deployment of Deep Learning systems. Many techniques have been proposed, of…

计算机视觉与模式识别 · 计算机科学 2022-08-24 Abhishek Joshi , Sathish Chalasani , Kiran Nanjunda Iyer