中文
相关论文

相关论文: Reactive Model Correction: Mitigating Harm to Task…

200 篇论文

Explainable AI (XAI) systems have been proposed to help people understand how AI systems produce outputs and behaviors. Explainable Reinforcement Learning (XRL) has an added complexity due to the temporal nature of sequential…

人工智能 · 计算机科学 2025-08-19 Madhuri Singh , Amal Alabdulkarim , Gennie Mansi , Mark O. Riedl

Post-hoc importance attribution methods are a popular tool for "explaining" Deep Neural Networks (DNNs) and are inherently based on the assumption that the explanations can be applied independently of how the models were trained.…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Siddhartha Gairola , Moritz Böhle , Francesco Locatello , Bernt Schiele

While deep neural network models offer unmatched classification performance, they are prone to learning spurious correlations in the data. Such dependencies on confounding information can be difficult to detect using performance metrics if…

机器学习 · 计算机科学 2023-08-09 Susu Sun , Lisa M. Koch , Christian F. Baumgartner

We propose a novel framework to solve risk-sensitive reinforcement learning (RL) problems where the agent optimises time-consistent dynamic spectral risk measures. Based on the notion of conditional elicitability, our methodology constructs…

机器学习 · 计算机科学 2023-05-02 Anthony Coache , Sebastian Jaimungal , Álvaro Cartea

Offline data are both valuable and practical resources for teaching robots complex behaviors. Ideally, learning agents should not be constrained by the scarcity of available demonstrations, but rather generalize beyond the training…

机器学习 · 计算机科学 2024-12-13 Núria Armengol Urpí , Marco Bagatella , Marin Vlastelica , Georg Martius

Compared with traditional deep learning techniques, continual learning enables deep neural networks to learn continually and adaptively. Deep neural networks have to learn new tasks and overcome forgetting the knowledge obtained from the…

机器学习 · 计算机科学 2022-02-08 Yujiang He

Safety is essential for reinforcement learning (RL) applied in real-world situations. Chance constraints are suitable to represent the safety requirements in stochastic systems. Previous chance-constrained RL methods usually have a low…

机器学习 · 计算机科学 2021-03-17 Baiyu Peng , Yao Mu , Yang Guan , Shengbo Eben Li , Yuming Yin , Jianyu Chen

To address the problem of NLP classifiers learning spurious correlations between training features and target labels, a common approach is to make the model's predictions invariant to these features. However, this can be counter-productive…

机器学习 · 计算机科学 2023-06-22 Parikshit Bansal , Amit Sharma

Deep generative models are known to produce undesirable samples such as harmful content. Traditional mitigation methods include re-training from scratch, filtering, or editing; however, these are either computationally expensive or can be…

机器学习 · 计算机科学 2024-02-22 Zhifeng Kong , Kamalika Chaudhuri

As machine learning models become increasingly prevalent in time series applications, Explainable Artificial Intelligence (XAI) methods are essential for understanding their predictions. Within XAI, feature attribution methods aim to…

机器学习 · 计算机科学 2025-10-20 Gregor Baer , Isel Grau , Chao Zhang , Pieter Van Gorp

Deep Reinforcement Learning (DRL) policies have been shown to be vulnerable to small adversarial noise in observations. Such adversarial noise can have disastrous consequences in safety-critical environments. For instance, a self-driving…

机器学习 · 计算机科学 2024-03-28 Roman Belaire , Pradeep Varakantham , Thanh Nguyen , David Lo

Generating calibrated and sharp neural network predictive distributions for regression problems is essential for optimal decision-making in many real-world applications. To address the miscalibration issue of neural networks, various…

机器学习 · 计算机科学 2024-03-19 Victor Dheur , Souhaib Ben Taieb

Deep neural networks provide Reinforcement Learning (RL) powerful function approximators to address large-scale decision-making problems. However, these approximators introduce challenges due to the non-stationary nature of RL training. One…

机器学习 · 计算机科学 2024-12-12 Hongyao Tang , Glen Berseth

In the field of explainable Artificial Intelligence (XAI), sequential counterfactual (SCF) examples are often used to alter the decision of a trained classifier by implementing a sequence of modifications to the input instance. Although…

机器学习 · 计算机科学 2023-11-02 E. Panagiotou , E. Ntoutsi

Counterfactual explanations provide human-understandable reasoning for AI-made decisions by describing minimal changes to input features that would alter a model's prediction. To be truly useful in practice, such explanations must be…

机器学习 · 计算机科学 2025-08-15 Asiful Arefeen , Shovito Barua Soumma , Hassan Ghasemzadeh

Deep learning models are known to often learn features that spuriously correlate with the class label during training but are irrelevant to the prediction task. Existing methods typically address this issue by annotating potential spurious…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Weiwei Li , Junzhuo Liu , Yuanyuan Ren , Yuchen Zheng , Yahao Liu , Wen Li

As deep neural networks(DNN) become increasingly prevalent, particularly in high-stakes areas such as autonomous driving and healthcare, the ability to detect incorrect predictions of models and intervene accordingly becomes crucial for…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Ge Yan , Tsui-Wei Weng

Deep Reinforcement Learning has enabled the learning of policies for complex tasks in partially observable environments, without explicitly learning the underlying model of the tasks. While such model-free methods achieve considerable…

机器学习 · 计算机科学 2017-01-11 Tanmay Shankar , Santosha K. Dwivedy , Prithwijit Guha

Post-training for large language models (LLMs) is constrained by the high cost of acquiring new knowledge or correcting errors and by the unintended side effects that frequently arise from retraining. To address these issues, we introduce…

计算与语言 · 计算机科学 2026-02-11 Yisu Wang , Ming Wang , Haoyuan Song , Wenjie Huang , Chaozheng Wang , Yi Xie , Xuming Ran

This paper proposes a novel framework to reinforce classification models using language-guided generated counterfactual images. Deep learning classification models are often trained using datasets that mirror real-world scenarios. In this…

计算机视觉与模式识别 · 计算机科学 2024-06-21 Xiang Li , Ren Togo , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama