中文
相关论文

相关论文: Is it the model or the metric -- On robustness mea…

200 篇论文

This paper studies the robustness of feature attribution methods for deep neural networks. It challenges the current notion of attributional robustness that largely ignores the difference in the model's outputs and introduces a new way of…

机器学习 · 计算机科学 2025-12-09 Panagiota Kiourti , Anu Singh , Preeti Duraipandian , Weichao Zhou , Wenchao Li

Deep learning (DL) has demonstrated significant potential across various safety-critical applications, yet ensuring its robustness remains a key challenge. While adversarial robustness has been extensively studied in worst-case scenarios,…

机器学习 · 计算机科学 2025-03-11 Xingyu Zhao

Neural network models have become the leading solution for a large variety of tasks, such as classification, language processing, protein folding, and others. However, their reliability is heavily plagued by adversarial inputs: small input…

机器学习 · 计算机科学 2022-10-04 Natan Levy , Guy Katz

We argue that the vulnerability of model parameters is of crucial value to the study of model robustness and generalization but little research has been devoted to understanding this matter. In this work, we propose an indicator to measure…

机器学习 · 计算机科学 2020-12-11 Xu Sun , Zhiyuan Zhang , Xuancheng Ren , Ruixuan Luo , Liangyou Li

Reinforcement learning has received significant interest in recent years, due primarily to the successes of deep reinforcement learning at solving many challenging tasks such as playing Chess, Go and online computer games. However, with the…

机器学习 · 计算机科学 2022-03-24 Laura L. Pullum

Robustness to noise is of utmost importance in reinforcement learning systems, particularly in military contexts where high stakes and uncertain environments prevail. Noise and uncertainty are inherent features of military operations,…

机器学习 · 计算机科学 2023-11-16 Lorenzo Nodari , Federico Cerutti

With the advancement of large language models (LLMs), an increasing number of student models have leveraged LLMs to analyze textual artifacts generated by students to understand and evaluate their learning. These student models typically…

计算与语言 · 计算机科学 2025-02-03 Jiayi Zhang

Trustworthy verifiers are essential for the success of reinforcement learning with verifiable reward (RLVR), which is the core methodology behind various large reasoning models such as DeepSeek-R1. In complex domains like mathematical…

机器学习 · 计算机科学 2025-10-08 Yuzhen Huang , Weihao Zeng , Xingshan Zeng , Qi Zhu , Junxian He

Deep neural networks (DNNs), are widely used in many industries such as image recognition, supply chain, medical diagnosis, and autonomous driving. However, prior work has shown the high accuracy of a DNN model does not imply high…

机器学习 · 计算机科学 2022-11-28 Guanqin Zhang , Jiankun Sun , Feng Xu , H. M. N. Dilum Bandara , Shiping Chen , Yulei Sui , Tim Menzies

In this study, we leverage the deliberate and systematic fault-injection capabilities of an open-source benchmark suite to perform a series of experiments on state-of-the-art deep and robust reinforcement learning algorithms. We aim to…

机器人学 · 计算机科学 2022-10-28 Catherine R. Glossop , Jacopo Panerati , Amrit Krishnan , Zhaocong Yuan , Angela P. Schoellig

Many methods of estimating causal models do not provide estimates of confidence in the resulting model. In this work, a metric is proposed for validating the output of a causal model fit; the robustness of the model structure with resampled…

Deep neural networks (DNNs) are highly susceptible to adversarial samples, raising concerns about their reliability in safety-critical tasks. Currently, methods of evaluating adversarial robustness are primarily categorized into…

机器学习 · 计算机科学 2025-05-27 Jialei Song , Xingquan Zuo , Feiyang Wang , Hai Huang , Tianle Zhang

Successful deep learning models often involve training neural network architectures that contain more parameters than the number of training samples. Such overparametrized models have been extensively studied in recent years, and the…

机器学习 · 计算机科学 2024-02-02 Hamed Hassani , Adel Javanmard

Machine learning has demonstrated remarkable performance over finite datasets, yet whether the scores over the fixed benchmarks can sufficiently indicate the model's performance in the real world is still in discussion. In reality, an ideal…

计算机视觉与模式识别 · 计算机科学 2024-05-17 Peiyan Zhang , Haoyang Liu , Chaozhuo Li , Xing Xie , Sunghun Kim , Haohan Wang

Cyber-Physical Systems (CPS) in domains such as manufacturing and energy distribution generate complex time series data crucial for Prognostics and Health Management (PHM). While Deep Learning (DL) methods have demonstrated strong…

机器学习 · 计算机科学 2025-12-16 Alexander Windmann , Henrik Steude , Daniel Boschmann , Oliver Niggemann

Reliability quantification of deep reinforcement learning (DRL)-based control is a significant challenge for the practical application of artificial intelligence (AI) in safety-critical systems. This study proposes a method for quantifying…

系统与控制 · 电气工程与系统科学 2024-07-22 Hitoshi Yoshioka , Hirotada Hashimoto

Discrete-time random walks and their extensions are common tools for analyzing animal movement data. In these analyses, resolution of temporal discretization is a critical feature. Ideally, a model both mirrors the relevant temporal scale…

定量方法 · 定量生物学 2015-08-27 Ulrike E. Schlägel , Mark A. Lewis

Large Language Models (LLMs) have emerged as a promising cornerstone for the development of natural language processing (NLP) and artificial intelligence (AI). However, ensuring the robustness of LLMs remains a critical challenge. To…

计算与语言 · 计算机科学 2025-11-07 Pankaj Kumar , Subhankar Mishra

Robust reinforcement learning (RL) is to find a policy that optimizes the worst-case performance over an uncertainty set of MDPs. In this paper, we focus on model-free robust RL, where the uncertainty set is defined to be centering at a…

机器学习 · 计算机科学 2021-10-29 Yue Wang , Shaofeng Zou

We consider the problem of distributionally robust multimodal machine learning. Existing approaches often rely on merging modalities on the feature level (early fusion) or heuristic uncertainty modeling, which downplays modality-aware…

机器学习 · 计算机科学 2025-11-11 Peilin Yang , Yu Ma