中文
相关论文

相关论文: Is it the model or the metric -- On robustness mea…

200 篇论文

Robustness of machine learning models to various adversarial and non-adversarial corruptions continues to be of interest. In this paper, we introduce the notion of the boundary thickness of a classifier, and we describe its connection with…

Adversarial perturbations are imperceptible changes to input pixels that can change the prediction of deep learning models. Learned weights of models robust to such perturbations are previously found to be transferable across different…

机器学习 · 计算机科学 2020-10-30 Alvin Chan , Yi Tay , Yew-Soon Ong

Robustness to adversarial attacks is typically evaluated with adversarial accuracy. While essential, this metric does not capture all aspects of robustness and in particular leaves out the question of how many perturbations can be found for…

机器学习 · 计算机科学 2023-08-14 Raphael Olivier , Bhiksha Raj

Explainability has been widely stated as a cornerstone of the responsible and trustworthy use of machine learning models. With the ubiquitous use of Deep Neural Network (DNN) models expanding to risk-sensitive and safety-critical domains,…

Recently, we have witnessed the bloom of neural ranking models in the information retrieval (IR) field. So far, much effort has been devoted to developing effective neural ranking models that can generalize well on new data. There has been…

信息检索 · 计算机科学 2022-05-20 Chen Wu , Ruqing Zhang , Jiafeng Guo , Yixing Fan , Xueqi Cheng

With the introduction of machine learning in high-stakes decision making, ensuring algorithmic fairness has become an increasingly important problem to solve. In response to this, many mathematical definitions of fairness have been…

机器学习 · 计算机科学 2024-06-04 Edward Small , Wei Shao , Zeliang Zhang , Peihan Liu , Jeffrey Chan , Kacper Sokol , Flora Salim

Catastrophic interference is common in many network-based learning systems, and many proposals exist for mitigating it. Before overcoming interference we must understand it better. In this work, we provide a definition and novel measure of…

机器学习 · 计算机科学 2023-07-12 Vincent Liu , Han Wang , Ruo Yu Tao , Khurram Javed , Adam White , Martha White

Recent research has highlighted a critical issue known as ``robust fairness", where robust accuracy varies significantly across different classes, undermining the reliability of deep neural networks (DNNs). A common approach to address this…

机器学习 · 计算机科学 2025-01-24 Gaojie Jin , Sihao Wu , Jiaxu Liu , Tianjin Huang , Ronghui Mu

Deep neural networks give state-of-the-art accuracy for reconstructing images from few and noisy measurements, a problem arising for example in accelerated magnetic resonance imaging (MRI). However, recent works have raised concerns that…

图像与视频处理 · 电气工程与系统科学 2021-06-14 Mohammad Zalbagi Darestani , Akshay S. Chaudhari , Reinhard Heckel

Neural networks are known to be highly sensitive to adversarial examples. These may arise due to different factors, such as random initialization, or spurious correlations in the learning problem. To better understand these factors, we…

机器学习 · 统计学 2022-07-05 Elvis Dohmatob , Alberto Bietti

We derive generalization bounds for learning algorithms based on their robustness: the property that if a testing sample is "similar" to a training sample, then the testing error is close to the training error. This provides a novel…

机器学习 · 计算机科学 2015-03-17 Huan Xu , Shie Mannor

Deep Reinforcement Learning (DRL) is a subfield of machine learning for training autonomous agents that take sequential actions across complex environments. Despite its significant performance in well-known environments, it remains…

Deep Reinforcement Learning (DRL) is considered a potential framework to improve many real-world autonomous systems; it has attracted the attention of multiple and diverse fields. Nevertheless, the successful deployment in the real world is…

机器学习 · 计算机科学 2021-07-08 Juan Jose Garau-Luis , Edward Crawley , Bruce Cameron

Deep Reinforcement Learning has shown great success in a variety of control tasks. However, it is unclear how close we are to the vision of putting Deep RL into practice to solve real world problems. In particular, common practice in the…

机器学习 · 计算机科学 2019-02-21 Chenyang Zhao , Olivier Sigaud , Freek Stulp , Timothy M. Hospedales

The ability to learn disentangled representations that split underlying sources of variation in high dimensional, unstructured data is important for data efficient and robust use of neural networks. While various approaches aiming towards…

机器学习 · 统计学 2019-05-15 Raphael Suter , Đorđe Miladinović , Bernhard Schölkopf , Stefan Bauer

We introduce Harmonic Robustness, a powerful and intuitive method to test the robustness of any machine-learning model either during training or in black-box real-time inference monitoring without ground-truth labels. It is based on…

机器学习 · 计算机科学 2024-04-30 Nicholas S. Kersting , Yi Li , Aman Mohanty , Oyindamola Obisesan , Raphael Okochu

The pursuit of robustness has recently been a popular topic in reinforcement learning (RL) research, yet the existing methods generally suffer from efficiency issues that obstruct their real-world implementation. In this paper, we introduce…

机器学习 · 计算机科学 2024-04-15 Yang Hu , Haitong Ma , Bo Dai , Na Li

Reinforcement learning (RL) is a branch of machine learning which is employed to solve various sequential decision making problems without proper supervision. Due to the recent advancement of deep learning, the newly proposed Deep-RL…

人工智能 · 计算机科学 2019-04-17 Dhruv Ramani

Our goal is to improve reliability of Machine Learning (ML) systems deployed in the wild. ML models perform exceedingly well when test examples are similar to train examples. However, real-world applications are required to perform on any…

机器学习 · 计算机科学 2023-03-07 Vihari Piratla

The integration of deep learning to reinforcement learning (RL) has enabled RL to perform efficiently in high-dimensional environments. Deep RL methods have been applied to solve many complex real-world problems in recent years. However,…

机器学习 · 计算机科学 2021-02-24 Ngoc Duy Nguyen , Thanh Thi Nguyen , Hai Nguyen , Doug Creighton , Saeid Nahavandi