中文
相关论文

相关论文: Rethinking Robustness: A New Approach to Evaluatin…

200 篇论文

Neural networks are known to be vulnerable to adversarial attacks -- slight but carefully constructed perturbations of the inputs which can drastically impair the network's performance. Many defense methods have been proposed for improving…

Feature attribution methods are popular in interpretable machine learning. These methods compute the attribution of each input feature to represent its importance, but there is no consensus on the definition of "attribution", leading to…

机器学习 · 计算机科学 2021-12-16 Yilun Zhou , Serena Booth , Marco Tulio Ribeiro , Julie Shah

We evaluate the robustness of several large language models on multiple datasets. Robustness here refers to the relative insensitivity of the model's answers to meaning-preserving variants of their input. Benchmark datasets are constructed…

计算与语言 · 计算机科学 2024-11-05 Samuel Ackerman , Ella Rabinovich , Eitan Farchi , Ateret Anaby-Tavor

The robustness of deep neural networks is usually lacking under adversarial examples, common corruptions, and distribution shifts, which becomes an important research problem in the development of deep learning. Although new deep learning…

计算机视觉与模式识别 · 计算机科学 2023-03-01 Chang Liu , Yinpeng Dong , Wenzhao Xiang , Xiao Yang , Hang Su , Jun Zhu , Yuefeng Chen , Yuan He , Hui Xue , Shibao Zheng

Neural network models have become the leading solution for a large variety of tasks, such as classification, language processing, protein folding, and others. However, their reliability is heavily plagued by adversarial inputs: small input…

机器学习 · 计算机科学 2022-10-04 Natan Levy , Guy Katz

Deep neural networks (DNNs) are increasingly used in real-world applications (e.g. facial recognition). This has resulted in concerns about the fairness of decisions made by these models. Various notions and measures of fairness have been…

机器学习 · 计算机科学 2021-01-22 Vedant Nanda , Samuel Dooley , Sahil Singla , Soheil Feizi , John P. Dickerson

The robustness of deep neural networks (DNNs) against adversarial attacks has been studied extensively in hopes of both better understanding how deep learning models converge and in order to ensure the security of these models in…

机器学习 · 计算机科学 2023-07-11 Jovon Craig , Josh Andle , Theodore S. Nowak , Salimeh Yasaei Sekeh

Over the past decade, numerous theories have been proposed to explain the widespread vulnerability of deep neural networks to adversarial evasion attacks. Among these, the theory of non-robust features proposed by Ilyas et al. has been…

机器学习 · 计算机科学 2026-01-05 Jennifer Crawford , Amol Khanna , Fred Lu , Amy R. Wagoner , Stella Biderman , Andre T. Nguyen , Edward Raff

To better understand the output of deep neural networks (DNN), attribution based methods have been an important approach for model interpretability, which assign a score for each input dimension to indicate its importance towards the model…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Zhiyu Zhu , Huaming Chen , Jiayu Zhang , Xinyi Wang , Zhibo Jin , Minhui Xue , Dongxiao Zhu , Kim-Kwang Raymond Choo

Recent research studies revealed that neural networks are vulnerable to adversarial attacks. State-of-the-art defensive techniques add various adversarial examples in training to improve models' adversarial robustness. However, these…

机器学习 · 计算机科学 2019-09-13 Chang Song , Zuoguan Wang , Hai Li

Source code attribution approaches have achieved remarkable accuracy thanks to the rapid advances in deep learning. However, recent studies shed light on their vulnerability to adversarial attacks. In particular, they can be easily deceived…

机器学习 · 计算机科学 2022-03-01 Yizhen Wang , Mohannad Alhanahnah , Ke Wang , Mihai Christodorescu , Somesh Jha

Vulnerability to adversarial attacks is a well-known weakness of Deep Neural networks. While most of the studies focus on single-task neural networks with computer vision datasets, very little research has considered complex multi-task…

机器学习 · 计算机科学 2021-10-29 Salah Ghamizi , Maxime Cordy , Mike Papadakis , Yves Le Traon

Recent studies have shown that modern deep neural network classifiers are easy to fool, assuming that an adversary is able to slightly modify their inputs. Many papers have proposed adversarial attacks, defenses and methods to measure…

机器学习 · 计算机科学 2020-03-17 Igor Buzhinsky , Arseny Nerinovsky , Stavros Tripakis

Adversarial examples are inevitable on the road of pervasive applications of deep neural networks (DNN). Imperceptible perturbations applied on natural samples can lead DNN-based classifiers to output wrong prediction with fair confidence…

机器学习 · 计算机科学 2020-11-04 Tao Bai , Jinqi Luo , Jun Zhao

Transfer learning, in which a network is trained on one task and re-purposed on another, is often used to produce neural network classifiers when data is scarce or full-scale training is too costly. When the goal is to produce a model that…

机器学习 · 计算机科学 2020-02-24 Ali Shafahi , Parsa Saadatpanah , Chen Zhu , Amin Ghiasi , Christoph Studer , David Jacobs , Tom Goldstein

In deep learning applications, robustness measures the ability of neural models that handle slight changes in input data, which could lead to potential safety hazards, especially in safety-critical applications. Pre-deployment assessment of…

软件工程 · 计算机科学 2024-04-26 Wenchuan Mu , Kwan Hui Lim

Representation learning, i.e. the generation of representations useful for downstream applications, is a task of fundamental importance that underlies much of the success of deep neural networks (DNNs). Recently, robustness to adversarial…

机器学习 · 计算机科学 2022-09-16 Christian Cianfarani , Arjun Nitin Bhagoji , Vikash Sehwag , Ben Y. Zhao , Prateek Mittal , Haitao Zheng

Neural networks have been widely applied in security applications such as spam and phishing detection, intrusion prevention, and malware detection. This black-box method, however, often has uncertainty and poor explainability in…

密码学与安全 · 计算机科学 2022-10-12 Mark Huasong Meng , Guangdong Bai , Sin Gee Teo , Zhe Hou , Yan Xiao , Yun Lin , Jin Song Dong

Recent work has found that adversarially-robust deep networks used for image classification are more interpretable: their feature attributions tend to be sharper, and are more concentrated on the objects associated with the image's…

机器学习 · 计算机科学 2021-10-07 Zifan Wang , Matt Fredrikson , Anupam Datta

Deep neural networks (DNNs) are highly susceptible to adversarial samples, raising concerns about their reliability in safety-critical tasks. Currently, methods of evaluating adversarial robustness are primarily categorized into…

机器学习 · 计算机科学 2025-05-27 Jialei Song , Xingquan Zuo , Feiyang Wang , Hai Huang , Tianle Zhang