中文
相关论文

相关论文: Local Competition and Stochasticity for Adversaria…

200 篇论文

Robustness is a key requirement for widespread deployment of machine learning algorithms, and has received much attention in both statistics and computer science. We study a natural model of robustness for high-dimensional statistical…

机器学习 · 计算机科学 2020-06-03 Pranjal Awasthi , Xue Chen , Aravindan Vijayaraghavan

Robustness in deep neural networks and machine learning algorithms in general is an open research challenge. In particular, it is difficult to ensure algorithmic performance is maintained on out-of-distribution inputs or anomalous instances…

机器学习 · 计算机科学 2022-11-23 Natalie Abreu , Nathan Vaska , Victoria Helus

We develop an efficient algorithm for weak recovery in a robust version of the stochastic block model. The algorithm matches the statistical guarantees of the best known algorithms for the vanilla version of the stochastic block model. In…

机器学习 · 计算机科学 2021-11-17 Jingqiu Ding , Tommaso d'Orsi , Rajai Nasser , David Steurer

Recent works have shown the effectiveness of randomized smoothing as a scalable technique for building neural network-based classifiers that are provably robust to $\ell_2$-norm adversarial perturbations. In this paper, we employ…

机器学习 · 计算机科学 2020-01-13 Hadi Salman , Greg Yang , Jerry Li , Pengchuan Zhang , Huan Zhang , Ilya Razenshteyn , Sebastien Bubeck

Intentionally crafted adversarial samples have effectively exploited weaknesses in deep neural networks. A standard method in adversarial robustness assumes a framework to defend against samples crafted by minimally perturbing a sample such…

机器学习 · 计算机科学 2022-11-07 Anaelia Ovalle , Evan Czyzycki , Cho-Jui Hsieh

The vulnerability of deep neural networks to adversarial examples has motivated an increasing number of defense strategies for promoting model robustness. However, the progress is usually hampered by insufficient robustness evaluations. As…

机器学习 · 计算机科学 2021-10-19 Xiao Yang , Yinpeng Dong , Wenzhao Xiang , Tianyu Pang , Hang Su , Jun Zhu

This work studies the adversarial robustness of parametric functions composed of a linear predictor and a non-linear representation map. % that satisfies certain stability condition. Our analysis relies on \emph{sparse local Lipschitzness}…

机器学习 · 计算机科学 2023-03-07 Ramchandran Muthukumar , Jeremias Sulam

Distributional assumptions have been shown to be necessary for the robust learnability of concept classes when considering the exact-in-the-ball robust risk and access to random examples by Gourdeau et al. (2019). In this paper, we study…

机器学习 · 计算机科学 2023-07-21 Pascale Gourdeau , Varun Kanade , Marta Kwiatkowska , James Worrell

Recent studies demonstrate that deep networks, even robustified by the state-of-the-art adversarial training (AT), still suffer from large robust generalization gaps, in addition to the much more expensive training costs than standard…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Tianlong Chen , Zhenyu Zhang , Pengjun Wang , Santosh Balachandra , Haoyu Ma , Zehao Wang , Zhangyang Wang

We show that for unconstrained Deep Linear Discriminant Analysis (LDA) classifiers, maximum-likelihood training admits pathological solutions in which class means drift together, covariances collapse, and the learned representation becomes…

机器学习 · 统计学 2026-01-06 Maxat Tezekbayev , Rustem Takhanov , Arman Bolatov , Zhenisbek Assylbekov

We identify fragile and robust neurons of deep learning architectures using nodal dropouts of the first convolutional layer. Using an adversarial targeting algorithm, we correlate these neurons with the distribution of adversarial attacks…

机器学习 · 计算机科学 2022-02-01 Chandresh Pravin , Ivan Martino , Giuseppe Nicosia , Varun Ojha

Adversarial robustness studies the worst-case performance of a machine learning model to ensure safety and reliability. With the proliferation of deep-learning-based technology, the potential risks associated with model development and…

机器学习 · 计算机科学 2023-01-06 Pin-Yu Chen , Sijia Liu

Recent efforts within the AI community have yielded impressive results towards "soft theorem proving" over natural language sentences using language models. We propose a novel, generative adversarial framework for probing and improving…

机器学习 · 计算机科学 2022-05-03 Alexander Gaskell , Yishu Miao , Lucia Specia , Francesca Toni

Driven by massive amounts of data and important advances in computational resources, new deep learning systems have achieved outstanding results in a large spectrum of applications. Nevertheless, our current theoretical understanding on the…

Neural networks are vulnerable to adversarial attacks -- small visually imperceptible crafted noise which when added to the input drastically changes the output. The most effective method of defending against these adversarial attacks is to…

This paper presents Rudra, a parameter server based distributed computing framework tuned for training large-scale deep neural networks. Using variants of the asynchronous stochastic gradient descent algorithm we study the impact of…

机器学习 · 统计学 2016-12-07 Suyog Gupta , Wei Zhang , Fei Wang

Recently, adversarial deception becomes one of the most considerable threats to deep neural networks. However, compared to extensive research in new designs of various adversarial attacks and defenses, the neural networks' intrinsic…

机器学习 · 计算机科学 2019-05-13 Fuxun Yu , Zhuwei Qin , Chenchen Liu , Liang Zhao , Yanzhi Wang , Xiang Chen

Adversarial attacks and defenses are currently active areas of research for the deep learning community. A recent review paper divided the defense approaches into three categories; gradient masking, robust optimization, and adversarial…

机器学习 · 计算机科学 2019-10-24 Leslie N. Smith

Deep neural networks (DNNs) are vulnerable to adversarial examples where inputs with imperceptible perturbations mislead DNNs to incorrect results. Despite the potential risk they bring, adversarial examples are also valuable for providing…

计算机视觉与模式识别 · 计算机科学 2020-12-15 Chongzhi Zhang , Aishan Liu , Xianglong Liu , Yitao Xu , Hang Yu , Yuqing Ma , Tianlin Li

The adversarial robustness of attributions is a fundamental requirement for reliable explainability in deep learning, yet existing approaches typically rely on computationally expensive explicit regularization. In this work, we show that…

机器学习 · 计算机科学 2026-05-29 Amir Mehrpanah , Matteo Gamba , Hossein Azizpour