中文
相关论文

相关论文: Revisiting Hilbert-Schmidt Information Bottleneck …

200 篇论文

Deep neural networks are susceptible to adversarial examples, posing a significant security risk in critical applications. Adversarial Training (AT) is a well-established technique to enhance adversarial robustness, but it often comes at…

机器学习 · 计算机科学 2023-08-08 Kaijie Zhu , Jindong Wang , Xixu Hu , Xing Xie , Ge Yang

Existing deep neural networks, say for image classification, have been shown to be vulnerable to adversarial images that can cause a DNN misclassification, without any perceptible change to an image. In this work, we propose shock absorbing…

机器学习 · 计算机科学 2019-09-19 Kevin Eykholt , Swati Gupta , Atul Prakash , Amir Rahmati , Pratik Vaishnavi , Haizhong Zheng

We present a variational approximation to the information bottleneck of Tishby et al. (1999). This variational approach allows us to parameterize the information bottleneck model using a neural network and leverage the reparameterization…

机器学习 · 计算机科学 2019-10-25 Alexander A. Alemi , Ian Fischer , Joshua V. Dillon , Kevin Murphy

In spite of great advancements of machine reading comprehension (RC), existing RC models are still vulnerable and not robust to different types of adversarial examples. Neural models over-confidently predict wrong answers to semantic…

计算与语言 · 计算机科学 2019-11-19 Mantong Zhou , Minlie Huang , Xiaoyan Zhu

Recent studies have revealed that GNNs are vulnerable to adversarial attacks. Most existing robust graph learning methods measure model robustness based on label information, rendering them infeasible when label information is not…

机器学习 · 计算机科学 2023-06-09 Jihong Wang , Minnan Luo , Jundong Li , Ziqi Liu , Jun Zhou , Qinghua Zheng

We introduce Hybrid Convolutions with Attention Stochasticity (HyCAS), an adversarial defense that narrows the long-standing gap between provable robustness under L2 certificates and empirical robustness against strong L attacks, while…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Joy Dhar , Song Xia , Manish Kumar Pandey , Maryam Haghighat , Azadeh Alavi , Ferdous Sohel , Wenyu Zhang , Nayyar Zaidi

Recent research has highlighted a critical issue known as ``robust fairness", where robust accuracy varies significantly across different classes, undermining the reliability of deep neural networks (DNNs). A common approach to address this…

机器学习 · 计算机科学 2025-01-24 Gaojie Jin , Sihao Wu , Jiaxu Liu , Tianjin Huang , Ronghui Mu

We introduce Harmonic Robustness, a powerful and intuitive method to test the robustness of any machine-learning model either during training or in black-box real-time inference monitoring without ground-truth labels. It is based on…

机器学习 · 计算机科学 2024-04-30 Nicholas S. Kersting , Yi Li , Aman Mohanty , Oyindamola Obisesan , Raphael Okochu

Neural networks are getting better accuracy with higher energy and computational cost. After quantization, the cost can be greatly saved, and the quantized models are more hardware friendly with acceptable accuracy loss. On the other hand,…

机器学习 · 计算机科学 2021-10-26 Chang Song , Riya Ranjan , Hai Li

We study a model for adversarial classification based on distributionally robust chance constraints. We show that under Wasserstein ambiguity, the model aims to minimize the conditional value-at-risk of the distance to misclassification,…

机器学习 · 计算机科学 2021-11-05 Nam Ho-Nguyen , Stephen J. Wright

Recently, adversarial deception becomes one of the most considerable threats to deep neural networks. However, compared to extensive research in new designs of various adversarial attacks and defenses, the neural networks' intrinsic…

机器学习 · 计算机科学 2019-05-13 Fuxun Yu , Zhuwei Qin , Chenchen Liu , Liang Zhao , Yanzhi Wang , Xiang Chen

The reliability of a learning model is key to the successful deployment of machine learning in various applications. However, it is difficult to describe the phenomenon due to the complicated nature of the problems in machine learning. It…

机器学习 · 计算机科学 2025-05-27 Ramin Barati , Reza Safabakhsh , Mohammad Rahmati

In this theory paper, we investigate training deep neural networks (DNNs) for classification via minimizing the information bottleneck (IB) functional. We show that the resulting optimization problem suffers from two severe issues: First,…

机器学习 · 计算机科学 2020-08-10 Rana Ali Amjad , Bernhard C. Geiger

Previous adversarial training raises model robustness under the compromise of accuracy on natural data. In this paper, we reduce natural accuracy degradation. We use the model logits from one clean model to guide learning of another one…

计算机视觉与模式识别 · 计算机科学 2021-08-17 Jiequan Cui , Shu Liu , Liwei Wang , Jiaya Jia

In this paper, we analyze and improve the adversarial robustness of a convolutional neural network (CNN) that assists crystal-collimator alignment at CERN's Large Hadron Collider (LHC) by classifying a beam-loss monitor (BLM) time series…

Deep neural networks (DNNs) have had many successes, but they suffer from two major issues: (1) a vulnerability to adversarial examples and (2) a tendency to elude human interpretation. Interestingly, recent empirical and theoretical…

机器学习 · 计算机科学 2020-12-07 Adam Noack , Isaac Ahern , Dejing Dou , Boyang Li

Adversarial training has been shown to regularize deep neural networks in addition to increasing their robustness to adversarial examples. However, its impact on very deep state of the art networks has not been fully investigated. In this…

计算机视觉与模式识别 · 计算机科学 2018-05-30 Swami Sankaranarayanan , Arpit Jain , Rama Chellappa , Ser Nam Lim

Recent studies have highlighted the potential of Lipschitz-based methods for training certifiably robust neural networks against adversarial attacks. A key challenge, supported both theoretically and empirically, is that robustness demands…

机器学习 · 计算机科学 2024-06-25 Kai Hu , Klas Leino , Zifan Wang , Matt Fredrikson

The emergence of Graph Convolutional Network (GCN) has greatly boosted the progress of graph learning. However, two disturbing factors, noise and redundancy in graph data, and lack of interpretation for prediction results, impede further…

机器学习 · 计算机科学 2021-03-23 Junchi Yu , Tingyang Xu , Yu Rong , Yatao Bian , Junzhou Huang , Ran He

Recent studies on the adversarial vulnerability of neural networks have shown that models trained with the objective of minimizing an upper bound on the worst-case loss over all possible adversarial perturbations improve robustness against…

机器学习 · 计算机科学 2019-10-22 Anindya Sarkar , Nikhil Kumar Gupta , Raghu Iyengar