English
Related papers

Related papers: Local Intrinsic Dimensionality Signals Adversarial…

200 papers

Neural networks have been shown to be vulnerable against minor adversarial perturbations of their inputs, especially for high dimensional data under $\ell_\infty$ attacks. To combat this problem, techniques like adversarial training have…

Machine Learning · Computer Science 2019-06-04 Emilio Rafael Balda , Arash Behboodi , Niklas Koep , Rudolf Mathar

We present a nonparametric method for outlier detection that takes full account of local variations in intrinsic dimensionality within the dataset. Using the theory of Local Intrinsic Dimensionality (LID), our 'dimensionality-aware' outlier…

An information-theoretic upper bound on the generalization error of supervised learning algorithms is derived. The bound is constructed in terms of the mutual information between each individual training sample and the output of the…

Machine Learning · Computer Science 2020-08-06 Yuheng Bu , Shaofeng Zou , Venugopal V. Veeravalli

The performance of distance-based classifiers heavily depends on the underlying distance metric, so it is valuable to learn a suitable metric from the data. To address the problem of multimodality, it is desirable to learn local metrics. In…

Machine Learning · Computer Science 2018-02-13 Mingzhi Dong , Yujiang Wang , Xiaochen Yang , Jing-Hao Xue

Deep learning based intrusion detection systems (DL-based IDS) have emerged as one of the best choices for providing security solutions against various network intrusion attacks. However, due to the emergence and development of adversarial…

Cryptography and Security · Computer Science 2023-12-12 Xinwei Yuan , Shu Han , Wei Huang , Hongliang Ye , Xianglong Kong , Fan Zhang

The vulnerability of deep neural networks against adversarial examples - inputs with small imperceptible perturbations - has gained a lot of attention in the research community recently. Simultaneously, the number of parameters of…

Machine Learning · Computer Science 2021-08-20 Florian Merkle , Maximilian Samsinger , Pascal Schöttle

The vulnerability of deep neural networks to small and even imperceptible perturbations has become a central topic in deep learning research. Although several sophisticated defense mechanisms have been introduced, most were later shown to…

Machine Learning · Computer Science 2021-09-28 Leo Schwinn , An Nguyen , René Raab , Dario Zanca , Bjoern Eskofier , Daniel Tenbrinck , Martin Burger

Deep neural networks progressively transform their inputs across multiple processing layers. What are the geometrical properties of the representations learned by these networks? Here we study the intrinsic dimensionality (ID) of…

Machine Learning · Computer Science 2019-10-29 Alessio Ansuini , Alessandro Laio , Jakob H. Macke , Davide Zoccolan

This work investigates the impact of ensuring local differential privacy in the thresholding bandit problem. We consider both the fixed budget and fixed confidence settings. We propose methods that utilize private responses, obtained…

Machine Learning · Computer Science 2025-08-26 Annalisa Barbara , Joseph Lazzaro , Ciara Pike-Burke

There is substantial interest in the use of machine learning (ML) based techniques throughout the electronic computer-aided design (CAD) flow, particularly those based on deep learning. However, while deep learning methods have surpassed…

Machine Learning · Computer Science 2020-09-07 Kang Liu , Haoyu Yang , Yuzhe Ma , Benjamin Tan , Bei Yu , Evangeline F. Y. Young , Ramesh Karri , Siddharth Garg

We propose the use of controlled perturbations to address the challenging question of optimal active-set prediction for interior point methods. Namely, in the context of linear programming, we consider perturbing the inequality…

Optimization and Control · Mathematics 2016-02-18 Coralia Cartis , Yiming Yan

An acknowledged weakness of neural networks is their vulnerability to adversarial perturbations to the inputs. To improve the robustness of these models, one of the most popular defense mechanisms is to alternatively maximize the loss over…

Machine Learning · Computer Science 2020-10-22 Zhun Deng , Hangfeng He , Jiaoyang Huang , Weijie J. Su

Imitating skills from low-quality datasets, such as sub-optimal demonstrations and observations with distractors, is common in real-world applications. In this work, we focus on the problem of Learning from Noisy Demonstrations (LND), where…

Machine Learning · Computer Science 2024-04-05 Kaichen Huang , Hai-Hang Sun , Shenghua Wan , Minghao Shao , Shuai Feng , Le Gan , De-Chuan Zhan

It has been consistently reported that many machine learning models are susceptible to adversarial attacks i.e., small additive adversarial perturbations applied to data points can cause misclassification. Adversarial training using…

Machine Learning · Statistics 2021-07-15 Hossein Taheri , Ramtin Pedarsani , Christos Thrampoulidis

Local robustness verification can verify that a neural network is robust wrt. any perturbation to a specific input within a certain distance. We call this distance Robustness Radius. We observe that the robustness radii of correctly…

Machine Learning · Computer Science 2024-02-14 Jiangchao Liu , Liqian Chen , Antoine Mine , Ji Wang

Machine Learning (ML) models are applied in a variety of tasks such as network intrusion detection or Malware classification. Yet, these models are vulnerable to a class of malicious inputs known as adversarial examples. These are slightly…

Cryptography and Security · Computer Science 2017-10-18 Kathrin Grosse , Praveen Manoharan , Nicolas Papernot , Michael Backes , Patrick McDaniel

We study inference on a low-dimensional functional $\beta$ in the presence of infinite-dimensional nuisance parameters. Classical inferential methods are typically based on Wald intervals, whose large-sample validity rests on asymptotic…

Methodology · Statistics 2026-02-24 Mengchu Zheng , Matteo Bonvini , Zijian Guo

Adversarial examples mainly exploit changes to input pixels to which humans are not sensitive to, and arise from the fact that models make decisions based on uninterpretable features. Interestingly, cognitive science reports that the…

How can we perform efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable posterior distributions, and large datasets? We introduce a stochastic variational…

Machine Learning · Statistics 2022-12-13 Diederik P Kingma , Max Welling

State-of-the-art machine learning models can be vulnerable to very small input perturbations that are adversarially constructed. Adversarial training is an effective approach to defend against it. Formulated as a min-max problem, it…

Machine Learning · Statistics 2023-10-18 Antônio H. Ribeiro , Dave Zachariah , Francis Bach , Thomas B. Schön