English
Related papers

Related papers: Building Robust Ensembles via Margin Boosting

200 papers

Malware remains a big threat to cyber security, calling for machine learning based malware detection. While promising, such detectors are known to be vulnerable to evasion attacks. Ensemble learning typically facilitates countermeasures,…

Cryptography and Security · Computer Science 2020-07-01 Deqiang Li , Qianmu Li

Neural network ensembles have been studied extensively in the context of adversarial robustness and most ensemble-based approaches remain vulnerable to adaptive attacks. In this paper, we investigate the robustness of Error-Correcting…

Machine Learning · Computer Science 2023-03-07 Thomas Philippon , Christian Gagné

Adversarial learning has emerged as one of the successful techniques to circumvent the susceptibility of existing methods against adversarial perturbations. However, the majority of existing defense methods are tailored to defend against a…

Machine Learning · Computer Science 2021-06-28 Divyam Madaan , Jinwoo Shin , Sung Ju Hwang

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

Ensembling a neural network is a widely recognized approach to enhance model performance, estimate uncertainty, and improve robustness in deep supervised learning. However, deep ensembles often come with high computational costs and memory…

Machine learning is becoming ubiquitous. From finance to medicine, machine learning models are boosting decision-making processes and even outperforming humans in some tasks. This huge progress in terms of prediction quality does not…

Machine Learning · Computer Science 2025-04-11 Marco Anisetti , Claudio A. Ardagna , Alessandro Balestrucci , Nicola Bena , Ernesto Damiani , Chan Yeob Yeun

We propose an algorithm to enhance certified robustness of a deep model ensemble by optimally weighting each base model. Unlike previous works on using ensembles to empirically improve robustness, our algorithm is based on optimizing a…

Machine Learning · Statistics 2019-11-01 Huan Zhang , Minhao Cheng , Cho-Jui Hsieh

Previous work shows that adversarially robust generalization requires larger sample complexity, and the same dataset, e.g., CIFAR-10, which enables good standard accuracy may not suffice to train robust models. Since collecting new training…

Machine Learning · Computer Science 2020-02-21 Tianyu Pang , Kun Xu , Yinpeng Dong , Chao Du , Ning Chen , Jun Zhu

Vulnerability to adversarial attacks is a well-known deficiency of deep neural networks. Larger networks are generally more robust, and ensembling is one method to increase adversarial robustness: each model's weaknesses are compensated by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Svetlana Pavlitska , Enrico Eisen , J. Marius Zöllner

Deep Neural Networks are vulnerable to adversarial attacks even in settings where the attacker has no direct access to the model being attacked. Such attacks usually rely on the principle of transferability, whereby an attack crafted on a…

Machine Learning · Statistics 2019-01-30 Sanjay Kariyappa , Moinuddin K. Qureshi

This paper aims to provide a thorough study on the effectiveness of the transformation-based ensemble defence for image classification and its reasons. It has been empirically shown that they can enhance the robustness against evasion…

Machine Learning · Computer Science 2020-10-09 Chang Liao , Yao Cheng , Chengfang Fang , Jie Shi

Ensemble learning has achieved remarkable success in machine learning, but its reliance on numerous base learners limits its application in resource-constrained environments. This paper introduces an innovative "Margin-Maximizing…

Machine Learning · Computer Science 2024-09-20 Jinghui Yuan , Hao Chen , Renwei Luo , Feiping Nie

Adversarial examples are perturbed inputs designed to fool machine learning models. Adversarial training injects such examples into training data to increase robustness. To scale this technique to large datasets, perturbations are crafted…

Machine Learning · Statistics 2020-04-28 Florian Tramèr , Alexey Kurakin , Nicolas Papernot , Ian Goodfellow , Dan Boneh , Patrick McDaniel

Deep Metric Learning (DML) has shown remarkable successes in many domains by taking advantage of powerful deep neural networks. Deep neural networks are prone to adversarial attacks and could be easily fooled by adversarial examples. The…

Machine Learning · Computer Science 2025-01-14 Xiaopeng Ke

Deep neural network ensembles hold the potential of improving generalization performance for complex learning tasks. This paper presents formal analysis and empirical evaluation to show that heterogeneous deep ensembles with high ensemble…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Yanzhao Wu , Ka-Ho Chow , Wenqi Wei , Ling Liu

We present a new algorithm to learn a deep neural network model robust against adversarial attacks. Previous algorithms demonstrate an adversarially trained Bayesian Neural Network (BNN) provides improved robustness. We recognize the…

Machine Learning · Computer Science 2023-12-04 Bao Gia Doan , Ehsan Abbasnejad , Javen Qinfeng Shi , Damith C. Ranasinghe

Due to numerous breakthroughs in real-world applications brought by machine intelligence, deep neural networks (DNNs) are widely employed in critical applications. However, predictions of DNNs are easily manipulated with imperceptible…

Machine Learning · Computer Science 2022-05-04 Hongjun Wang , Yisen Wang

Adversarial attacks and defenses are currently active areas of research for the deep learning community. A recent review paper divided the defense approaches into three categories; gradient masking, robust optimization, and adversarial…

Machine Learning · Computer Science 2019-10-24 Leslie N. Smith

Adversarial attacks can deceive neural networks by adding tiny perturbations to their input data. Ensemble defenses, which are trained to minimize attack transferability among sub-models, offer a promising research direction to improve…

Machine Learning · Computer Science 2022-11-16 Yunrui Yu , Xitong Gao , Cheng-Zhong Xu

Machine learning algorithms, however effective, are known to be vulnerable in adversarial scenarios where a malicious user may inject manipulated instances. In this work we focus on evasion attacks, where a model is trained in a safe…

Machine Learning · Computer Science 2020-04-08 Stefano Calzavara , Claudio Lucchese , Federico Marcuzzi , Salvatore Orlando