English
Related papers

Related papers: Ensemble-in-One: Learning Ensemble within Random G…

200 papers

Graph Neural Networks (GNNs) have enjoyed wide spread applications in graph-structured data. However, existing graph based applications commonly lack annotated data. GNNs are required to learn latent patterns from a limited amount of…

Machine Learning · Computer Science 2023-03-22 Wenqi Wei , Mu Qiao , Divyesh Jadav

Recent development of adversarial attacks has proven that ensemble-based methods outperform traditional, non-ensemble ones in black-box attack. However, as it is computationally prohibitive to acquire a family of diverse models, these…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Yingwei Li , Song Bai , Yuyin Zhou , Cihang Xie , Zhishuai Zhang , Alan Yuille

Deep learning-based computer vision systems adopt complex and large architectures to improve performance, yet they face challenges in deployment on resource-constrained mobile and edge devices. To address this issue, model compression…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yoojin Jung , Byung Cheol Song

Sparsely-gated Mixture of Expert (MoE), an emerging deep model architecture, has demonstrated a great promise to enable high-accuracy and ultra-efficient model inference. Despite the growing popularity of MoE, little work investigated its…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yihua Zhang , Ruisi Cai , Tianlong Chen , Guanhua Zhang , Huan Zhang , Pin-Yu Chen , Shiyu Chang , Zhangyang Wang , Sijia Liu

Improving model performance is always the key problem in machine learning including deep learning. However, stand-alone neural networks always suffer from marginal effect when stacking more layers. At the same time, ensemble is an useful…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Yuan Gao , Zixiang Cai , Lei Yu

A memory efficient approach to ensembling neural networks is to share most weights among the ensembled models by means of a single reference network. We refer to this strategy as Embedded Ensembling (EE); its particular examples are…

Machine Learning · Statistics 2022-02-25 Maksim Velikanov , Roman Kail , Ivan Anokhin , Roman Vashurin , Maxim Panov , Alexey Zaytsev , Dmitry Yarotsky

Adversarial attacks rely on transferability, where an adversarial example (AE) crafted on a surrogate classifier tends to mislead a target classifier. Recent ensemble methods demonstrate that AEs are less likely to mislead multiple…

Many deep learning algorithms can be easily fooled with simple adversarial examples. To address the limitations of existing defenses, we devised a probabilistic framework that can generate an exponentially large ensemble of models from a…

Machine Learning · Computer Science 2018-09-11 George A. Adam , Petr Smirnov , David Duvenaud , Benjamin Haibe-Kains , Anna Goldenberg

Ensemble learning is a process by which multiple base learners are strategically generated and combined into one composite learner. There are two features that are essential to an ensemble's performance, the individual accuracies of the…

Machine Learning · Computer Science 2021-09-30 Wenjing Li , Randy C. Paffenroth , David Berthiaume

As deep learning applications, especially programs of computer vision, are increasingly deployed in our lives, we have to think more urgently about the security of these applications.One effective way to improve the security of deep…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Xiao Tan , Jingbo Gao , Ruolin Li

We present a new algorithm to learn a deep neural network model robust against adversarial attacks. Previous algorithms demonstrate an adversarially trained Bayesian Neural Network (BNN) provides improved robustness. We recognize the…

Machine Learning · Computer Science 2023-12-04 Bao Gia Doan , Ehsan Abbasnejad , Javen Qinfeng Shi , Damith C. Ranasinghe

Adversarial attacks can deceive neural networks by adding tiny perturbations to their input data. Ensemble defenses, which are trained to minimize attack transferability among sub-models, offer a promising research direction to improve…

Machine Learning · Computer Science 2022-11-16 Yunrui Yu , Xitong Gao , Cheng-Zhong Xu

The fact that deep neural networks are susceptible to crafted perturbations severely impacts the use of deep learning in certain domains of application. Among many developed defense models against such attacks, adversarial training emerges…

Machine Learning · Computer Science 2020-07-13 Anh Bui , Trung Le , He Zhao , Paul Montague , Olivier deVel , Tamas Abraham , Dinh Phung

Verifying the robustness of machine learning models against evasion attacks at test time is an important research problem. Unfortunately, prior work established that this problem is NP-hard for decision tree ensembles, hence bound to be…

Machine Learning · Computer Science 2023-11-14 Stefano Calzavara , Lorenzo Cazzaro , Giulio Ermanno Pibiri , Nicola Prezza

Machine learning algorithms, however effective, are known to be vulnerable in adversarial scenarios where a malicious user may inject manipulated instances. In this work we focus on evasion attacks, where a model is trained in a safe…

Machine Learning · Computer Science 2020-04-08 Stefano Calzavara , Claudio Lucchese , Federico Marcuzzi , Salvatore Orlando

The escalating frequency of intrusions in networked systems has spurred the exploration of new research avenues in devising artificial intelligence (AI) techniques for intrusion detection systems (IDS). Various AI techniques have been used…

Cryptography and Security · Computer Science 2024-10-22 Ismail Bibers , Osvaldo Arreche , Mustafa Abdallah

Deep neural network (DNN) models are known to be vulnerable to maliciously crafted adversarial examples and to out-of-distribution inputs drawn sufficiently far away from the training data. How to protect a machine learning model against…

Machine Learning · Computer Science 2020-09-15 Wenqi Wei , Ling Liu

Recent studies show that deep neural networks (DNN) are vulnerable to adversarial examples, which aim to mislead DNNs by adding perturbations with small magnitude. To defend against such attacks, both empirical and theoretical defense…

Machine Learning · Computer Science 2022-04-22 Zhuolin Yang , Linyi Li , Xiaojun Xu , Bhavya Kailkhura , Tao Xie , Bo Li

Deep Neural Networks (DNNs) are often criticized for being susceptible to adversarial attacks. Most successful defense strategies adopt adversarial training or random input transformations that typically require retraining or fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Lokender Tiwari , Anish Madan , Saket Anand , Subhashis Banerjee

Background: Machine learning-based security detection models have become prevalent in modern malware and intrusion detection systems. However, previous studies show that such models are susceptible to adversarial evasion attacks. In this…

Cryptography and Security · Computer Science 2021-10-14 Rui Shu , Tianpei Xia , Laurie Williams , Tim Menzies