English
Related papers

Related papers: Verifiable Boosted Tree Ensembles

200 papers

In this paper, we focus on addressing the challenges of detecting malicious attacks in networks by designing an advanced Explainable Intrusion Detection System (xIDS). The existing machine learning and deep learning approaches have…

Cryptography and Security · Computer Science 2025-03-04 Muhammad Adil , Mian Ahmad Jan , Safayat Bin Hakim , Houbing Herbert Song , Zhanpeng Jin

Datasets can be biased due to societal inequities, human biases, under-representation of minorities, etc. Our goal is to certify that models produced by a learning algorithm are pointwise-robust to potential dataset biases. This is a…

Machine Learning · Computer Science 2021-10-12 Anna P. Meyer , Aws Albarghouthi , Loris D'Antoni

This paper advances the theoretical understanding of active learning label complexity for decision trees as binary classifiers. We make two main contributions. First, we provide the first analysis of the disagreement coefficient for…

Recent studies show that deep neural networks (DNN) are vulnerable to adversarial examples, which aim to mislead DNNs by adding perturbations with small magnitude. To defend against such attacks, both empirical and theoretical defense…

Machine Learning · Computer Science 2022-04-22 Zhuolin Yang , Linyi Li , Xiaojun Xu , Bhavya Kailkhura , Tao Xie , Bo Li

We propose and investigate probabilistic guarantees for the adversarial robustness of classification algorithms. While traditional formal verification approaches for robustness are intractable and sampling-based approaches do not provide…

Machine Learning · Computer Science 2025-11-11 Peter Blohm , Patrick Indri , Thomas Gärtner , Sagar Malhotra

The success of neural networks across most machine learning tasks and the persistence of adversarial examples have made the verification of such models an important quest. Several techniques have been successfully developed to verify…

Machine Learning · Computer Science 2019-10-14 Nathanaël Fijalkow , Mohit Kumar Gupta

Implicit neural networks are a general class of learning models that replace the layers in traditional feedforward models with implicit algebraic equations. Compared to traditional learning models, implicit networks offer competitive…

Machine Learning · Computer Science 2021-12-13 Saber Jafarpour , Matthew Abate , Alexander Davydov , Francesco Bullo , Samuel Coogan

Neural networks are part of many contemporary NLP systems, yet their empirical successes come at the price of vulnerability to adversarial attacks. Previous work has used adversarial training and data augmentation to partially mitigate such…

Computation and Language · Computer Science 2019-12-23 Po-Sen Huang , Robert Stanforth , Johannes Welbl , Chris Dyer , Dani Yogatama , Sven Gowal , Krishnamurthy Dvijotham , Pushmeet Kohli

The use of neural networks as function approximators has enabled many advances in reinforcement learning (RL). The generalization power of neural networks combined with advances in RL algorithms has reignited the field of artificial…

Machine Learning · Computer Science 2022-03-14 Christopher Lazarus , Mykel J. Kochenderfer

Machine learning is becoming ubiquitous. From finance to medicine, machine learning models are boosting decision-making processes and even outperforming humans in some tasks. This huge progress in terms of prediction quality does not…

Machine Learning · Computer Science 2025-04-11 Marco Anisetti , Claudio A. Ardagna , Alessandro Balestrucci , Nicola Bena , Ernesto Damiani , Chan Yeob Yeun

Recent studies have shown that deep neural networks (DNNs) are vulnerable to adversarial attacks, including evasion and backdoor (poisoning) attacks. On the defense side, there have been intensive efforts on improving both empirical and…

Machine Learning · Computer Science 2023-08-04 Maurice Weber , Xiaojun Xu , Bojan Karlaš , Ce Zhang , Bo Li

This work introduces a verification framework that provides both sound and complete guarantees for data poisoning attacks during neural network training. We formulate adversarial data manipulation, model training, and test-time evaluation…

Machine Learning · Computer Science 2026-02-20 Philip Sosnin , Jodie Knapp , Fraser Kennedy , Josh Collyer , Calvin Tsay

Reinforcement learning algorithms need exploration to learn. However, unsupervised exploration prevents the deployment of such algorithms on safety-critical tasks and limits real-world deployment. In this paper, we propose a new algorithm…

Machine Learning · Computer Science 2024-02-07 Sven Gronauer , Tom Haider , Felippe Schmoeller da Roza , Klaus Diepold

Gradient Boosted Decision Trees (GBDT) is a very successful ensemble learning algorithm widely used across a variety of applications. Recently, several variants of GBDT training algorithms and implementations have been designed and heavily…

Machine Learning · Computer Science 2019-06-27 Yu Shi , Jian Li , Zhize Li

Many recent works have proposed methods to train classifiers with local robustness properties, which can provably eliminate classes of evasion attacks for most inputs, but not all inputs. Since data distribution shift is very common in…

Cryptography and Security · Computer Science 2021-12-03 Yizheng Chen , Shiqi Wang , Yue Qin , Xiaojing Liao , Suman Jana , David Wagner

The success of Deep Learning and its potential use in many safety-critical applications has motivated research on formal verification of Neural Network (NN) models. Despite the reputation of learned NN models to behave as black boxes and…

Artificial Intelligence · Computer Science 2018-05-23 Rudy Bunel , Ilker Turkaslan , Philip H. S. Torr , Pushmeet Kohli , M. Pawan Kumar

In recent years, gradient boosted decision tree learning has proven to be an effective method of training robust models. Moreover, collaborative learning among multiple parties has the potential to greatly benefit all parties involved, but…

Cryptography and Security · Computer Science 2020-10-07 Andrew Law , Chester Leung , Rishabh Poddar , Raluca Ada Popa , Chenyu Shi , Octavian Sima , Chaofan Yu , Xingmeng Zhang , Wenting Zheng

Currently, reinforcement learning (RL), especially deep RL, has received more and more attention in the research area. However, the security of RL has been an obvious problem due to the attack manners becoming mature. In order to defend…

Machine Learning · Computer Science 2023-10-04 Jiarui Yao , Simon Shaolei Du

Gradient boosting machines (GBMs) based on decision trees consistently demonstrate state-of-the-art results on regression and classification tasks with tabular data, often outperforming deep neural networks. However, these models do not…

Machine Learning · Computer Science 2023-02-23 Tristan Cinquin , Tammo Rukat , Philipp Schmidt , Martin Wistuba , Artur Bekasov

Verification of deep neural networks has witnessed a recent surge of interest, fueled by success stories in diverse domains and by abreast concerns about safety and security in envisaged applications. Complexity and sheer size of such…

Machine Learning · Computer Science 2020-03-18 Dario Guidotti , Francesco Leofante , Luca Pulina , Armando Tacchella