English
Related papers

Related papers: Adaptive Branch-and-Bound Tree Exploration for Neu…

200 papers

Real-world networks such as social and communication networks are too large to be observed entirely. Such networks are often partially observed such that network size, network topology, and nodes of the original network are unknown. In this…

Machine Learning · Statistics 2018-04-20 Kaushalya Madhawa , Tsuyoshi Murata

In many real-world AD applications including computer security and fraud prevention, the anomaly detector must be configurable by the human analyst to minimize the effort on false positives. One important way to configure the detector is by…

Machine Learning · Computer Science 2024-05-15 Shubhomoy Das , Md Rakibul Islam , Nitthilan Kannappan Jayakodi , Janardhan Rao Doppa

The ubiquity of deep learning algorithms in various applications has amplified the need for assuring their robustness against small input perturbations such as those occurring in adversarial attacks. Existing complete verification…

Machine Learning · Computer Science 2024-06-17 Matthias König , Xiyue Zhang , Holger H. Hoos , Marta Kwiatkowska , Jan N. van Rijn

In this paper, we surveyed the existing literature studying different approaches and algorithms for the four critical components in the general branch and bound (B&B) algorithm, namely, branching variable selection, node selection, node…

Machine Learning · Computer Science 2021-11-12 Lingying Huang , Xiaomeng Chen , Wei Huo , Jiazheng Wang , Fan Zhang , Bo Bai , Ling Shi

We present the Branch-and-Bound Performance Estimation Programming (BnB-PEP), a unified methodology for constructing optimal first-order methods for convex and nonconvex optimization. BnB-PEP poses the problem of finding the optimal…

Optimization and Control · Mathematics 2023-06-09 Shuvomoy Das Gupta , Bart P. G. Van Parys , Ernest K. Ryu

We apply Bayesian Additive Regression Tree (BART) principles to training an ensemble of small neural networks for regression tasks. Using Markov Chain Monte Carlo, we sample from the posterior distribution of neural networks that have a…

Machine Learning · Statistics 2024-04-09 Danielle Van Boxel

Deep Neural Networks (DNNs) are powerful tools for various computer vision tasks, yet they often struggle with reliable uncertainty quantification - a critical requirement for real-world applications. Bayesian Neural Networks (BNN) are…

Machine Learning · Computer Science 2023-12-27 Gianni Franchi , Olivier Laurent , Maxence Leguéry , Andrei Bursuc , Andrea Pilzer , Angela Yao

Tree search algorithms, such as branch-and-bound, are the most widely used tools for solving combinatorial and nonconvex problems. For example, they are the foremost method for solving (mixed) integer programs and constraint satisfaction…

Artificial Intelligence · Computer Science 2018-05-18 Maria-Florina Balcan , Travis Dick , Tuomas Sandholm , Ellen Vitercik

A branch-and-bound (BB) tree certifies a dual bound on the value of an integer program. In this work, we introduce the tree compression problem (TCP): Given a BB tree T that certifies a dual bound, can we obtain a smaller tree with the same…

Optimization and Control · Mathematics 2023-06-08 Gonzalo Muñoz , Joseph Paat , Álinson S. Xavier

Polynomial Networks (PNs) have demonstrated promising performance on face and image recognition recently. However, robustness of PNs is unclear and thus obtaining certificates becomes imperative for enabling their adoption in real-world…

Machine Learning · Computer Science 2022-10-25 Elias Abad Rocamora , Mehmet Fatih Sahin , Fanghui Liu , Grigorios G Chrysos , Volkan Cevher

Decision trees are one of the most useful and popular methods in the machine learning toolbox. In this paper, we consider the problem of learning optimal decision trees, a combinatorial optimization problem that is challenging to solve at…

Machine Learning · Computer Science 2022-07-01 Rahul Mazumder , Xiang Meng , Haoyue Wang

Recent works have tried to increase the verifiability of adversarially trained networks by running the attacks over domains larger than the original perturbations and adding various regularization terms to the objective. However, these…

Machine Learning · Computer Science 2023-06-01 Alessandro De Palma , Rudy Bunel , Krishnamurthy Dvijotham , M. Pawan Kumar , Robert Stanforth

Strong Branching (SB) is a cornerstone of all modern branching rules used in the Branch-and-Bound (BnB) algorithm, which is at the center of Mixed-Integer Programming solvers. In its full form, SB evaluates all variables to branch on and…

Optimization and Control · Mathematics 2024-04-08 Gioni Mexi , Somayeh Shamsi , Mathieu Besançon , Pierre Le Bodic

The success of Deep Learning and its potential use in many safety-critical applications has motivated research on formal verification of Neural Network (NN) models. Despite the reputation of learned NN models to behave as black boxes and…

Artificial Intelligence · Computer Science 2018-05-23 Rudy Bunel , Ilker Turkaslan , Philip H. S. Torr , Pushmeet Kohli , M. Pawan Kumar

We consider the message complexity of verifying whether a given subgraph of the communication network forms a tree with specific properties both in the KT-$\rho$ (nodes know their $\rho$-hop neighborhood, including node IDs) and the KT-$0$…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-01 Shay Kutten , Peter Robinson , Ming Ming Tan

Modeling natural phenomena with artificial neural networks (ANNs) often provides highly accurate predictions. However, ANNs often suffer from over-parameterization, complicating interpretation and raising uncertainty issues. Bayesian neural…

Machine Learning · Statistics 2025-03-14 Eirik Høyheim , Lars Skaaret-Lund , Solve Sæbø , Aliaksandr Hubin

This paper addresses the problem of formally verifying desirable properties of neural networks, i.e., obtaining provable guarantees that neural networks satisfy specifications relating their inputs and outputs (robustness to bounded norm…

Machine Learning · Computer Science 2018-08-06 Krishnamurthy , Dvijotham , Robert Stanforth , Sven Gowal , Timothy Mann , Pushmeet Kohli

Unsupervised Domain Adaptation (UDA) is a key issue in visual recognition, as it allows to bridge different visual domains enabling robust performances in the real world. To date, all proposed approaches rely on human expertise to manually…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Luca Robbiano , Muhammad Rameez Ur Rahman , Fabio Galasso , Barbara Caputo , Fabio Maria Carlucci

Traditional methods for formal verification (FV) of deep neural networks (DNNs) are constrained by a binary encoding of safety properties, where a model is classified as either safe or unsafe (robust or not robust). This binary encoding…

Artificial Intelligence · Computer Science 2025-05-09 Luca Marzari , Isabella Mastroeni , Alessandro Farinelli

The optimization of Binary Neural Networks (BNNs) relies on approximating the real-valued weights with their binarized representations. Current techniques for weight-updating use the same approaches as traditional Neural Networks (NNs) with…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Cuauhtemoc Daniel Suarez-Ramirez , Miguel Gonzalez-Mendoza , Leonardo Chang-Fernandez , Gilberto Ochoa-Ruiz , Mario Alberto Duran-Vega