English
Related papers

Related papers: Adaptive Branch-and-Bound Tree Exploration for Neu…

200 papers

Probabilistic verification problems of neural networks are concerned with formally analysing the output distribution of a neural network under a probability distribution of the inputs. Examples of probabilistic verification problems include…

Machine Learning · Computer Science 2025-07-11 David Boetius , Stefan Leue , Tobias Sutter

Attention Branch Networks (ABNs) have been shown to simultaneously provide visual explanation and improve the performance of deep convolutional neural networks (CNNs). In this work, we introduce Multi-Scale Attention Branch Networks…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Ankit Gupta , Ida-Maria Sintorn

Conventional model quantization methods use a fixed quantization scheme to different data samples, which ignores the inherent "recognition difficulty" differences between various samples. We propose to feed different data samples with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Chen Tang , Haoyu Zhai , Kai Ouyang , Zhi Wang , Yifei Zhu , Wenwu Zhu

We study the problem of formal verification of Binarized Neural Networks (BNN), which have recently been proposed as a energy-efficient alternative to traditional learning networks. The verification of BNNs, using the reduction to hardware…

Software Engineering · Computer Science 2018-01-22 Chih-Hong Cheng , Georg Nührenberg , Chung-Hao Huang , Harald Ruess

We consider the resolution of learning problems involving $\ell_0$-regularization via Branch-and-Bound (BnB) algorithms. These methods explore regions of the feasible space of the problem and check whether they do not contain solutions…

Optimization and Control · Mathematics 2024-06-07 Theo Guyard , Cédric Herzet , Clément Elvira , Ayşe-Nur Arslan

Branch-and-bound (BnB) algorithms are widely used to solve combinatorial problems, and the performance crucially depends on its branching heuristic.In this work, we consider a typical problem of maximum common subgraph (MCS), and propose a…

Machine Learning · Computer Science 2019-05-23 Yan-li Liu , Chu-min Li , Hua Jiang , Kun He

Recently, cutting-plane methods such as GCP-CROWN have been explored to enhance neural network verifiers and made significant advances. However, GCP-CROWN currently relies on generic cutting planes (cuts) generated from external mixed…

Machine Learning · Computer Science 2026-03-31 Duo Zhou , Christopher Brix , Grani A Hanasusanto , Huan Zhang

Most work on the formal verification of neural networks has focused on bounding the set of outputs that correspond to a given set of inputs (for example, bounded perturbations of a nominal input). However, many use cases of neural network…

Machine Learning · Computer Science 2024-03-19 Suhas Kotha , Christopher Brix , Zico Kolter , Krishnamurthy Dvijotham , Huan Zhang

Branch and Bound (B&B) is the exact tree search method typically used to solve Mixed-Integer Linear Programming problems (MILPs). Learning branching policies for MILP has become an active research area, with most works proposing to imitate…

Machine Learning · Computer Science 2021-06-04 Giulia Zarpellon , Jason Jo , Andrea Lodi , Yoshua Bengio

Concerned with the reliability of neural networks, researchers have developed verification techniques to prove their robustness. Most verifiers work with real-valued networks. Unfortunately, the exact (complete and sound) verifiers face…

Artificial Intelligence · Computer Science 2020-10-28 Kai Jia , Martin Rinard

Recently, formal verification of deep neural networks (DNNs) has garnered considerable attention, and over-approximation based methods have become popular due to their effectiveness and efficiency. However, these strategies face challenges…

Artificial Intelligence · Computer Science 2024-01-24 Zhen Liang , Taoran Wu , Ran Zhao , Bai Xue , Ji Wang , Wenjing Yang , Shaojun Deng , Wanwei Liu

Verification of deep neural networks has witnessed a recent surge of interest, fueled by success stories in diverse domains and by abreast concerns about safety and security in envisaged applications. Complexity and sheer size of such…

Machine Learning · Computer Science 2020-03-18 Dario Guidotti , Francesco Leofante , Luca Pulina , Armando Tacchella

Verification of Neural Networks (NNs) that approximate the solution of Partial Differential Equations (PDEs) is a major milestone towards enhancing their trustworthiness and accelerating their deployment, especially for safety-critical…

Systems and Control · Electrical Eng. & Systems 2024-02-13 Petros Ellinas , Rahul Nellikath , Ignasi Ventura , Jochen Stiasny , Spyros Chatzivasileiadis

Inference-time alignment enhances the performance of large language models without requiring additional training or fine-tuning but presents challenges due to balancing computational efficiency with high-quality output. Best-of-N (BoN)…

Computation and Language · Computer Science 2025-09-04 Jiahao Qiu , Yifu Lu , Yifan Zeng , Jiacheng Guo , Jiayi Geng , Chenhao Zhu , Xinzhe Juan , Ling Yang , Huazheng Wang , Kaixuan Huang , Yue Wu , Mengdi Wang

Neural-network-based dynamics models learned from observational data have shown strong predictive capabilities for scene dynamics in robotic manipulation tasks. However, their inherent non-linearity presents significant challenges for…

Robotics · Computer Science 2025-03-18 Keyi Shen , Jiangwei Yu , Jose Barreiros , Huan Zhang , Yunzhu Li

Visual explanation enables human to understand the decision making of Deep Convolutional Neural Network (CNN), but it is insufficient to contribute the performance improvement. In this paper, we focus on the attention map for visual…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Hiroshi Fukui , Tsubasa Hirakawa , Takayoshi Yamashita , Hironobu Fujiyoshi

This paper explores methods for verifying the properties of Binary Neural Networks (BNNs), focusing on robustness against adversarial attacks. Despite their lower computational and memory needs, BNNs, like their full-precision counterparts,…

Machine Learning · Computer Science 2025-04-16 Jianting Yang , Srećko Ðurašinović , Jean-Bernard Lasserre , Victor Magron , Jun Zhao

Neural networks can learn complex, non-convex functions, and it is challenging to guarantee their correct behavior in safety-critical contexts. Many approaches exist to find failures in networks (e.g., adversarial examples), but these…

Branch and bound algorithms have to cope with several additional difficulties in the multi-objective case. Not only the bounding procedure is considerably weaker, but also the handling of upper and lower bound sets requires much more…

Optimization and Control · Mathematics 2023-11-13 Julius Bauß , Michael Stiglmayr

Edge computing environments impose strict constraints on energy consumption and latency, making the deployment of deep neural networks a significant challenge. Therefore, smart and adaptive inference strategies that dynamically balance…

Machine Learning · Computer Science 2026-05-25 Grigorios Papanikolaou , Ioannis Kontopoulos , Konstantinos Tserpes