English
Related papers

Related papers: Counterexample Guided Branching via Directional Re…

200 papers

We improve the effectiveness of propagation- and linear-optimization-based neural network verification algorithms with a new tightened convex relaxation for ReLU neurons. Unlike previous single-neuron relaxations which focus only on the…

Machine Learning · Computer Science 2020-10-26 Christian Tjandraatmadja , Ross Anderson , Joey Huchette , Will Ma , Krunal Patel , Juan Pablo Vielma

The verification problem for neural networks is verifying whether a neural network will suffer from adversarial samples, or approximating the maximal allowed scale of adversarial perturbation that can be endured. While most prior work…

Machine Learning · Computer Science 2018-11-16 Qinglong Wang , Kaixuan Zhang , Xue Liu , C. Lee Giles

Retrieval-Augmented Generation (RAG) has become a core paradigm for enhancing factual grounding and multi-hop reasoning in Large Language Models (LLMs). Traditional text-based RAG often retrieves logically irrelevant pseudo-evidence, while…

Artificial Intelligence · Computer Science 2026-05-08 Jiarui Zhong , Hong Cai Chen

Formally verifying Deep Reinforcement Learning (DRL) systems is a challenging task due to the dynamic continuity of system behaviors and the black-box feature of embedded neural networks. In this paper, we propose a novel abstraction-based…

Artificial Intelligence · Computer Science 2021-06-15 Peng Jin , Min Zhang , Jianwen Li , Li Han , Xuejun Wen

Reachability analysis of compositional hybrid systems, where individual components are modeled as hybrid automata, poses unique challenges. In addition to preserving the compositional semantics while computing system behaviors, algorithms…

Logic in Computer Science · Computer Science 2025-09-05 Atanu Kundu , Pratyay Sarkar , Rajarshi Ray

Neural networks are essential components of learning-based software systems. However, their high compute, memory, and power requirements make using them in low resources domains challenging. For this reason, neural networks are often…

Machine Learning · Computer Science 2022-07-12 João Batista P. Matos , Iury Bessa , Edoardo Manino , Xidan Song , Lucas C. Cordeiro

Convolutional neural networks have gained vast popularity due to their excellent performance in the fields of computer vision, image processing, and others. Unfortunately, it is now well known that convolutional networks often produce…

Machine Learning · Computer Science 2022-01-07 Matan Ostrovsky , Clark Barrett , Guy Katz

One common belief is that with complex models and pre-training on large-scale datasets, transformer-based methods for referring expression comprehension (REC) perform much better than existing graph-based methods. We observe that since most…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Jingcheng Ke , Dele Wang , Jun-Cheng Chen , I-Hong Jhuo , Chia-Wen Lin , Yen-Yu Lin

In this paper, we study certifying the robustness of ReLU neural networks against adversarial input perturbations. To diminish the relaxation error suffered by the popular linear programming (LP) and semidefinite programming (SDP)…

Machine Learning · Computer Science 2025-05-13 Brendon G. Anderson , Ziye Ma , Jingqi Li , Somayeh Sojoudi

Abstraction is a key verification technique to improve scalability. However, its use for neural networks is so far extremely limited. Previous approaches for abstracting classification networks replace several neurons with one of them that…

Logic in Computer Science · Computer Science 2023-07-21 Calvin Chau , Jan Křetínský , Stefanie Mohr

As deep neural networks are increasingly being deployed in practice, their efficiency has become an important issue. While there are compression techniques for reducing the network's size, energy consumption and computational requirement,…

Machine Learning · Computer Science 2020-01-31 Brandon Paulsen , Jingbo Wang , Chao Wang

Neural network verification aims to provide provable bounds for the output of a neural network for a given input range. Notable prior works in this domain have either generated bounds using abstract domains, which preserve some dependency…

Machine Learning · Computer Science 2022-10-18 Matt Jordan , Jonathan Hayase , Alexandros G. Dimakis , Sewoong Oh

Intensive research has been conducted on the verification and validation of deep neural networks (DNNs), aiming to understand if, and how, DNNs can be applied to safety critical applications. However, existing verification and validation…

Machine Learning · Computer Science 2021-03-08 Nicolas Berthier , Amany Alshareef , James Sharp , Sven Schewe , Xiaowei Huang

Neural network verification aims at providing formal guarantees on the output of trained neural networks, to ensure their robustness against adversarial examples and enable their deployment in safety-critical applications. This paper…

Optimization and Control · Mathematics 2024-04-02 Haoruo Zhao , Hassan Hijazi , Haydn Jones , Juston Moore , Mathieu Tanneau , Pascal Van Hentenryck

Deep neural network architectures often consist of repetitive structural elements. We introduce an approach that reveals these patterns and can be broadly applied to the study of deep learning. Similarly to how a power strip helps untangle…

Statistical Mechanics · Physics 2025-07-03 Donghee Lee , Hye-Sung Lee , Jaeok Yi

In recent years, the notion of local robustness (or robustness for short) has emerged as a desirable property of deep neural networks. Intuitively, robustness means that small perturbations to an input do not cause the network to perform…

Programming Languages · Computer Science 2019-05-02 Greg Anderson , Shankara Pailoor , Isil Dillig , Swarat Chaudhuri

Nonlinear regression has been extensively employed in many computer vision problems (e.g., crowd counting, age estimation, affective computing). Under the umbrella of deep learning, two common solutions exist i) transforming nonlinear…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Le Zhang , Zenglin Shi , Ming-Ming Cheng , Yun Liu , Jia-Wang Bian , Joey Tianyi Zhou , Guoyan Zheng , Zeng Zeng

The increasing integration of deep neural networks in critical systems has spawned a theoretical and practical interest in formally guaranteeing safety properties about their behavior. To achieve this, contemporary verification algorithms…

Logic in Computer Science · Computer Science 2026-05-29 Ido Shmuel , Guy Katz

The vulnerability of neural networks to adversarial perturbations has necessitated formal verification techniques that can rigorously certify the quality of neural networks. As the state-of-the-art, branch and bound (BaB) is a…

Machine Learning · Computer Science 2025-07-24 Guanqin Zhang , Kota Fukuda , Zhenya Zhang , H. M. N. Dilum Bandara , Shiping Chen , Jianjun Zhao , Yulei Sui

Tight and efficient neural network bounding is crucial to the scaling of neural network verification systems. Many efficient bounding algorithms have been presented recently, but they are often too loose to verify more challenging…

Machine Learning · Computer Science 2024-02-27 Alessandro De Palma , Harkirat Singh Behl , Rudy Bunel , Philip H. S. Torr , M. Pawan Kumar