English
Related papers

Related papers: Trustworthy AI in numerics: On verification algori…

200 papers

Partial differential equations (PDEs) play a crucial role in studying a vast number of problems in science and engineering. Numerically solving nonlinear and/or high-dimensional PDEs is often a challenging task. Inspired by the traditional…

Numerical Analysis · Mathematics 2022-01-11 Yihao Hu , Tong Zhao , Shixin Xu , Zhiliang Xu , Lizhen Lin

In this paper, we consider the computational complexity of formally verifying the behavior of Rectified Linear Unit (ReLU) Neural Networks (NNs), where verification entails determining whether the NN satisfies convex polytopic…

Machine Learning · Computer Science 2021-03-26 James Ferlez , Yasser Shoukry

We propose an algorithm to numerically determined whether a second-order linear PDE problem satisfying a Garding inequality is well-posed. This algorithm further provides a lower bound to the inf-sup constant of the weak formulation, which…

Numerical Analysis · Mathematics 2026-05-20 T. Chaumont-Frelet

Most work on the formal verification of neural networks has focused on bounding the set of outputs that correspond to a given set of inputs (for example, bounded perturbations of a nominal input). However, many use cases of neural network…

Machine Learning · Computer Science 2024-03-19 Suhas Kotha , Christopher Brix , Zico Kolter , Krishnamurthy Dvijotham , Huan Zhang

Recently, artificial neural networks (ANNs) in conjunction with stochastic gradient descent optimization methods have been employed to approximately compute solutions of possibly rather high-dimensional partial differential equations…

Numerical Analysis · Mathematics 2021-10-12 Lukas Gonon , Philipp Grohs , Arnulf Jentzen , David Kofler , David Šiška

A learning method is self-certified if it uses all available data to simultaneously learn a predictor and certify its quality with a tight statistical certificate that is valid on unseen data. Recent work has shown that neural network…

Machine Learning · Computer Science 2021-12-13 Maria Perez-Ortiz , Omar Rivasplata , Emilio Parrado-Hernandez , Benjamin Guedj , John Shawe-Taylor

We propose a partial differential-integral equation (PDE) framework for deep neural networks (DNNs) and their associated learning problem by taking the continuum limits of both network width and depth. The proposed model captures the…

Optimization and Control · Mathematics 2024-11-12 Peter Markowich , Simone Portaro

Although neural networks are widely used, it remains challenging to formally verify the safety and robustness of neural networks in real-world applications. Existing methods are designed to verify the network before deployment, which are…

Machine Learning · Computer Science 2023-02-06 Tianhao Wei , Changliu Liu

Physics-informed neural networks (PINNs) constitute a flexible deep learning approach for solving partial differential equations (PDEs), which model phenomena ranging from heat conduction to quantum mechanical systems. Despite their…

Machine Learning · Computer Science 2026-03-17 Aleksander Krasowski , René P. Klausen , Aycan Celik , Sebastian Lapuschkin , Wojciech Samek , Jonas Naujoks

Automated mathematical reasoning is a challenging problem that requires an agent to learn algebraic patterns that contain long-range dependencies. Two particular tasks that test this type of reasoning are (1) mathematical equation…

Machine Learning · Computer Science 2021-04-08 Ankur Mali , Alexander Ororbia , Daniel Kifer , C. Lee Giles

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

Machine Learning · Computer Science 2024-01-17 Soyed Tuhin Ahmed

Physics Informed Neural Networks is a numerical method which uses neural networks to approximate solutions of partial differential equations. It has received a lot of attention and is currently used in numerous physical and engineering…

Numerical Analysis · Mathematics 2025-07-10 Dimitrios Gazoulis , Ioannis Gkanis , Charalambos G. Makridakis

Deep learning (DL) has had unprecedented success and is now entering scientific computing with full force. However, current DL methods typically suffer from instability, even when universal approximation properties guarantee the existence…

Machine Learning · Computer Science 2022-04-04 Matthew J. Colbrook , Vegard Antun , Anders C. Hansen

As machine learning systems are increasingly used to make real world legal and financial decisions, it is of paramount importance that we develop algorithms to verify that these systems do not discriminate against minorities. We design a…

Artificial Intelligence · Computer Science 2020-01-01 Osbert Bastani , Xin Zhang , Armando Solar-Lezama

Understanding the trustworthiness of a prediction yielded by a classifier is critical for the safe and effective use of AI models. Prior efforts have been proven to be reliable on small-scale datasets. In this work, we study the problem of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Yan Luo , Yongkang Wong , Mohan S. Kankanhalli , Qi Zhao

We introduce a practical method to enforce partial differential equation (PDE) constraints for functions defined by neural networks (NNs), with a high degree of accuracy and up to a desired tolerance. We develop a differentiable…

Machine Learning · Computer Science 2023-04-19 Geoffrey Négiar , Michael W. Mahoney , Aditi S. Krishnapriyan

Complete verification of deep neural networks (DNNs) can exactly determine whether the DNN satisfies a desired trustworthy property (e.g., robustness, fairness) on an infinite set of inputs or not. Despite the tremendous progress to improve…

Machine Learning · Computer Science 2023-06-13 Shubham Ugare , Debangshu Banerjee , Sasa Misailovic , Gagandeep Singh

Recently, formal verification of deep neural networks (DNNs) has garnered considerable attention, and over-approximation based methods have become popular due to their effectiveness and efficiency. However, these strategies face challenges…

Artificial Intelligence · Computer Science 2024-01-24 Zhen Liang , Taoran Wu , Ran Zhao , Bai Xue , Ji Wang , Wenjing Yang , Shaojun Deng , Wanwei Liu

We investigate the complexity of the reachability problem for (deep) neural networks: does it compute valid output given some valid input? It was recently claimed that the problem is NP-complete for general neural networks and…

Computational Complexity · Computer Science 2026-04-08 Marco Sälzer , Martin Lange

Software development in the aerospace domain requires adhering to strict, high-quality standards. While there exist regulatory guidelines for commercial software in this domain (e.g., ARP-4754 and DO-178), these do not apply to software…

Software Engineering · Computer Science 2024-08-06 Guy Katz , Natan Levy , Idan Refaeli , Raz Yerushalmi