English
Related papers

Related papers: Certifiers Make Neural Networks Vulnerable to Avai…

200 papers

Robustness verification of neural networks, referring to formally proving that neural networks satisfy robustness properties, is of crucial importance in safety-critical applications, where model failures can result in loss of human life or…

Machine Learning · Computer Science 2026-04-06 Minh Le , Phuong Cao

As neural networks (NNs) become more prevalent in safety-critical applications such as control of vehicles, there is a growing need to certify that systems with NN components are safe. This paper presents a set of backward reachability…

Systems and Control · Electrical Eng. & Systems 2022-11-22 Nicholas Rober , Sydney M. Katz , Chelsea Sidrane , Esen Yel , Michael Everett , Mykel J. Kochenderfer , Jonathan P. How

Availability attacks, which poison the training data with imperceptible perturbations, can make the data \emph{not exploitable} by machine learning algorithms so as to prevent unauthorized use of data. In this work, we investigate why these…

Machine Learning · Computer Science 2022-06-03 Da Yu , Huishuai Zhang , Wei Chen , Jian Yin , Tie-Yan Liu

Neural networks are one of the most investigated and widely used techniques in Machine Learning. In spite of their success, they still find limited application in safety- and security-related contexts, wherein assurance about networks'…

Artificial Intelligence · Computer Science 2018-05-28 Francesco Leofante , Nina Narodytska , Luca Pulina , Armando Tacchella

Deep neural networks can be trained to be efficient and effective controllers for dynamical systems; however, the mechanics of deep neural networks are complex and difficult to guarantee. This work presents a general approach for providing…

Systems and Control · Computer Science 2019-06-05 Kyle D. Julian , Mykel J. Kochenderfer

Ensuring the reliability of machine learning-based intrusion detection systems remains a critical challenge in Internet of Things (IoT) environments, particularly as data poisoning attacks increasingly threaten the integrity of model…

As spiking neural networks (SNNs) are deployed increasingly in real-world efficiency critical applications, the security concerns in SNNs attract more attention. Currently, researchers have already demonstrated an SNN can be attacked with…

Neural and Evolutionary Computing · Computer Science 2022-05-04 Ling Liang , Kaidi Xu , Xing Hu , Lei Deng , Yuan Xie

Data poisoning attacks and backdoor attacks aim to corrupt a machine learning classifier via modifying, adding, and/or removing some carefully selected training examples, such that the corrupted classifier makes incorrect predictions as the…

Cryptography and Security · Computer Science 2021-12-03 Jinyuan Jia , Yupei Liu , Xiaoyu Cao , Neil Zhenqiang Gong

Malware, or software designed with harmful intent, is an ever-evolving threat that can have drastic effects on both individuals and institutions. Neural network malware classification systems are key tools for combating these threats but…

Cryptography and Security · Computer Science 2024-04-09 Preston K. Robinette , Diego Manzanas Lopez , Serena Serbinowska , Kevin Leach , Taylor T. Johnson

Recent works show that Graph Neural Networks (GNNs) are highly non-robust with respect to adversarial attacks on both the graph structure and the node attributes, making their outcomes unreliable. We propose the first method for certifiable…

Machine Learning · Computer Science 2019-07-01 Daniel Zügner , Stephan Günnemann

Modern machine learning pipelines leverage large amounts of public data, making it infeasible to guarantee data quality and leaving models open to poisoning and backdoor attacks. Provably bounding model behavior under such attacks remains…

Machine Learning · Computer Science 2024-10-31 Philip Sosnin , Mark N. Müller , Maximilian Baader , Calvin Tsay , Matthew Wicker

In the rapidly evolving field of cybersecurity, ensuring the reproducibility of AI-driven research is critical to maintaining the reliability and integrity of security systems. This paper addresses the reproducibility crisis within the…

Machine Learning · Computer Science 2024-12-17 Richard H. Moulton , Gary A. McCully , John D. Hastings

Machine learning components are now central to AI-infused software systems, from recommendations and code assistants to clinical decision support. As regulations and governance frameworks increasingly require deleting sensitive data from…

Machine Learning · Computer Science 2026-04-21 Anna Mazhar , Sainyam Galhotra

As the capacity of deep neural networks (DNNs) increases, their need for huge amounts of data significantly grows. A common practice is to outsource the training process or collect more data over the Internet, which introduces the risks of…

Machine Learning · Computer Science 2023-11-14 Soroush Hashemifar , Saeed Parsa , Morteza Zakeri-Nasrabadi

In this paper, we show how Behavior Trees that have performance guarantees, in terms of safety and goal convergence, can be extended with components that were designed using machine learning, without destroying those performance guarantees.…

Robotics · Computer Science 2022-07-26 Christopher Iliffe Sprague , Petter Ögren

Black-box adversarial attacks have demonstrated strong potential to compromise machine learning models by iteratively querying the target model or leveraging transferability from a local surrogate model. Recently, such attacks can be…

Machine Learning · Computer Science 2024-09-09 Hanbin Hong , Xinyu Zhang , Binghui Wang , Zhongjie Ba , Yuan Hong

Deep neural networks have become widely used, obtaining remarkable results in domains such as computer vision, speech recognition, natural language processing, audio recognition, social network filtering, machine translation, and…

Neural and Evolutionary Computing · Computer Science 2020-02-03 Divya Gopinath , Guy Katz , Corina S. Pasareanu , Clark Barrett

Over the last decade, adversarial attack algorithms have revealed instabilities in deep learning tools. These algorithms raise issues regarding safety, reliability and interpretability in artificial intelligence; especially in high risk…

Numerical Analysis · Mathematics 2023-08-30 Desmond J. Higham

We argue that trustworthy AI agents, especially in high-stakes and policy-governed domains, should make execution conditional on certified traces rather than rely only on stronger generative models, output-level guardrails, or post-hoc…

Computational Engineering, Finance, and Science · Computer Science 2026-05-26 Xiao-Yang Liu Yanglet , Xiaodong Wang , Agostino Capponi

Machine learning models are highly vulnerable to label flipping, i.e., the adversarial modification (poisoning) of training labels to compromise performance. Thus, deriving robustness certificates is important to guarantee that test…

Machine Learning · Computer Science 2025-03-04 Mahalakshmi Sabanayagam , Lukas Gosch , Stephan Günnemann , Debarghya Ghoshdastidar