English
Related papers

Related papers: Towards Probability-based Safety Verification of S…

200 papers

Machine learning has made remarkable advancements, but confidently utilising learning-enabled components in safety-critical domains still poses challenges. Among the challenges, it is known that a rigorous, yet practical, way of achieving…

Machine Learning · Computer Science 2024-09-21 Saddek Bensalem , Chih-Hong Cheng , Wei Huang , Xiaowei Huang , Changshun Wu , Xingyu Zhao

The problem of probabilistic verification of a neural network investigates the probability of satisfying the safe constraints in the output space when the input is given by a probability distribution. It is significant to answer this…

Artificial Intelligence · Computer Science 2026-04-24 Jingyang Li , Xin Chen , Hongfei Fu , Guoqiang Li

Governments, industry, and academia have undertaken efforts to identify and mitigate harms in ML-driven systems, with a particular focus on social and ethical risks of ML components in complex sociotechnical systems. However, existing…

Machine Learning · Computer Science 2022-11-10 Edgar W. Jatho , Logan O. Mailloux , Shalaleh Rismani , Eugene D. Williams , Joshua A. Kroll

Learning-based methods could provide solutions to many of the long-standing challenges in control. However, the neural networks (NNs) commonly used in modern learning approaches present substantial challenges for analyzing the resulting…

Machine Learning · Computer Science 2022-02-03 Michael Everett

As machine learning (ML) technologies and applications are rapidly changing many computing domains, security issues associated with ML are also emerging. In the domain of systems security, many endeavors have been made to ensure ML model…

Cryptography and Security · Computer Science 2022-01-07 Kha Dinh Duy , Taehyun Noh , Siwon Huh , Hojoon Lee

The increasing use of deep neural networks for safety-critical applications, such as autonomous driving and flight control, raises concerns about their safety and reliability. Formal verification can address these concerns by guaranteeing…

Artificial Intelligence · Computer Science 2018-02-06 Lindsey Kuper , Guy Katz , Justin Gottschlich , Kyle Julian , Clark Barrett , Mykel Kochenderfer

Machine Learning (ML) has become a ubiquitous tool for predicting and classifying data and has found application in several problem domains, including Software Development (SD). This paper reviews the literature between 2000 and 2019 on the…

The recent convergence of pervasive computing and machine learning has given rise to numerous services, impacting almost all areas of economic and social activity. However, the use of AI techniques precludes certain standard software…

Software Engineering · Computer Science 2025-12-11 Vladimir Balditsyn , Philippe Lalanda , German Vega , Stéphanie Chollet

Machine learning algorithms are increasingly influencing our decisions and interacting with us in all parts of our daily lives. Therefore, just like for power plants, highways, and myriad other engineered sociotechnical systems, we must…

Machine Learning · Statistics 2016-01-19 Kush R. Varshney

The application of machine learning (ML) in computer systems introduces not only many benefits but also risks to society. In this paper, we develop the concept of ML governance to balance such benefits and risks, with the aim of achieving…

Cryptography and Security · Computer Science 2021-09-23 Varun Chandrasekaran , Hengrui Jia , Anvith Thudi , Adelin Travers , Mohammad Yaghini , Nicolas Papernot

Context: An increasing demand is observed in various domains to employ Machine Learning (ML) for solving complex problems. ML models are implemented as software components and deployed in Machine Learning Software Systems (MLSSs). Problem:…

Software Engineering · Computer Science 2022-08-23 Pierre-Olivier Côté , Amin Nikanjam , Rached Bouchoucha , Foutse Khomh

Deep Neural Networks (DNN) will emerge as a cornerstone in automotive software engineering. However, developing systems with DNNs introduces novel challenges for safety assessments. This paper reviews the state-of-the-art in verification…

Nowadays, systems containing components based on machine learning (ML) methods are becoming more widespread. In order to ensure the intended behavior of a software system, there are standards that define necessary quality aspects of the…

Software Engineering · Computer Science 2020-08-26 Julien Siebert , Lisa Joeckel , Jens Heidrich , Koji Nakamichi , Kyoko Ohashi , Isao Namba , Rieko Yamamoto , Mikio Aoyama

Deep neural networks have achieved impressive experimental results in image classification, but can surprisingly be unstable with respect to adversarial perturbations, that is, minimal changes to the input image that cause the network to…

Artificial Intelligence · Computer Science 2017-05-08 Xiaowei Huang , Marta Kwiatkowska , Sen Wang , Min Wu

Dependability assurance of systems embedding machine learning(ML) components---so called learning-enabled systems (LESs)---is a key step for their use in safety-critical applications. In emerging standardization and guidance efforts, there…

Software Engineering · Computer Science 2023-01-11 Erfan Asaadi , Ewen Denney , Ganesh Pai

The idea of applying machine learning(ML) to solve problems in security domains is almost 3 decades old. As information and communications grow more ubiquitous and more data become available, many security risks arise as well as appetite to…

Cryptography and Security · Computer Science 2016-11-11 Heju Jiang , Jasvir Nagra , Parvez Ahammad

Hardware-based Malware Detectors (HMDs) using Machine Learning (ML) models have shown promise in detecting malicious workloads. However, the conventional black-box based machine learning (ML) approach used in these HMDs fail to address the…

Cryptography and Security · Computer Science 2021-03-23 Harshit Kumar , Nikhil Chawla , Saibal Mukhopadhyay

Machine Learning (ML) represents a pivotal technology for current and future information systems, and many domains already leverage the capabilities of ML. However, deployment of ML in cybersecurity is still at an early stage, revealing a…

Malware presents a persistent threat to user privacy and data integrity. To combat this, machine learning-based (ML-based) malware detection (MD) systems have been developed. However, these systems have increasingly been attacked in recent…

Cryptography and Security · Computer Science 2025-05-19 Ping He , Yuhao Mao , Changjiang Li , Lorenzo Cavallaro , Ting Wang , Shouling Ji

Machine learning (ML) methods are becoming increasingly important in the design economic scenario generators for internal models. Validation of data-driven models differs from classical theory-based models. We discuss two novel aspects of…

Risk Management · Quantitative Finance 2024-12-12 Gero Junike , Solveig Flaig , Ralf Werner