English
Related papers

Related papers: Towards provable probabilistic safety for scalable…

200 papers

Embedding artificial intelligence into systems introduces significant challenges to modern engineering practices. Hazard analysis tools and processes have not yet been adequately adapted to the new paradigm. This paper describes initial…

Software Engineering · Computer Science 2022-03-30 Nikolas Martelaro , Carol J. Smith , Tamara Zilovic

Rapidly evolving AI exhibits increasingly strong autonomy and goal-directed capabilities, accompanied by derivative systemic risks that are more unpredictable, difficult to control, and potentially irreversible. However, current AI safety…

Artificial Intelligence (AI) algorithms are increasingly providing decision making and operational support across multiple domains. AI includes a wide library of algorithms for different problems. One important notion for the adoption of AI…

Artificial Intelligence · Computer Science 2021-11-16 Feras A. Batarseh , Laura Freeman

Certainty around the regulatory environment is crucial to enable responsible AI innovation and foster the social acceptance of these powerful new technologies. One notable source of uncertainty is, however, that the existing legal liability…

Computers and Society · Computer Science 2020-05-20 Olivia J. Erdélyi , Gábor Erdélyi

The United States Department of Defense (DOD) looks to accelerate the development and deployment of AI capabilities across a wide spectrum of defense applications to maintain strategic advantages. However, many common features of AI…

Artificial Intelligence · Computer Science 2025-04-25 Ariel S. Kapusta , David Jin , Peter M. Teague , Robert A. Houston , Jonathan B. Elliott , Grace Y. Park , Shelby S. Holdren

Currently, the dominant paradigm in AI safety is alignment with human values. Here we describe progress on developing an alternative approach to safety, based on ethical rationalism (Gewirth:1978), and propose an inherently safe…

Artificial Intelligence · Computer Science 2023-03-21 András Kornai , Michael Bukatin , Zsolt Zombori

This article offers several contributions to the interdisciplinary project of responsible research and innovation in data science and AI. First, it provides a critical analysis of current efforts to establish practical mechanisms for…

Computers and Society · Computer Science 2021-10-12 Christopher Burr , David Leslie

We present our Balanced, Integrated and Grounded (BIG) argument for assuring the safety of AI systems. The BIG argument adopts a whole-system approach to constructing a safety case for AI systems of varying capability, autonomy and…

Computers and Society · Computer Science 2025-04-01 Ibrahim Habli , Richard Hawkins , Colin Paterson , Philippa Ryan , Yan Jia , Mark Sujan , John McDermid

Artificial intelligence (AI) technologies (re-)shape modern life, driving innovation in a wide range of sectors. However, some AI systems have yielded unexpected or undesirable outcomes or have been used in questionable manners. As a…

The promise of AI is huge. AI systems have already achieved good enough performance to be in our streets and in our homes. However, they can be brittle and unfair. For society to reap the benefits of AI systems, society needs to be able to…

Artificial Intelligence · Computer Science 2020-02-18 Jeannette M. Wing

Artificial Intelligence (AI) has received an increasing amount of attention in multiple areas. The uncertainties and risks in AI-powered systems have created reluctance in their wild adoption. As an economic solution to compensate for…

Artificial Intelligence · Computer Science 2023-06-05 Yunfei Ge , Quanyan Zhu

Neuro-Symbolic Artificial Intelligence (NeSy AI) has emerged as a promising direction for integrating neural learning with symbolic reasoning. Typically, in the probabilistic variant of such systems, a neural network first extracts a set of…

AI safety is still largely framed as alignment: training models to follow human preferences, safety policies, and normative constraints. That framing has improved the behavior of modern language models, but aligned behavior does not by…

Artificial Intelligence · Computer Science 2026-05-27 Yige Li , Yunhao Feng , Jun Sun

As AI models scale to billions of parameters and operate with increasing autonomy, ensuring their safe, reliable operation demands engineering-grade security and assurance frameworks. This paper presents an enterprise-level, risk-aware,…

Cryptography and Security · Computer Science 2025-05-13 Krti Tallam

Risks associated with the use of AI, ranging from algorithmic bias to model hallucinations, have received much attention and extensive research across the AI community, from researchers to end-users. However, a gap exists in the systematic…

Artificial Intelligence · Computer Science 2025-11-21 Raymond K. Sheh , Karen Geappen

Artificial Intelligence (AI) is becoming the corner stone of many systems used in our daily lives such as autonomous vehicles, healthcare systems, and unmanned aircraft systems. Machine Learning is a field of AI that enables systems to…

Artificial Intelligence · Computer Science 2022-06-27 Lionel Nganyewou Tidjon , Foutse Khomh

As AI technologies increase in capability and ubiquity, AI accidents are becoming more common. Based on normal accident theory, high reliability theory, and open systems theory, we create a framework for understanding the risks associated…

Computers and Society · Computer Science 2024-03-13 Heather M. Williams , Roman V. Yampolskiy

Artificial Intelligence (AI) systems are increasingly prominent in emerging smart cities, yet their reliability remains a critical concern. These systems typically operate through a sequence of interconnected functional stages, where…

Artificial Intelligence · Computer Science 2026-03-20 Fenglian Pan , Yinwei Zhang , Yili Hong , Larry Head , Jian Liu

Frontier AI systems are being adopted across Africa, yet most AI safety evaluations are designed and validated in Western environments. In this paper, we argue that the portability gap can leave Africa-centric pathways to severe harm…

Provable safety is one of the most critical challenges in automated driving. The behavior of numerous traffic participants in a scene cannot be predicted reliably due to complex interdependencies and the indiscriminate behavior of humans.…

Robotics · Computer Science 2019-05-07 Piotr Franciszek Orzechowski , Annika Meyer , Martin Lauer