English
Related papers

Related papers: AI safety: state of the field through quantitative…

200 papers

Safety has become the central value around which dominant AI governance efforts are being shaped. Recently, this culminated in the publication of the International AI Safety Report, written by 96 experts of which 30 nominated by the…

Computers and Society · Computer Science 2025-03-10 Roel Dobbe

Ttraditional safety engineering is coming to a turning point moving from deterministic, non-evolving systems operating in well-defined contexts to increasingly autonomous and learning-enabled AI systems which are acting in largely…

Artificial Intelligence · Computer Science 2022-05-13 Harald Rueß , Simon Burton

The deployment of artificial intelligence (AI) applications has accelerated rapidly. AI enabled technologies are facing the public in many ways including infrastructure, consumer products and home applications. Because many of these…

Artificial Intelligence · Computer Science 2024-08-01 Joanna F. DeFranco , Luke Biersmith

Assuring safety of artificial intelligence (AI) applied to safety-critical systems is of paramount importance. Especially since research in the field of automated driving shows that AI is able to outperform classical approaches, to handle…

Computers and Society · Computer Science 2025-04-28 Lars Ullrich , Michael Buchholz , Klaus Dietmayer , Knut Graichen

Artificial Intelligence (AI) has emerged as a key technology, driving advancements across a range of applications. Its integration into modern autonomous systems requires assuring safety. However, the challenge of assuring safety in systems…

Machine Learning · Computer Science 2024-12-19 Ronald Schnitzer , Lennart Kilian , Simon Roessner , Konstantinos Theodorou , Sonja Zillner

Artificial Intelligence (AI) is an effective science which employs strong enough approaches, methods, and techniques to solve unsolvable real world based problems. Because of its unstoppable rise towards the future, there are also some…

Artificial Intelligence · Computer Science 2017-06-12 Alice Pavaloiu , Utku Kose

AI safety benchmarks are pivotal for safety in advanced AI systems; however, they have significant technical, epistemic, and sociotechnical shortcomings. We present a review of 210 safety benchmarks that maps out common challenges in safety…

Computers and Society · Computer Science 2026-02-10 Cheng Yu , Severin Engelmann , Ruoxuan Cao , Dalia Ali , Orestis Papakyriakopoulos

AI-based systems have been used widely across various industries for different decisions ranging from operational decisions to tactical and strategic ones in low- and high-stakes contexts. Gradually the weaknesses and issues of these…

Human-Computer Interaction · Computer Science 2022-01-13 Morteza Saberi

Current efforts in AI safety prioritize filtering harmful content, preventing manipulation of human behavior, and eliminating existential risks in cybersecurity or biosecurity. While pressing, this narrow focus overlooks critical…

Computers and Society · Computer Science 2025-07-14 Sanchaita Hazra , Bodhisattwa Prasad Majumder , Tuhin Chakrabarty

In this paper we discuss how systems with Artificial Intelligence (AI) can undergo safety assessment. This is relevant, if AI is used in safety related applications. Taking a deeper look into AI models, we show, that many models of…

Artificial Intelligence · Computer Science 2021-05-17 Jens Braband , Hendrik Schäbe

The development of Artificial General Intelligence (AGI) promises to be a major event. Along with its many potential benefits, it also raises serious safety concerns (Bostrom, 2014). The intention of this paper is to provide an easily…

Artificial Intelligence · Computer Science 2018-05-22 Tom Everitt , Gary Lea , Marcus Hutter

The rapid advancement of artificial intelligence (AI) technologies presents profound challenges to societal safety. As AI systems become more capable, accessible, and integrated into critical services, the dual nature of their potential is…

Artificial Intelligence · Computer Science 2024-12-06 Giulio Corsi , Kyle Kilian , Richard Mallah

As AI technologies increase in capability and ubiquity, AI accidents are becoming more common. Based on normal accident theory, high reliability theory, and open systems theory, we create a framework for understanding the risks associated…

Computers and Society · Computer Science 2024-03-13 Heather M. Williams , Roman V. Yampolskiy

AI advancements have been significantly driven by a combination of foundation models and curiosity-driven learning aimed at increasing capability and adaptability. Within this landscape, open-endedness, where AI agents autonomously and…

Artificial Intelligence · Computer Science 2026-05-06 Ivaxi Sheth , Jan Wehner , Sahar Abdelnabi , Ruta Binkyte , Mario Fritz

The potential presented by Artificial Intelligence (AI) for healthcare has long been recognised by the technical community. More recently, this potential has been recognised by policymakers, resulting in considerable public and private…

Artificial Intelligence · Computer Science 2021-04-15 Jessica Morley , Caroline Morton , Kassandra Karpathakis , Mariarosaria Taddeo , Luciano Floridi

The recent development of artificial intelligence (AI) has increased the interest of researchers and practitioners towards applying its techniques into multiple domains like automotive, health care and air space to achieve automation.…

Artificial Intelligence · Computer Science 2022-05-18 Rafia Inam , Alberto Yukinobu Hata , Vlasjov Prifti , Sara Abbaspour Asadollah

The issues of AI risk and AI safety are becoming critical as the prospect of artificial general intelligence (AGI) looms larger. The emergence of extremely large and capable generative models has led to alarming predictions and created a…

Artificial Intelligence · Computer Science 2025-05-20 Ali A. Minai

The use of Artificial Intelligence (AI) in high-risk, decision-making scenarios presents technical, safety, and normative challenges; problems that may only be ameliorated by human oversight. However, notions of human oversight lack a…

As artificial intelligence becomes increasingly integrated into software development processes, the prevalence and sophistication of AI-generated code continue to expand rapidly. This study addresses the critical need for transparency and…

Software Engineering · Computer Science 2025-05-28 David Hanson

AI technology has a long history which is actively and constantly changing and growing. It focuses on intelligent agents, which contain devices that perceive the environment and based on which takes actions in order to maximize goal success…

Artificial Intelligence · Computer Science 2018-04-05 Jahanzaib Shabbir , Tarique Anwer