English
Related papers

Related papers: Principles for new ASI Safety Paradigms

200 papers

Verified artificial intelligence (AI) is the goal of designing AI-based systems that that have strong, ideally provable, assurances of correctness with respect to mathematically-specified requirements. This paper considers Verified AI from…

Artificial Intelligence · Computer Science 2020-07-24 Sanjit A. Seshia , Dorsa Sadigh , S. Shankar Sastry

Recent developments in artificial intelligence (AI) have permeated through an array of different immersive environments, including virtual, augmented, and mixed realities. AI brings a wealth of potential that centers on its ability to…

Human-Computer Interaction · Computer Science 2024-05-10 Wangfan Li , Rohit Mallick , Carlos Toxtli-Hernandez , Christopher Flathmann , Nathan J. McNeese

AI agents have been boosted by large language models. AI agents can function as intelligent assistants and complete tasks on behalf of their users with access to tools and the ability to execute commands in their environments. Through…

Cryptography and Security · Computer Science 2024-12-19 Yifeng He , Ethan Wang , Yuyang Rong , Zifei Cheng , Hao Chen

Superhuman artificial general intelligence could be created this century and would likely be a significant source of existential risk. Delaying the creation of superintelligent AI (ASI) could decrease total existential risk by increasing…

Computers and Society · Computer Science 2022-09-13 Stephen McAleese

There are many goals for an AI that could become dangerous if the AI becomes superintelligent or otherwise powerful. Much work on the AI control problem has been focused on constructing AI goals that are safe even for such AIs. This paper…

Artificial Intelligence · Computer Science 2017-05-31 Stuart Armstrong , Benjamin Levinstein

This article provides a critical overview of the recently approved Artificial Intelligence Act. It starts by presenting the main structure, objectives, and approach of Regulation (EU) 2024/1689. A definition of key concepts follows, and…

Computers and Society · Computer Science 2024-09-04 Nuno Sousa e Silva

The lack of explainability of Artificial Intelligence (AI) is one of the first obstacles that the industry and regulators must overcome to mitigate the risks associated with the technology. The need for eXplainable AI (XAI) is evident in…

Computers and Society · Computer Science 2025-02-24 Georgios Pavlidis

Robotics and Artificial Intelligence (AI) have been inextricably intertwined since their inception. Today, AI-Robotics systems have become an integral part of our daily lives, from robotic vacuum cleaners to semi-autonomous cars. These…

AI technology has a long history which is actively and constantly changing and growing. It focuses on intelligent agents, which contain devices that perceive the environment and based on which takes actions in order to maximize goal success…

Artificial Intelligence · Computer Science 2018-04-05 Jahanzaib Shabbir , Tarique Anwer

Assuring safety for ``AI-based'' systems is one of the current challenges in safety engineering. For automated driving systems, in particular, further assurance challenges result from the open context that the systems need to operate in…

Systems and Control · Electrical Eng. & Systems 2025-07-29 Marcus Nolte , Nayel Fabian Salem , Olaf Franke , Jan Heckmann , Christoph Höhmann , Georg Stettinger , Markus Maurer

Superintelligence is a hypothetical agent that possesses intelligence far surpassing that of the brightest and most gifted human minds. In light of recent advances in machine intelligence, a number of scientists, philosophers and…

Computers and Society · Computer Science 2021-01-12 Manuel Alfonseca , Manuel Cebrian , Antonio Fernandez Anta , Lorenzo Coviello , Andres Abeliuk , Iyad Rahwan

Dramatic advances in artificial intelligence over the past decade (for narrow-purpose AI) and the last several years (for general-purpose AI) have transformed AI from a niche academic field to the core business strategy of many of the…

Computers and Society · Computer Science 2025-03-10 Anthony Aguirre

While autonomous agents often surpass humans in their ability to handle vast and complex data, their potential misalignment (i.e., lack of transparency regarding their true objective) has thus far hindered their use in critical applications…

Artificial Intelligence · Computer Science 2024-12-03 Frédéric Berdoz , Roger Wattenhofer

With the introduction of Artificial Intelligence (AI) and related technologies in our daily lives, fear and anxiety about their misuse as well as the hidden biases in their creation have led to a demand for regulation to address such…

Artificial Intelligence · Computer Science 2021-04-09 The Anh Han , Tom Lenaerts , Francisco C. Santos , Luis Moniz Pereira

By defining the current limits (and thereby the frontiers), many boundaries are shaping, and will continue to shape, the future of Artificial Intelligence (AI). We push on these boundaries in order to make further progress into what were…

Artificial Intelligence · Computer Science 2022-05-27 Ryan Watkins , Soheil Human

Legislation and public sentiment throughout the world have promoted fairness metrics, explainability, and interpretability as prescriptions for the responsible development of ethical artificial intelligence systems. Despite the importance…

Artificial Intelligence · Computer Science 2022-03-08 Erick Galinkin

In this paper we discuss how systems with Artificial Intelligence (AI) can undergo safety assessment. This is relevant, if AI is used in safety related applications. Taking a deeper look into AI models, we show, that many models of…

Artificial Intelligence · Computer Science 2021-05-17 Jens Braband , Hendrik Schäbe

The increasing attention on Artificial Intelligence (AI) regulation has led to the definition of a set of ethical principles grouped into the Sustainable AI framework. In this article, we identify Continual Learning, an active area of AI…

Artificial Intelligence · Computer Science 2021-11-19 Andrea Cossu , Marta Ziosi , Vincenzo Lomonaco

This paper examines the strategic dynamics of international competition to develop Artificial Superintelligence (ASI). We argue that the same assumptions that might motivate the US to race to develop ASI also imply that such a race is…

Computers and Society · Computer Science 2025-01-28 Corin Katzke , Gideon Futerman

In the rapidly evolving domain of Artificial Intelligence (AI), the complex interaction between innovation and regulation has become an emerging focus of our society. Despite tremendous advancements in AI's capabilities to excel in specific…

Artificial Intelligence · Computer Science 2025-02-07 Nan Sun , Yuantian Miao , Hao Jiang , Ming Ding , Jun Zhang