English
Related papers

Related papers: Superintelligence Safety: A Requirements Engineeri…

200 papers

As progress in AI continues to advance, it is important to know how advanced systems will make choices and in what ways they may fail. Machines can already outsmart humans in some domains, and understanding how to safely build ones which…

Artificial Intelligence · Computer Science 2023-04-04 Stephen Casper

How to make artificial intelligence (AI) systems safe and aligned with human values is an open research question. Proposed solutions tend toward relying on human intervention in uncertain situations, learning human values and intentions…

Computers and Society · Computer Science 2023-10-04 Jeffrey W. Johnston

Artificial Intelligence (AI) systems are increasingly used in high-stakes domains of our life, increasing the need to explain these decisions and to make sure that they are aligned with how we want the decision to be made. The field of…

Artificial Intelligence · Computer Science 2023-06-28 Sofie Goethals , David Martens , Theodoros Evgeniou

As artificial intelligence systems grow more powerful, there has been increasing interest in "AI safety" research to address emerging and future risks. However, the field of AI safety remains poorly defined and inconsistently measured,…

AI that can accelerate research could drive a century of technological progress over just a few years. During such a period, new technological or political developments will raise consequential and hard-to-reverse decisions, in rapid…

Computers and Society · Computer Science 2025-06-19 William MacAskill , Fin Moorhouse

As AI rapidly advances, the security risks posed by AI are becoming increasingly severe, especially in critical scenarios, including those posing existential risks. If AI becomes uncontrollable, manipulated, or actively evades safety…

Artificial Intelligence · Computer Science 2025-08-29 Donglin Wang , Weiyun Liang , Chunyuan Chen , Jing Xu , Yulong Fu

The rise of connectivity, digitalization, robotics, and artificial intelligence (AI) is rapidly changing our society and shaping its future development. During this technological and societal revolution, security has been persistently…

Cryptography and Security · Computer Science 2018-07-06 Alberto Giaretta , Michele De Donno , Nicola Dragoni

The deployment of artificial intelligence (AI) applications has accelerated rapidly. AI enabled technologies are facing the public in many ways including infrastructure, consumer products and home applications. Because many of these…

Artificial Intelligence · Computer Science 2024-08-01 Joanna F. DeFranco , Luke Biersmith

Humanity is progressing towards automated product development, a trend that promises faster creation of better products and thus the acceleration of technological progress. However, increasing reliance on non-human agents for this process…

Computers and Society · Computer Science 2025-06-03 Jan Göpfert , Jann M. Weinand , Patrick Kuckertz , Noah Pflugradt , Jochen Linßen

As the deployment of artificial intelligence (AI) is changing many fields and industries, there are concerns about AI systems making decisions and recommendations without adequately considering various ethical aspects, such as…

Computers and Society · Computer Science 2023-10-02 Conrad Sanderson , Qinghua Lu , David Douglas , Xiwei Xu , Liming Zhu , Jon Whittle

From its inception, AI has had a rather ambivalent relationship to humans---swinging between their augmentation and replacement. Now, as AI technologies enter our everyday lives at an ever increasing pace, there is a greater need for AI…

Artificial Intelligence · Computer Science 2019-10-17 Subbarao Kambhampati

Recently, a lot of attention has been given to undesired consequences of Artificial Intelligence (AI), such as unfair bias leading to discrimination, or the lack of explanations of the results of AI systems. There are several important…

Computers and Society · Computer Science 2019-12-23 Richard Benjamins , Alberto Barbado , Daniel Sierra

This research paper explores the privacy and security threats posed to an Agentic AI system with direct access to database systems. Such access introduces significant risks, including unauthorized retrieval of sensitive information,…

Cryptography and Security · Computer Science 2024-12-10 Raihan Khan , Sayak Sarkar , Sainik Kumar Mahata , Edwin Jose

This paper identifies and tackles the challenges of the requirements engineering discipline when applied to development of AI-based complex systems. Due to their complex behaviour, there is an immanent need for a tailored development…

Software Engineering · Computer Science 2019-09-02 Hrvoje Belani , Marin Vuković , Željka Car

This paper examines the strategic dynamics of international competition to develop Artificial Superintelligence (ASI). We argue that the same assumptions that might motivate the US to race to develop ASI also imply that such a race is…

Computers and Society · Computer Science 2025-01-28 Corin Katzke , Gideon Futerman

By defining the current limits (and thereby the frontiers), many boundaries are shaping, and will continue to shape, the future of Artificial Intelligence (AI). We push on these boundaries in order to make further progress into what were…

Artificial Intelligence · Computer Science 2022-05-27 Ryan Watkins , Soheil Human

Artificial Intelligence (AI) has rapidly evolved over the past decade and has advanced in areas such as language comprehension, image and video recognition, programming, and scientific reasoning. Recent AI technologies based on large…

Machine Learning · Computer Science 2024-10-30 Jonghong Jeon

The deployment of capable AI agents raises fresh questions about safety, human-machine relationships and social coordination. We argue for greater engagement by scientists, scholars, engineers and policymakers with the implications of a…

Computers and Society · Computer Science 2025-09-15 Iason Gabriel , Geoff Keeling , Arianna Manzini , James Evans

We argue that the trend toward providing users with feasible and actionable explanations of AI decisions, known as recourse explanations, comes with ethical downsides. Specifically, we argue that recourse explanations face several…

Computers and Society · Computer Science 2024-06-19 Emily Sullivan , Atoosa Kasirzadeh

We consider a series of legal provocations emerging from the proposed European Union AI Act 2021 (AIA) and how they open up new possibilities for HCI in the design and development of trustworthy autonomous systems. The AIA continues the by…

Human-Computer Interaction · Computer Science 2022-06-16 Lachlan D. Urquhart , Glenn McGarry , Andy Crabtree