English
Related papers

Related papers: SoK: On the Offensive Potential of AI

200 papers

As artificial intelligence (AI) becomes deeply embedded in critical services and everyday products, it is increasingly exposed to security threats which traditional cyber defenses were not designed to handle. In this paper, we investigate…

Cryptography and Security · Computer Science 2026-03-06 Natalia Krawczyk , Mateusz Szczepkowski , Adrian Brodzik , Krzysztof Bocianiak

An Artificial Intelligence (AI) agent is a software entity that autonomously performs tasks or makes decisions based on pre-defined objectives and data inputs. AI agents, capable of perceiving user inputs, reasoning and planning tasks, and…

Cryptography and Security · Computer Science 2025-11-26 Zehang Deng , Yongjian Guo , Changzhou Han , Wanlun Ma , Junwu Xiong , Sheng Wen , Yang Xiang

As the social implementation of AI has been steadily progressing, research and development related to AI security has also been increasing. However, existing studies have been limited to organizing related techniques, attacks, defenses, and…

Cryptography and Security · Computer Science 2025-08-13 Hiroya Kato , Kentaro Kita , Kento Hasegawa , Seira Hidano

As AI systems become more advanced, concerns about large-scale risks from misuse or accidents have grown. This report analyzes the technical research into safe AI development being conducted by three leading AI companies: Anthropic, Google…

Computers and Society · Computer Science 2024-09-26 Oscar Delaney , Oliver Guest , Zoe Williams

The rise of AI has transformed the software and hardware landscape, enabling powerful capabilities through specialized infrastructures, large-scale data storage, and advanced hardware. However, these innovations introduce unique attack…

Cryptography and Security · Computer Science 2025-08-29 Michael R Smith , Joe Ingram

Industrial systems are increasingly threatened by cyberattacks with potentially disastrous consequences. To counter such attacks, industrial intrusion detection systems strive to timely uncover even the most sophisticated breaches. Due to…

Cryptography and Security · Computer Science 2023-11-07 Olav Lamberts , Konrad Wolsing , Eric Wagner , Jan Pennekamp , Jan Bauer , Klaus Wehrle , Martin Henze

Quantitative Artificial Intelligence (AI) Benchmarks have emerged as fundamental tools for evaluating the performance, capability, and safety of AI models and systems. Currently, they shape the direction of AI development and are playing an…

Artificial Intelligence · Computer Science 2025-05-27 Maria Eriksson , Erasmo Purificato , Arman Noroozian , Joao Vinagre , Guillaume Chaslot , Emilia Gomez , David Fernandez-Llorca

Over the last decade, adversarial attack algorithms have revealed instabilities in deep learning tools. These algorithms raise issues regarding safety, reliability and interpretability in artificial intelligence; especially in high risk…

Numerical Analysis · Mathematics 2023-08-30 Desmond J. Higham

Recently, a lot of attention has been given to undesired consequences of Artificial Intelligence (AI), such as unfair bias leading to discrimination, or the lack of explanations of the results of AI systems. There are several important…

Computers and Society · Computer Science 2019-12-23 Richard Benjamins , Alberto Barbado , Daniel Sierra

As machine learning becomes more widely used, the need to study its implications in security and privacy becomes more urgent. Although the body of work in privacy has been steadily growing over the past few years, research on the privacy…

Cryptography and Security · Computer Science 2023-09-19 Maria Rigaki , Sebastian Garcia

The state of artificial intelligence technology has a rich history that dates back decades and includes two fall-outs before the explosive resurgence of today, which is credited largely to data-driven techniques. While AI technology has and…

Artificial Intelligence · Computer Science 2022-02-08 Anu K. Myne , Kevin J. Leahy , Ryan J. Soklaski

Recent works have identified a gap between research and practice in artificial intelligence security: threats studied in academia do not always reflect the practical use and security risks of AI. For example, while models are often studied…

Cryptography and Security · Computer Science 2024-03-27 Kathrin Grosse , Lukas Bieringer , Tarek Richard Besold , Alexandre Alahi

Artificial intelligence (AI) systems are being readily and rapidly adopted, increasingly permeating critical domains: from consumer platforms and enterprise software to networked systems with embedded agents. While this has unlocked…

Cryptography and Security · Computer Science 2025-12-16 Amy Chang , Tiffany Saade , Sanket Mendapara , Adam Swanda , Ankit Garg

Artificial Intelligence Impact Assessments ("AIIAs"), a family of tools that provide structured processes to imagine the possible impacts of a proposed AI system, have become an increasingly popular proposal to govern AI systems. Recent…

Computers and Society · Computer Science 2023-11-21 Nari Johnson , Hoda Heidari

Artificial Intelligence (AI) has the potential to revolutionize various sectors, yet its adoption is often hindered by concerns about data privacy, security, and the understanding of AI capabilities. This paper synthesizes AI governance…

Computers and Society · Computer Science 2024-10-04 Dian W. Tjondronegoro

In an era where digital threats are increasingly sophisticated, the intersection of Artificial Intelligence and cybersecurity presents both promising defenses and potent dangers. This paper delves into the escalating threat posed by the…

Cryptography and Security · Computer Science 2024-08-26 Yusuf Usman , Aadesh Upadhyay , Prashnna Gyawali , Robin Chataut

This article deals with the IT security of connectionist artificial intelligence (AI) applications, focusing on threats to integrity, one of the three IT security goals. Such threats are for instance most relevant in prominent AI computer…

Cryptography and Security · Computer Science 2020-07-30 Christian Berghoff , Matthias Neu , Arndt von Twickel

Artificial intelligence (AI) is an emerging technology that has the potential to transform many aspects of society, including the economy, healthcare, and transportation. This article synthesizes recent research literature on the global…

Cryptography and Security · Computer Science 2024-01-24 Chandregowda Pachegowda

This work examines an imbalance in artificial intelligence (AI) security research: the field tends to produce more work on attacking AI systems than on defending them. Drawing on related academic papers, we find biased attack-to-defense…

Cryptography and Security · Computer Science 2026-05-25 Youqian Zhang

Artificial intelligence (AI) is reshaping society, from video generation to medical diagnosis, coding agents to autonomous vehicles. Yet researchers, policymakers, and technology companies lack shared terminology for discussing AI risks.…