English
Related papers

Related papers: CORTEX: Composite Overlay for Risk Tiering and Exp…

200 papers

To understand and identify the unprecedented risks posed by rapidly advancing artificial intelligence (AI) models, this report presents a comprehensive assessment of their frontier risks. Drawing on the E-T-C analysis (deployment…

Enterprise AI Assistants are increasingly deployed in domains where accuracy is paramount, making each erroneous output a potentially significant incident. This paper presents a comprehensive framework for monitoring, benchmarking, and…

Artificial Intelligence · Computer Science 2025-04-22 Akash V. Maharaj , David Arbour , Daniel Lee , Uttaran Bhattacharya , Anup Rao , Austin Zane , Avi Feller , Kun Qian , Yunyao Li

As AI systems become increasingly capable and ubiquitous, ensuring the safety of these systems is critical. However, existing safety tools often target different aspects of model safety and cannot provide full assurance in isolation,…

Artificial Intelligence · Computer Science 2025-07-15 Harshal Nandigramwar , Syed Qutub , Kay-Ulrich Scholl

Collaborative AI systems aim at working together with humans in a shared space to achieve a common goal. This setting imposes potentially hazardous circumstances due to contacts that could harm human beings. Thus, building such systems with…

Software Engineering · Computer Science 2021-03-15 Matteo Camilli , Michael Felderer , Andrea Giusti , Dominik T. Matt , Anna Perini , Barbara Russo , Angelo Susi

Through a systematic review of academic literature, we propose a taxonomy of systemic risks associated with artificial intelligence (AI), in particular general-purpose AI. Following the EU AI Act's definition, we consider systemic risks as…

Over the past year, artificial intelligence (AI) companies have been increasingly adopting AI safety frameworks. These frameworks outline how companies intend to keep the potential risks associated with developing and deploying frontier AI…

Computers and Society · Computer Science 2024-09-16 Jide Alaga , Jonas Schuett , Markus Anderljung

In this study, we investigate system-level emergent risks of interacting AI agents. The core contribution of this work is an exploratory scenario-based identification of these risks as well as their categorization. We consider a multitude…

Computers and Society · Computer Science 2025-12-22 Paul Darius , Thomas Hoppe , Andrei Aleksandrov

The recent development of powerful AI systems has highlighted the need for robust risk management frameworks in the AI industry. Although companies have begun to implement safety frameworks, current approaches often lack the systematic…

Artificial Intelligence · Computer Science 2025-02-20 Simeon Campos , Henry Papadatos , Fabien Roger , Chloé Touzet , Otter Quarks , Malcolm Murray

This paper proposes a comprehensive analysis of existing concepts coming from different disciplines tackling the notion of intelligence, namely psychology and engineering, and from disciplines aiming to regulate AI innovations, namely AI…

Artificial Intelligence · Computer Science 2021-05-10 Gauthier Chassang , Mogens Thomsen , Pierre Rumeau , Florence Sèdes , Alejandra Delfin

Embedded into information systems, artificial intelligence (AI) faces security threats that exploit AI-specific vulnerabilities. This paper provides an accessible overview of adversarial attacks unique to predictive and generative AI…

Cryptography and Security · Computer Science 2025-07-01 Naoto Kiribuchi , Kengo Zenitani , Takayuki Semitsu

This chapter bridges technical analysis and organizational preparedness by tracing the path from layered failure modes to reliability awareness in generative and agentic AI systems. We first introduce an 11-layer failure stack, a structured…

Systems and Control · Electrical Eng. & Systems 2025-11-11 Janet , Lin , Liangwei Zhang

As AI systems increasingly influence critical decisions, they face threats that exploit reasoning mechanisms rather than technical infrastructure. We present a framework for cognitive cybersecurity, a systematic protection of AI reasoning…

Cryptography and Security · Computer Science 2025-08-25 Yuksel Aydin

AI incident reporting requirements are emerging in regulation and policy, yet no operational criteria exist for determining when a detected AI incident warrants escalation beyond national handling to international coordination. This paper…

Computers and Society · Computer Science 2026-05-20 Francesca Gomez , Matthew Ball , Michael Harre , Lydia Preston , Josephine Schwab , Caio Machado

As generative AI systems, including large language models (LLMs) and diffusion models, advance rapidly, their growing adoption has led to new and complex security risks often overlooked in traditional AI risk assessment frameworks. This…

Cryptography and Security · Computer Science 2024-10-21 Aviral Srivastava , Sourav Panda

Cybersecurity spans multiple interconnected domains, complicating the development of meaningful, labor-relevant benchmarks. Existing benchmarks assess isolated skills rather than integrated performance. We find that pre-trained knowledge of…

Artificial Intelligence (AI) technology epitomizes the complex challenges posed by human-made artifacts, particularly those widely integrated into society and exerting significant influence, highlighting potential benefits and their…

Artificial Intelligence · Computer Science 2025-10-06 Michael Papademas , Xenia Ziouvelou , Antonis Troumpoukis , Vangelis Karkaletsis

The rapid diffusion of agentic AI has created a new coverage problem for commercial insurance: some AI-mediated losses are now affirmatively insured, some create silent-AI exposure under legacy cyber, technology errors-and-omissions (E&O),…

Risk Management · Quantitative Finance 2026-05-20 Alex Leung , Rex Zhang , Ervin Ling , Kentaroh Toyoda , SiewMei Loh

Artificial intelligence systems are increasingly embedded in high-stakes decision environments, yet many governance approaches focus primarily on policy guidance rather than operational stability mechanisms. As AI deployments scale,…

Computers and Society · Computer Science 2026-04-07 Horatio Morgan

When AI systems make errors in high-stakes domains like medical diagnosis or autonomous vehicles, a single algorithmic flaw across varying operational contexts can generate highly heterogeneous losses that challenge traditional insurance…

Machine Learning · Computer Science 2026-03-31 Dimitris Bertsimas , Agni Orfanoudaki

The rapid evolution of generative AI has expanded the breadth of risks associated with AI systems. While various taxonomies and frameworks exist to classify these risks, the lack of interoperability between them creates challenges for…