English
Related papers

Related papers: Frontier AI Risk Management Framework in Practice:…

200 papers

Several jurisdictions are starting to regulate frontier artificial intelligence (AI) systems, i.e. general-purpose AI systems that match or exceed the capabilities present in the most advanced systems. To reduce risks from these systems,…

Computers and Society · Computer Science 2025-08-27 Jonas Schuett , Markus Anderljung , Alexis Carlier , Leonie Koessler , Ben Garfinkel

As part of the Frontier AI Safety Commitments agreed to at the 2024 AI Seoul Summit, many AI developers agreed to publish a safety framework outlining how they will manage potential severe risks associated with their systems. This paper…

Computers and Society · Computer Science 2025-03-10 Marie Davidsen Buhl , Ben Bucknall , Tammy Masterson

The accelerating deployment of artificial intelligence systems across regulated sectors has exposed critical fragmentation in risk assessment methodologies. A significant "language barrier" currently separates technical security teams, who…

Cryptography and Security · Computer Science 2025-12-01 Hernan Huwyler

The impact of frontier AI (i.e., AI agents and foundation models) in cybersecurity is rapidly increasing. In this paper, we comprehensively analyze this trend through multiple aspects: quantitative benchmarks, qualitative literature review,…

Cryptography and Security · Computer Science 2025-12-01 Yujin Potter , Wenbo Guo , Zhun Wang , Tianneng Shi , Hongwei Li , Andy Zhang , Patrick Gage Kelley , Kurt Thomas , Dawn Song

A comprehensive approach to addressing catastrophic risks from AI models should cover the full model lifecycle. This paper explores contingency plans for cases where pre-deployment risk management falls short: where either very dangerous…

Computers and Society · Computer Science 2023-10-03 Joe O'Brien , Shaun Ee , Zoe Williams

Given rapid progress toward advanced AI and risks from frontier AI systems (advanced AI systems pushing the boundaries of the AI capabilities frontier), the creation and implementation of AI governance and regulatory schemes deserves…

Although general-purpose AI systems offer transformational opportunities in science and industry, they simultaneously raise critical concerns about safety, misuse, and potential loss of control. Despite these risks, methods for assessing…

Computers and Society · Computer Science 2025-12-12 Malcolm Murray , Steve Barrett , Henry Papadatos , Otter Quarks , Matt Smith , Alejandro Tlaie Boria , Chloé Touzet , Siméon Campos

This article argues that frontier artificial intelligence (AI) developers need an internal audit function. First, it describes the role of internal audit in corporate governance: internal audit evaluates the adequacy and effectiveness of a…

Computers and Society · Computer Science 2024-10-08 Jonas Schuett

As frontier AI models become more capable, evaluating their potential to enable cyberattacks is crucial for ensuring the safe development of Artificial General Intelligence (AGI). Current cyber evaluation efforts are often ad-hoc, lacking…

Cryptography and Security · Computer Science 2025-04-23 Mikel Rodriguez , Raluca Ada Popa , Four Flynn , Lihao Liang , Allan Dafoe , Anna Wang

Frontier artificial intelligence (AI) systems pose increasing risks to society, making it essential for developers to provide assurances about their safety. One approach to offering such assurances is through a safety case: a structured,…

Computers and Society · Computer Science 2024-11-14 Arthur Goemans , Marie Davidsen Buhl , Jonas Schuett , Tomek Korbak , Jessica Wang , Benjamin Hilton , Geoffrey Irving

This year, jurisdictions worldwide, including the United States, the European Union, the United Kingdom, and China, are set to enact or revise laws governing frontier AI. Their efforts largely rely on the assumption that increasing model…

Computers and Society · Computer Science 2025-02-25 Nicholas A. Caputo

This second update to the 2025 International AI Safety Report assesses new developments in general-purpose AI risk management over the past year. It examines how researchers, public institutions, and AI developers are approaching risk…

This paper critically examines the evolving ethical and regulatory challenges posed by the integration of artificial intelligence (AI) in cybersecurity. We trace the historical development of AI regulation, highlighting major milestones…

Cryptography and Security · Computer Science 2025-01-22 Vikram Kulothungan

Recent work has demonstrated the plausibility of frontier AI models scheming -- knowingly and covertly pursuing an objective misaligned with its developer's intentions. Such behavior could be very hard to detect, and if present in future…

Machine Learning · Computer Science 2025-07-04 Mary Phuong , Roland S. Zimmermann , Ziyue Wang , David Lindner , Victoria Krakovna , Sarah Cogan , Allan Dafoe , Lewis Ho , Rohin Shah

To understand the risks posed by a new AI system, we must understand what it can and cannot do. Building on prior work, we introduce a programme of new "dangerous capability" evaluations and pilot them on Gemini 1.0 models. Our evaluations…

Frontier AI developers operate at the intersection of rapid technical progress, extreme risk exposure, and growing regulatory scrutiny. While a range of external evaluations and safety frameworks have emerged, comparatively little attention…

Computers and Society · Computer Science 2025-12-19 Francesca Gomez , Adam Buick , Leah Ferentinos , Haelee Kim , Elley Lee

The governance of frontier general-purpose artificial intelligence has become a public-sector problem of institutional design, not merely a technical issue of model performance. Recent evidence indicates that AI capabilities are advancing…

Computers and Society · Computer Science 2026-04-09 Fabio Correa Xavier

Financial institutions face increasing cyber risk while operating under strict regulatory oversight. To manage this risk, they rely heavily on Cyber Threat Intelligence (CTI) to inform detection, response, and strategic security decisions.…

Cryptography and Security · Computer Science 2026-03-25 Emir Karaosman , Advije Rizvani , Irdin Pekaric

As generative AI systems, including large language models (LLMs) and diffusion models, advance rapidly, their growing adoption has led to new and complex security risks often overlooked in traditional AI risk assessment frameworks. This…

Cryptography and Security · Computer Science 2024-10-21 Aviral Srivastava , Sourav Panda

Artificial intelligence (AI) is increasingly being used to augment and automate cyber operations, altering the scale, speed, and accessibility of malicious activity. These shifts raise urgent questions about when AI systems introduce…

Cryptography and Security · Computer Science 2026-01-27 Krystal Jackson , Deepika Raman , Jessica Newman , Nada Madkour , Charlotte Yuan , Evan R. Murphy