English
Related papers

Related papers: A Grading Rubric for AI Safety Frameworks

200 papers

Generative AI is rapidly moving from research to deployment, elevating the need for responsible development, evaluation, and governance. We conduct a PRISMA guided review of 232 studies (November 2022 - December 2025), spanning large…

This paper introduces v0.5 of the AI Safety Benchmark, which has been created by the MLCommons AI Safety Working Group. The AI Safety Benchmark has been designed to assess the safety risks of AI systems that use chat-tuned language models.…

Computation and Language · Computer Science 2024-05-15 Bertie Vidgen , Adarsh Agrawal , Ahmed M. Ahmed , Victor Akinwande , Namir Al-Nuaimi , Najla Alfaraj , Elie Alhajjar , Lora Aroyo , Trupti Bavalatti , Max Bartolo , Borhane Blili-Hamelin , Kurt Bollacker , Rishi Bomassani , Marisa Ferrara Boston , Siméon Campos , Kal Chakra , Canyu Chen , Cody Coleman , Zacharie Delpierre Coudert , Leon Derczynski , Debojyoti Dutta , Ian Eisenberg , James Ezick , Heather Frase , Brian Fuller , Ram Gandikota , Agasthya Gangavarapu , Ananya Gangavarapu , James Gealy , Rajat Ghosh , James Goel , Usman Gohar , Sujata Goswami , Scott A. Hale , Wiebke Hutiri , Joseph Marvin Imperial , Surgan Jandial , Nick Judd , Felix Juefei-Xu , Foutse Khomh , Bhavya Kailkhura , Hannah Rose Kirk , Kevin Klyman , Chris Knotz , Michael Kuchnik , Shachi H. Kumar , Srijan Kumar , Chris Lengerich , Bo Li , Zeyi Liao , Eileen Peters Long , Victor Lu , Sarah Luger , Yifan Mai , Priyanka Mary Mammen , Kelvin Manyeki , Sean McGregor , Virendra Mehta , Shafee Mohammed , Emanuel Moss , Lama Nachman , Dinesh Jinenhally Naganna , Amin Nikanjam , Besmira Nushi , Luis Oala , Iftach Orr , Alicia Parrish , Cigdem Patlak , William Pietri , Forough Poursabzi-Sangdeh , Eleonora Presani , Fabrizio Puletti , Paul Röttger , Saurav Sahay , Tim Santos , Nino Scherrer , Alice Schoenauer Sebag , Patrick Schramowski , Abolfazl Shahbazi , Vin Sharma , Xudong Shen , Vamsi Sistla , Leonard Tang , Davide Testuggine , Vithursan Thangarasa , Elizabeth Anne Watkins , Rebecca Weiss , Chris Welty , Tyler Wilbers , Adina Williams , Carole-Jean Wu , Poonam Yadav , Xianjun Yang , Yi Zeng , Wenhui Zhang , Fedor Zhdanov , Jiacheng Zhu , Percy Liang , Peter Mattson , Joaquin Vanschoren

Current frontier AI safety evaluations emphasize static benchmarks, third-party annotations, and red-teaming. In this position paper, we argue that AI safety research should focus on human-centered evaluations that measure harmful…

Computers and Society · Computer Science 2026-03-31 Michelle Vaccaro , Jaeyoon Song , Abdullah Almaatouq , Michiel A. Bakker

Artificial Intelligence (AI) has made impressive progress in recent years and represents a key technology that has a crucial impact on the economy and society. However, it is clear that AI and business models based on it can only reach…

The rapid development of artificial intelligence (AI) has led to increasing concerns about the capability of AI systems to make decisions and behave responsibly. Responsible AI (RAI) refers to the development and use of AI systems that…

Software Engineering · Computer Science 2023-05-25 Boming Xia , Qinghua Lu , Harsha Perera , Liming Zhu , Zhenchang Xing , Yue Liu , Jon Whittle

Safety and responsibility evaluations of advanced AI models are a critical but developing field of research and practice. In the development of Google DeepMind's advanced AI models, we innovated on and applied a broad set of approaches to…

As artificial intelligence (AI) becomes increasingly embedded in digital, social, and institutional infrastructures, and AI and platforms are merged into hybrid structures, systemic risk has emerged as a critical but undertheorized…

Computers and Society · Computer Science 2026-05-26 Philipp Hacker , Lilian Edwards , Atoosa Kasirzadeh

This paper contributes to the nascent debate around safety cases for frontier AI systems. Safety cases are structured, defensible arguments that a system is acceptably safe to deploy in a given context. Historically, they have been used in…

Computers and Society · Computer Science 2026-03-11 Shaun Feakins , Ibrahim Habli , Phillip Morgan

The Universal Declaration of Human Rights and other international agreements outline numerous inalienable rights that apply across geopolitical boundaries. As generative AI becomes increasingly prevalent, it poses risks to human rights such…

Computers and Society · Computer Science 2025-10-08 Vyoma Raman , Camille Chabot , Betsy Popken

There is an urgent need to identify both short and long-term risks from newly emerging types of Artificial Intelligence (AI), as well as available risk management measures. In response, and to support global efforts in regulating AI and…

Computers and Society · Computer Science 2024-11-18 Rokas Gipiškis , Ayrton San Joaquin , Ze Shen Chin , Adrian Regenfuß , Ariel Gil , Koen Holtman

The range of application of artificial intelligence (AI) is vast, as is the potential for harm. Growing awareness of potential risks from AI systems has spurred action to address those risks, while eroding confidence in AI systems and the…

As Artificial Intelligence becomes increasingly central to corporate strategies, concerns over its risks are growing too. In response, regulators are pushing for greater transparency in how companies identify, report and mitigate AI-related…

Computers and Society · Computer Science 2025-08-28 Lucas G. Uberti-Bona Marin , Bram Rijsbosch , Gerasimos Spanakis , Konrad Kollnig

Generative Artificial Intelligence (AI) is enabling unprecedented automation in content creation and decision support, but it also raises novel risks. This paper presents a first-principles risk assessment framework underlying the IEEE…

Computers and Society · Computer Science 2025-11-21 Richard J. Tong , Marina Cortês , Jeanine A. DeFalco , Mark Underwood , Janusz Zalewski

As AI systems integrate into critical infrastructure, security gaps in AI compliance frameworks demand urgent attention. This paper audits and quantifies security risks in three major AI governance standards: NIST AI RMF 1.0, UK's AI and…

Cryptography and Security · Computer Science 2025-07-29 Keerthana Madhavan , Abbas Yazdinejad , Fattane Zarrinkalam , Ali Dehghantanha

The risks of frontier AI may require international cooperation, which in turn may require verification: checking that all parties follow agreed-on rules. For instance, states might need to verify that powerful AI models are widely deployed…

Computers and Society · Computer Science 2025-07-29 Mauricio Baker , Gabriel Kulp , Oliver Marks , Miles Brundage , Lennart Heim

Frontier AI both amplifies existing risks and introduces qualitatively novel challenges. Not only is there a notable lack of stable scientific consensus resulting from the rapid pace of technological change, but emerging frontier AI safety…

Many leading AI researchers expect AI development to exceed the transformative impact of all previous technological revolutions. This belief is based on the idea that AI will be able to automate the process of AI research itself, leading to…

Computers and Society · Computer Science 2026-03-09 Severin Field , Raymond Douglas , David Krueger

Generative AI systems produce a range of risks. To ensure the safety of generative AI systems, these risks must be evaluated. In this paper, we make two main contributions toward establishing such evaluations. First, we propose a…

The rapid diffusion of agentic AI has created a new coverage problem for commercial insurance: some AI-mediated losses are now affirmatively insured, some create silent-AI exposure under legacy cyber, technology errors-and-omissions (E&O),…

Risk Management · Quantitative Finance 2026-05-20 Alex Leung , Rex Zhang , Ervin Ling , Kentaroh Toyoda , SiewMei Loh

Mitigating the risks from frontier AI systems requires up-to-date and reliable information about those systems. Organizations that develop and deploy frontier systems have significant access to such information. By reporting safety-critical…