Related papers
Related papers: Evaluating the Critical Risks of Amazon's Nova Pre…
200 papers
Amazon published its Frontier Model Safety Framework (FMSF) as part of the Paris AI summit, following which we presented a report on Amazon's Premier model. In this report, we present an evaluation of Nova 2.0 Lite. Nova 2.0 Lite was made…
Cryptography and Security · Computer Science
2026-01-28
Satyapriya Krishna , Matteo Memelli , Tong Wang , Abhinav Mohanty , Claire O'Brien Rajkumar , Payal Motwani , Rahul Gupta , Spyros Matsoukas
We present Amazon Nova, a new generation of state-of-the-art foundation models that deliver frontier intelligence and industry-leading price performance. Amazon Nova Pro is a highly-capable multimodal model with the best combination of…
Artificial Intelligence · Computer Science
2025-06-17
Amazon AGI , Aaron Langford , Aayush Shah , Abhanshu Gupta , Abhimanyu Bhatter , Abhinav Goyal , Abhinav Mathur , Abhinav Mohanty , Abhishek Kumar , Abhishek Sethi , Abi Komma , Abner Pena , Achin Jain , Adam Kunysz , Adam Opyrchal , Adarsh Singh , Aditya Rawal , Adok Achar Budihal Prasad , Adrià de Gispert , Agnika Kumar , Aishwarya Aryamane , Ajay Nair , Akilan M , Akshaya Iyengar , Akshaya Vishnu Kudlu Shanbhogue , Alan He , Alessandra Cervone , Alex Loeb , Alex Zhang , Alexander Fu , Alexander Lisnichenko , Alexander Zhipa , Alexandros Potamianos , Ali Kebarighotbi , Aliakbar Daronkolaei , Alok Parmesh , Amanjot Kaur Samra , Ameen Khan , Amer Rez , Amir Saffari , Amit Agarwalla , Amit Jhindal , Amith Mamidala , Ammar Asmro , Amulya Ballakur , Anand Mishra , Anand Sridharan , Anastasiia Dubinina , Andre Lenz , Andreas Doerr , Andrew Keating , Andrew Leaver , Andrew Smith , Andrew Wirth , Andy Davey , Andy Rosenbaum , Andy Sohn , Angela Chan , Aniket Chakrabarti , Anil Ramakrishna , Anirban Roy , Anita Iyer , Anjali Narayan-Chen , Ankith Yennu , Anna Dabrowska , Anna Gawlowska , Anna Rumshisky , Anna Turek , Anoop Deoras , Anton Bezruchkin , Anup Prasad , Anupam Dewan , Anwith Kiran , Apoorv Gupta , Aram Galstyan , Aravind Manoharan , Arijit Biswas , Arindam Mandal , Arpit Gupta , Arsamkhan Pathan , Arun Nagarajan , Arushan Rajasekaram , Arvind Sundararajan , Ashwin Ganesan , Ashwin Swaminathan , Athanasios Mouchtaris , Audrey Champeau , Avik Ray , Ayush Jaiswal , Ayush Sharma , Bailey Keefer , Balamurugan Muthiah , Beatriz Leon-Millan , Ben Koopman , Ben Li , Benjamin Biggs , Benjamin Ott , Bhanu Vinzamuri , Bharath Venkatesh , Bhavana Ganesh , Bhoomit Vasani , Bill Byrne , Bill Hsu , Bincheng Wang , Blake King , Blazej Gorny , Bo Feng , Bo Zheng , Bodhisattwa Paul , Bofan Sun , Bofeng Luo , Bowen Chen , Bowen Xie , Boya Yu , Brendan Jugan , Brett Panosh , Brian Collins , Brian Thompson , Can Karakus , Can Liu , Carl Lambrecht , Carly Lin , Carolyn Wang , Carrie Yuan , Casey Loyda , Cezary Walczak , Chalapathi Choppa , Chandana Satya Prakash , Chankrisna Richy Meas , Charith Peris , Charles Recaido , Charlie Xu , Charul Sharma , Chase Kernan , Chayut Thanapirom , Chengwei Su , Chenhao Xu , Chenhao Yin , Chentao Ye , Chenyang Tao , Chethan Parameshwara , Ching-Yun Chang , Chong Li , Chris Hench , Chris Tran , Christophe Dupuy , Christopher Davis , Christopher DiPersio , Christos Christodoulopoulos , Christy Li , Chun Chen , Claudio Delli Bovi , Clement Chung , Cole Hawkins , Connor Harris , Corey Ropell , Cynthia He , DK Joo , Dae Yon Hwang , Dan Rosen , Daniel Elkind , Daniel Pressel , Daniel Zhang , Danielle Kimball , Daniil Sorokin , Dave Goodell , Davide Modolo , Dawei Zhu , Deepikaa Suresh , Deepti Ragha , Denis Filimonov , Denis Foo Kune , Denis Romasanta Rodriguez , Devamanyu Hazarika , Dhananjay Ram , Dhawal Parkar , Dhawal Patel , Dhwanil Desai , Dinesh Singh Rajput , Disha Sule , Diwakar Singh , Dmitriy Genzel , Dolly Goldenberg , Dongyi He , Dumitru Hanciu , Dushan Tharmal , Dzmitry Siankovich , Edi Cikovic , Edwin Abraham , Ekraam Sabir , Elliott Olson , Emmett Steven , Emre Barut , Eric Jackson , Ethan Wu , Evelyn Chen , Ezhilan Mahalingam , Fabian Triefenbach , Fan Yang , Fangyu Liu , Fanzi Wu , Faraz Tavakoli , Farhad Khozeimeh , Feiyang Niu , Felix Hieber , Feng Li , Firat Elbey , Florian Krebs , Florian Saupe , Florian Sprünken , Frank Fan , Furqan Khan , Gabriela De Vincenzo , Gagandeep Kang , George Ding , George He , George Yeung , Ghada Qaddoumi , Giannis Karamanolakis , Goeric Huybrechts , Gokul Maddali , Gonzalo Iglesias , Gordon McShane , Gozde Sahin , Guangtai Huang , Gukyeong Kwon , Gunnar A. Sigurdsson , Gurpreet Chadha , Gururaj Kosuru , Hagen Fuerstenau , Hah Hah , Haja Maideen , Hajime Hosokawa , Han Liu , Han-Kai Hsu , Hann Wang , Hao Li , Hao Yang , Haofeng Zhu , Haozheng Fan , Harman Singh , Harshavardhan Kaluvala , Hashim Saeed , He Xie , Helian Feng , Hendrix Luo , Hengzhi Pei , Henrik Nielsen , Hesam Ilati , Himanshu Patel , Hongshan Li , Hongzhou Lin , Hussain Raza , Ian Cullinan , Imre Kiss , Inbarasan Thangamani , Indrayani Fadnavis , Ionut Teodor Sorodoc , Irem Ertuerk , Iryna Yemialyanava , Ishan Soni , Ismail Jelal , Ivan Tse , Jack FitzGerald , Jack Zhao , Jackson Rothgeb , Jacky Lee , Jake Jung , Jakub Debski , Jakub Tomczak , James Jeun , James Sanders , Jason Crowley , Jay Lee , Jayakrishna Anvesh Paidy , Jayant Tiwari , Jean Farmer , Jeff Solinsky , Jenna Lau , Jeremy Savareese , Jerzy Zagorski , Ji Dai , Jiacheng , Gu , Jiahui Li , Jian , Zheng , Jianhua Lu , Jianhua Wang , Jiawei Dai , Jiawei Mo , Jiaxi Xu , Jie Liang , Jie Yang , Jim Logan , Jimit Majmudar , Jing Liu , Jinghong Miao , Jingru Yi , Jingyang Jin , Jiun-Yu Kao , Jixuan Wang , Jiyang Wang , Joe Pemberton , Joel Carlson , Joey Blundell , John Chin-Jew , John He , Jonathan Ho , Jonathan Hueser , Jonathan Lunt , Jooyoung Lee , Joshua Tan , Joyjit Chatterjee , Judith Gaspers , Jue Wang , Jun Fang , Jun Tang , Jun Wan , Jun Wu , Junlei Wang , Junyi Shi , Justin Chiu , Justin Satriano , Justin Yee , Jwala Dhamala , Jyoti Bansal , Kai Zhen , Kai-Wei Chang , Kaixiang Lin , Kalyan Raman , Kanthashree Mysore Sathyendra , Karabo Moroe , Karan Bhandarkar , Karan Kothari , Karolina Owczarzak , Karthick Gopalswamy , Karthick Ravi , Karthik Ramakrishnan , Karthika Arumugam , Kartik Mehta , Katarzyna Konczalska , Kavya Ravikumar , Ke Tran , Kechen Qin , Kelin Li , Kelvin Li , Ketan Kulkarni , Kevin Angelo Rodrigues , Keyur Patel , Khadige Abboud , Kiana Hajebi , Klaus Reiter , Kris Schultz , Krishna Anisetty , Krishna Kotnana , Kristen Li , Kruthi Channamallikarjuna , Krzysztof Jakubczyk , Kuba Pierewoj , Kunal Pal , Kunwar Srivastav , Kyle Bannerman , Lahari Poddar , Lakshmi Prasad , Larry Tseng , Laxmikant Naik , Leena Chennuru Vankadara , Lenon Minorics , Leo Liu , Leonard Lausen , Leonardo F. R. Ribeiro , Li Zhang , Lili Gehorsam , Ling Qi , Lisa Bauer , Lori Knapp , Lu Zeng , Lucas Tong , Lulu Wong , Luoxin Chen , Maciej Rudnicki , Mahdi Namazifar , Mahesh Jaliminche , Maira Ladeira Tanke , Manasi Gupta , Mandeep Ahlawat , Mani Khanuja , Mani Sundaram , Marcin Leyk , Mariusz Momotko , Markus Boese , Markus Dreyer , Markus Mueller , Mason Fu , Mateusz Górski , Mateusz Mastalerczyk , Matias Mora , Matt Johnson , Matt Scott , Matthew Wen , Max Barysau , Maya Boumerdassi , Maya Krishnan , Mayank Gupta , Mayank Hirani , Mayank Kulkarni , Meganathan Narayanasamy , Melanie Bradford , Melanie Gens , Melissa Burke , Meng Jin , Miao Chen , Michael Denkowski , Michael Heymel , Michael Krestyaninov , Michal Obirek , Michalina Wichorowska , Michał Miotk , Milosz Watroba , Mingyi Hong , Mingzhi Yu , Miranda Liu , Mohamed Gouda , Mohammad El-Shabani , Mohammad Ghavamzadeh , Mohit Bansal , Morteza Ziyadi , Nan Xia , Nathan Susanj , Nav Bhasin , Neha Goswami , Nehal Belgamwar , Nicolas Anastassacos , Nicolas Bergeron , Nidhi Jain , Nihal Jain , Niharika Chopparapu , Nik Xu , Nikko Strom , Nikolaos Malandrakis , Nimisha Mishra , Ninad Parkhi , Ninareh Mehrabi , Nishita Sant , Nishtha Gupta , Nitesh Sekhar , Nithin Rajeev , Nithish Raja Chidambaram , Nitish Dhar , Noor Bhagwagar , Noy Konforty , Omar Babu , Omid Razavi , Orchid Majumder , Osama Dar , Oscar Hsu , Pablo Kvitca , Pallavi Pandey , Parker Seegmiller , Patrick Lange , Paul Ferraro , Payal Motwani , Pegah Kharazmi , Pei Wang , Pengfei Liu , Peter Bradtke , Peter Götz , Peter Zhou , Pichao Wang , Piotr Poskart , Pooja Sonawane , Pradeep Natarajan , Pradyun Ramadorai , Pralam Shah , Prasad Nirantar , Prasanthi Chavali , Prashan Wanigasekara , Prashant Saraf , Prashun Dey , Pratyush Pant , Prerak Pradhan , Preyaa Patel , Priyanka Dadlani , Prudhvee Narasimha Sadha , Qi Dong , Qian Hu , Qiaozi , Gao , Qing Liu , Quinn Lam , Quynh Do , R. Manmatha , Rachel Willis , Rafael Liu , Rafal Ellert , Rafal Kalinski , Rafi Al Attrach , Ragha Prasad , Ragini Prasad , Raguvir Kunani , Rahul Gupta , Rahul Sharma , Rahul Tewari , Rajaganesh Baskaran , Rajan Singh , Rajiv Gupta , Rajiv Reddy , Rajshekhar Das , Rakesh Chada , Rakesh Vaideeswaran Mahesh , Ram Chandrasekaran , Ramesh Nallapati , Ran Xue , Rashmi Gangadharaiah , Ravi Rachakonda , Renxian Zhang , Rexhina Blloshmi , Rishabh Agrawal , Robert Enyedi , Robert Lowe , Robik Shrestha , Robinson Piramuthu , Rohail Asad , Rohan Khanna , Rohan Mukherjee , Rohit Mittal , Rohit Prasad , Rohith Mysore Vijaya Kumar , Ron Diamant , Ruchita Gupta , Ruiwen Li , Ruoying Li , Rushabh Fegade , Ruxu Zhang , Ryan Arbow , Ryan Chen , Ryan Gabbard , Ryan Hoium , Ryan King , Sabarishkumar Iyer , Sachal Malick , Sahar Movaghati , Sai Balakavi , Sai Jakka , Sai Kashyap Paruvelli , Sai Muralidhar Jayanthi , Saicharan Shriram Mujumdar , Sainyam Kapoor , Sajjad Beygi , Saket Dingliwal , Saleh Soltan , Sam Ricklin , Sam Tucker , Sameer Sinha , Samridhi Choudhary , Samson Tan , Samuel Broscheit , Samuel Schulter , Sanchit Agarwal , Sandeep Atluri , Sander Valstar , Sanjana Shankar , Sanyukta Sanyukta , Sarthak Khanna , Sarvpriye Khetrapal , Satish Janakiraman , Saumil Shah , Saurabh Akolkar , Saurabh Giri , Saurabh Khandelwal , Saurabh Pawar , Saurabh Sahu , Sean Huang , Sejun Ra , Senthilkumar Gopal , Sergei Dobroshinsky , Shadi Saba , Shamik Roy , Shamit Lal , Shankar Ananthakrishnan , Sharon Li , Shashwat Srijan , Shekhar Bhide , Sheng Long Tang , Sheng Zha , Shereen Oraby , Sherif Mostafa , Shiqi Li , Shishir Bharathi , Shivam Prakash , Shiyuan Huang , Shreya Yembarwar , Shreyas Pansare , Shreyas Subramanian , Shrijeet Joshi , Shuai Liu , Shuai Tang , Shubham Chandak , Shubham Garg , Shubham Katiyar , Shubham Mehta , Shubham Srivastav , Shuo Yang , Siddalingesha D S , Siddharth Choudhary , Siddharth Singh Senger , Simon Babb , Sina Moeini , Siqi Deng , Siva Loganathan , Slawomir Domagala , Sneha Narkar , Sneha Wadhwa , Songyang Zhang , Songyao Jiang , Sony Trenous , Soumajyoti Sarkar , Soumya Saha , Sourabh Reddy , Sourav Dokania , Spurthideepika Sandiri , Spyros Matsoukas , Sravan Bodapati , Sri Harsha Reddy Wdaru , Sridevi Yagati Venkateshdatta , Srikanth Ronanki , Srinivasan R Veeravanallur , Sriram Venkatapathy , Sriramprabhu Sankaraguru , Sruthi Gorantla , Sruthi Karuturi , Stefan Schroedl , Subendhu Rongali , Subhasis Kundu , Suhaila Shakiah , Sukriti Tiwari , Sumit Bharti , Sumita Sami , Sumith Mathew , Sunny Yu , Sunwoo Kim , Suraj Bajirao Malode , Susana Cumplido Riel , Swapnil Palod , Swastik Roy , Syed Furqhan , Tagyoung Chung , Takuma Yoshitani , Taojiannan Yang , Tejaswi Chillakura , Tejwant Bajwa , Temi Lajumoke , Thanh Tran , Thomas Gueudre , Thomas Jung , Tianhui Li , Tim Seemman , Timothy Leffel , Tingting Xiang , Tirth Patel , Tobias Domhan , Tobias Falke , Toby Guo , Tom Li , Tomasz Horszczaruk , Tomasz Jedynak , Tushar Kulkarni , Tyst Marin , Tytus Metrycki , Tzu-Yen Wang , Umang Jain , Upendra Singh , Utkarsh Chirimar , Vaibhav Gupta , Vanshil Shah , Varad Deshpande , Varad Gunjal , Varsha Srikeshava , Varsha Vivek , Varun Bharadwaj , Varun Gangal , Varun Kumar , Venkatesh Elango , Vicente Ordonez , Victor Soto , Vignesh Radhakrishnan , Vihang Patel , Vikram Singh , Vinay Varma Kolanuvada , Vinayshekhar Bannihatti Kumar , Vincent Auvray , Vincent Cartillier , Vincent Ponzo , Violet Peng , Vishal Khandelwal , Vishal Naik , Vishvesh Sahasrabudhe , Vitaliy Korolev , Vivek Gokuladas , Vivek Madan , Vivek Subramanian , Volkan Cevher , Vrinda Gupta , Wael Hamza , Wei Zhang , Weitong Ruan , Weiwei Cheng , Wen Zhang , Wenbo Zhao , Wenyan Yao , Wenzhuo Ouyang , Wesley Dashner , William Campbell , William Lin , Willian Martin , Wyatt Pearson , Xiang Jiang , Xiangxing Lu , Xiangyang Shi , Xianwen Peng , Xiaofeng Gao , Xiaoge Jiang , Xiaohan Fei , Xiaohui Wang , Xiaozhou Joey Zhou , Xin Feng , Xinyan Zhao , Xinyao Wang , Xinyu Li , Xu Zhang , Xuan Wang , Xuandi Fu , Xueling Yuan , Xuning Wang , Yadunandana Rao , Yair Tavizon , Yan Rossiytsev , Yanbei Chen , Yang Liu , Yang Zou , Yangsook Park , Yannick Versley , Yanyan Zhang , Yash Patel , Yen-Cheng Lu , Yi Pan , Yi-Hsiang , Lai , Yichen Hu , Yida Wang , Yiheng Zhou , Yilin Xiang , Ying Shi , Ying Wang , Yishai Galatzer , Yongxin Wang , Yorick Shen , Yuchen Sun , Yudi Purwatama , Yue , Wu , Yue Gu , Yuechun Wang , Yujun Zeng , Yuncong Chen , Yunke Zhou , Yusheng Xie , Yvon Guy , Zbigniew Ambrozinski , Zhaowei Cai , Zhen Zhang , Zheng Wang , Zhenghui Jin , Zhewei Zhao , Zhiheng Li , Zhiheng Luo , Zhikang Zhang , Zhilin Fang , Zhiqi Bu , Zhiyuan Wang , Zhizhong Li , Zijian Wang , Zimeng , Qiu , Zishi Li
Advanced AI models hold the promise of tremendous benefits for humanity, but society needs to proactively manage the accompanying risks. In this paper, we focus on what we term "frontier AI" models: highly capable foundation models that…
Computers and Society · Computer Science
2023-11-09
Markus Anderljung , Joslyn Barnhart , Anton Korinek , Jade Leung , Cullen O'Keefe , Jess Whittlestone , Shahar Avin , Miles Brundage , Justin Bullock , Duncan Cass-Beggs , Ben Chang , Tantum Collins , Tim Fist , Gillian Hadfield , Alan Hayes , Lewis Ho , Sara Hooker , Eric Horvitz , Noam Kolt , Jonas Schuett , Yonadav Shavit , Divya Siddarth , Robert Trager , Kevin Wolf
As part of the Frontier AI Safety Commitments agreed to at the 2024 AI Seoul Summit, many AI developers agreed to publish a safety framework outlining how they will manage potential severe risks associated with their systems. This paper…
Computers and Society · Computer Science
2025-03-10
Marie Davidsen Buhl , Ben Bucknall , Tammy Masterson
To understand and identify the unprecedented risks posed by rapidly advancing artificial intelligence (AI) models, this report presents a comprehensive assessment of their frontier risks. Drawing on the E-T-C analysis (deployment…
Artificial Intelligence · Computer Science
2025-07-29
Shanghai AI Lab , : , Xiaoyang Chen , Yunhao Chen , Zeren Chen , Zhiyun Chen , Hanyun Cui , Yawen Duan , Jiaxuan Guo , Qi Guo , Xuhao Hu , Hong Huang , Lige Huang , Chunxiao Li , Juncheng Li , Qihao Lin , Dongrui Liu , Xinmin Liu , Zicheng Liu , Chaochao Lu , Xiaoya Lu , Jingjing Qu , Qibing Ren , Jing Shao , Jingwei Shi , Jingwei Sun , Peng Wang , Weibing Wang , Jia Xu , Lewen Yan , Xiao Yu , Yi Yu , Boxuan Zhang , Jie Zhang , Weichen Zhang , Zhijie Zheng , Tianyi Zhou , Bowen Zhou
Rapidly evolving AI exhibits increasingly strong autonomy and goal-directed capabilities, accompanied by derivative systemic risks that are more unpredictable, difficult to control, and potentially irreversible. However, current AI safety…
Artificial Intelligence · Computer Science
2026-03-02
Haibo Tong , Feifei Zhao , Linghao Feng , Ruoyu Wu , Ruolin Chen , Lu Jia , Zhou Zhao , Jindong Li , Tenglong Li , Erliang Lin , Shuai Yang , Enmeng Lu , Yinqian Sun , Qian Zhang , Zizhe Ruan , Jinyu Fan , Zeyang Yue , Ping Wu , Huangrui Li , Chengyi Sun , Yi Zeng
Most frontier AI developers publicly document their safety evaluations of new AI models in model reports, including testing for chemical and biological (ChemBio) misuse risks. This practice provides a window into the methodology of these…
To understand the risks posed by a new AI system, we must understand what it can and cannot do. Building on prior work, we introduce a programme of new "dangerous capability" evaluations and pilot them on Gemini 1.0 models. Our evaluations…
Machine Learning · Computer Science
2024-04-08
Mary Phuong , Matthew Aitchison , Elliot Catt , Sarah Cogan , Alexandre Kaskasoli , Victoria Krakovna , David Lindner , Matthew Rahtz , Yannis Assael , Sarah Hodkinson , Heidi Howard , Tom Lieberum , Ramana Kumar , Maria Abi Raad , Albert Webson , Lewis Ho , Sharon Lin , Sebastian Farquhar , Marcus Hutter , Gregoire Deletang , Anian Ruoss , Seliem El-Sayed , Sasha Brown , Anca Dragan , Rohin Shah , Allan Dafoe , Toby Shevlane
The rapid advancement of large language models (LLMs) introduces dual-use capabilities that could both threaten and bolster national security and public safety (NSPS). Models implement safeguards to protect against potential misuse relevant…
Computers and Society · Computer Science
2025-06-26
Christina Q. Knight , Kaustubh Deshpande , Ved Sirdeshmukh , Meher Mankikar , Scale Red Team , SEAL Research Team , Julian Michael
Frontier AI safety claims - published assertions that a highly capable general-purpose model is below a threshold of concern, adequately mitigated, or suitable for release - increasingly shape model deployment, governance, and public trust.…
Computers and Society · Computer Science
2026-05-12
Varad Vishwarupe , Nigel Shadbolt , Marina Jirotka , Ivan Flechais
Frontier AI models -- highly capable foundation models at the cutting edge of AI development -- may pose severe risks to public safety, human rights, economic stability, and societal value in the coming years. These risks could arise from…
Computers and Society · Computer Science
2025-03-11
Deepika Raman , Nada Madkour , Evan R. Murphy , Krystal Jackson , Jessica Newman
The rapid advancement of large models, driven by their exceptional abilities in learning and generalization through large-scale pre-training, has reshaped the landscape of Artificial Intelligence (AI). These models are now foundational to a…
Cryptography and Security · Computer Science
2026-04-15
Xingjun Ma , Yifeng Gao , Yixu Wang , Ruofan Wang , Xin Wang , Ye Sun , Yifan Ding , Hengyuan Xu , Yunhao Chen , Yunhan Zhao , Hanxun Huang , Yige Li , Yutao Wu , Jiaming Zhang , Xiang Zheng , Yang Bai , Zuxuan Wu , Xipeng Qiu , Jingfeng Zhang , Yiming Li , Xudong Han , Haonan Li , Jun Sun , Cong Wang , Jindong Gu , Baoyuan Wu , Siheng Chen , Tianwei Zhang , Yang Liu , Mingming Gong , Tongliang Liu , Shirui Pan , Cihang Xie , Tianyu Pang , Yinpeng Dong , Ruoxi Jia , Yang Zhang , Shiqing Ma , Xiangyu Zhang , Neil Gong , Chaowei Xiao , Sarah Erfani , Tim Baldwin , Bo Li , Masashi Sugiyama , Dacheng Tao , James Bailey , Yu-Gang Jiang
Following the AI Seoul Summit in 2024, twelve AI companies published frontier AI safety frameworks (Frameworks) outlining their approaches to managing catastrophic risks from advanced AI systems. Emerging legislation increasingly treats…
Computers and Society · Computer Science
2026-05-01
Lily Stelling , Malcolm Murray , Bruno Galizzi , Max Schaffelder , Siméon Campos , Henry Papadatos
This second update to the 2025 International AI Safety Report assesses new developments in general-purpose AI risk management over the past year. It examines how researchers, public institutions, and AI developers are approaching risk…
Computers and Society · Computer Science
2025-11-26
Yoshua Bengio , Stephen Clare , Carina Prunkl , Maksym Andriushchenko , Ben Bucknall , Philip Fox , Nestor Maslej , Conor McGlynn , Malcolm Murray , Shalaleh Rismani , Stephen Casper , Jessica Newman , Daniel Privitera , Sören Mindermann , Daron Acemoglu , Thomas G. Dietterich , Fredrik Heintz , Geoffrey Hinton , Nick Jennings , Susan Leavy , Teresa Ludermir , Vidushi Marda , Helen Margetts , John McDermid , Jane Munga , Arvind Narayanan , Alondra Nelson , Clara Neppel , Gopal Ramchurn , Stuart Russell , Marietje Schaake , Bernhard Schölkopf , Alavaro Soto , Lee Tiedrich , Gaël Varoquaux , Andrew Yao , Ya-Qin Zhang , Leandro Aguirre , Olubunmi Ajala , Fahad Albalawi , Noora AlMalek , Christian Busch , André Carvalho , Jonathan Collas , Amandeep Gill , Ahmet Hatip , Juha Heikkilä , Chris Johnson , Gill Jolly , Ziv Katzir , Mary Kerema , Hiroaki Kitano , Antonio Krüger , Aoife McLysaght , Oleksii Molchanovskyi , Andrea Monti , Kyoung Mu Lee , Mona Nemer , Nuria Oliver , Raquel Pezoa , Audrey Plonk , José Portillo , Balaraman Ravindran , Hammam Riza , Crystal Rugege , Haroon Sheikh , Denise Wong , Yi Zeng , Liming Zhu
The recent development of powerful AI systems has highlighted the need for robust risk management frameworks in the AI industry. Although companies have begun to implement safety frameworks, current approaches often lack the systematic…
Artificial Intelligence · Computer Science
2025-02-20
Simeon Campos , Henry Papadatos , Fabien Roger , Chloé Touzet , Otter Quarks , Malcolm Murray
To understand and identify the unprecedented risks posed by rapidly advancing artificial intelligence (AI) models, Frontier AI Risk Management Framework in Practice presents a comprehensive assessment of their frontier risks. As Large…
Artificial Intelligence · Computer Science
2026-02-17
Dongrui Liu , Yi Yu , Jie Zhang , Guanxu Chen , Qihao Lin , Hanxi Zhu , Lige Huang , Yijin Zhou , Peng Wang , Shuai Shao , Boxuan Zhang , Zicheng Liu , Jingwei Sun , Yu Li , Yuejin Xie , Jiaxuan Guo , Jia Xu , Chaochao Lu , Bowen Zhou , Xia Hu , Jing Shao
Over the past year, artificial intelligence (AI) companies have been increasingly adopting AI safety frameworks. These frameworks outline how companies intend to keep the potential risks associated with developing and deploying frontier AI…
Frontier artificial intelligence (AI) systems pose increasing risks to society, making it essential for developers to provide assurances about their safety. One approach to offering such assurances is through a safety case: a structured,…
Computers and Society · Computer Science
2024-11-14
Arthur Goemans , Marie Davidsen Buhl , Jonas Schuett , Tomek Korbak , Jessica Wang , Benjamin Hilton , Geoffrey Irving
When AI interacts with the physical world -- as a robot or an assistive agent -- new safety challenges emerge beyond those of purely ``digital AI". In such interactions, the potential for physical harm is direct and immediate. How well do…
Artificial Intelligence · Computer Science
2025-11-24
Abhishek Jindal , Dmitry Kalashnikov , R. Alex Hofer , Oscar Chang , Divya Garikapati , Anirudha Majumdar , Pierre Sermanet , Vikas Sindhwani
Since the publication of the first International AI Safety Report, AI capabilities have continued to improve across key domains. New training techniques that teach AI systems to reason step-by-step and inference-time enhancements have…
Computers and Society · Computer Science
2025-10-16
Yoshua Bengio , Stephen Clare , Carina Prunkl , Shalaleh Rismani , Maksym Andriushchenko , Ben Bucknall , Philip Fox , Tiancheng Hu , Cameron Jones , Sam Manning , Nestor Maslej , Vasilios Mavroudis , Conor McGlynn , Malcolm Murray , Charlotte Stix , Lucia Velasco , Nicole Wheeler , Daniel Privitera , Sören Mindermann , Daron Acemoglu , Thomas G. Dietterich , Fredrik Heintz , Geoffrey Hinton , Nick Jennings , Susan Leavy , Teresa Ludermir , Vidushi Marda , Helen Margetts , John McDermid , Jane Munga , Arvind Narayanan , Alondra Nelson , Clara Neppel , Gopal Ramchurn , Stuart Russell , Marietje Schaake , Bernhard Schölkopf , Alavaro Soto , Lee Tiedrich , Gaël Varoquaux , Andrew Yao , Ya-Qin Zhang , Leandro Aguirre , Olubunmi Ajala , Fahad Albalawi Noora AlMalek , Christian Busch , André Carvalho , Jonathan Collas , Amandeep Gill , Ahmet Hatip , Juha Heikkilä , Chris Johnson , Gill Jolly , Ziv Katzir , Mary Kerema , Hiroaki Kitano , Antonio Krüger , Aoife McLysaght , Oleksii Molchanovskyi , Andrea Monti , Kyoung Mu Lee , Mona Nemer , Nuria Oliver , Raquel Pezoa , Audrey Plonk , José Portillo , Balaraman Ravindran , Hammam Riza , Crystal Rugege , Haroon Sheikh , Denise Wong , Yi Zeng , Liming Zhu