English
Related papers

Related papers: Quantifying AI Vulnerabilities: A Synthesis of Com…

200 papers

This vision paper presents initial research on assessing the robustness and reliability of AI-enabled systems, and key factors in ensuring their safety and effectiveness in practical applications, including a focus on accountability. By…

Software Engineering · Computer Science 2025-06-23 Filippo Scaramuzza , Damian A. Tamburri , Willem-Jan van den Heuvel

This article deals with the IT security of connectionist artificial intelligence (AI) applications, focusing on threats to integrity, one of the three IT security goals. Such threats are for instance most relevant in prominent AI computer…

Cryptography and Security · Computer Science 2020-07-30 Christian Berghoff , Matthias Neu , Arndt von Twickel

This paper investigates a unexplored yet impactful vulnerability in AI explainability used in intrusion detection (IDS): multicollinearity-induced instability. Despite extensive reliance on post-hoc explainability tools such as SHAP or…

Machine Learning · Computer Science 2026-05-22 Ioannis J. Vourganas , Anna Lito Michala

Despite the impressive performance of Artificial Intelligence (AI) systems, their robustness remains elusive and constitutes a key issue that impedes large-scale adoption. Robustness has been studied in many domains of AI, yet with…

Artificial Intelligence · Computer Science 2022-10-20 Andrea Tocchetti , Lorenzo Corti , Agathe Balayn , Mireia Yurrita , Philip Lippmann , Marco Brambilla , Jie Yang

The use of eXplainable Artificial Intelligence (XAI) systems has introduced a set of challenges that need resolution. The XAI robustness, or stability, has been one of the goals of the community from its beginning. Multiple authors have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Miquel Miró-Nicolau , Antoni Jaume-i-Capó , Gabriel Moyà-Alcover

In recent years, the convergence of cybersecurity, artificial intelligence (AI), and data management has emerged as a critical area of research, driven by the increasing complexity and interdependence of modern technological ecosystems.…

Cryptography and Security · Computer Science 2024-08-13 Marwan Omar

Enterprise AI systems, built on large language models, retrieval pipelines and autonomous agents, introduce a class of risks that traditional software quality assurance was never designed to address. These systems are probabilistic,…

Software Engineering · Computer Science 2026-05-25 Chitra Badagi , Divye Singh , Animesh Sen , Adinath Shirsath

As AI models scale to billions of parameters and operate with increasing autonomy, ensuring their safe, reliable operation demands engineering-grade security and assurance frameworks. This paper presents an enterprise-level, risk-aware,…

Cryptography and Security · Computer Science 2025-05-13 Krti Tallam

Traditional cybersecurity methodologies target deterministic systems and fail to address the probabilistic nature of AI, leaving systems vulnerable to attack vectors such as model inversion, data poisoning, and prompt injection. Recent…

Cryptography and Security · Computer Science 2026-05-19 Tsafac Nkombong Regine Cyrille , Franziska Schwarz

Although AI systems are increasingly being leveraged to provide value to organizations, individuals, and society, significant attendant risks have been identified and have manifested. These risks have led to proposed regulations,…

Artificial Intelligence · Computer Science 2024-12-06 David Piorkowski , Michael Hind , John Richards

The critical need for transparent and trustworthy machine learning in cybersecurity operations drives the development of this integrated Explainable AI (XAI) framework. Our methodology addresses three fundamental challenges in deploying AI…

Cryptography and Security · Computer Science 2026-02-24 Norrakith Srisumrith , Sunantha Sodsee

Recent AI systems compress the distance between capability growth and capability deployment. Earlier high-risk technologies were slowed by capital intensity, physical bottlenecks, organizational inertia, and specialized supply chains. By…

Artificial Intelligence · Computer Science 2026-05-05 Wesley Shu , Peng Wei

AI safety benchmarks are pivotal for safety in advanced AI systems; however, they have significant technical, epistemic, and sociotechnical shortcomings. We present a review of 210 safety benchmarks that maps out common challenges in safety…

Computers and Society · Computer Science 2026-02-10 Cheng Yu , Severin Engelmann , Ruoxuan Cao , Dalia Ali , Orestis Papakyriakopoulos

This review comprehensively examines the integration of artificial intelligence (AI) in enhancing the dynamic security assessments of modern power systems. It highlights the pivotal role of AI in facilitating scenario generation, incident…

Systems and Control · Electrical Eng. & Systems 2024-08-20 Runhao Zhang

Artificial intelligence (AI) is increasingly being used to augment and automate cyber operations, altering the scale, speed, and accessibility of malicious activity. These shifts raise urgent questions about when AI systems introduce…

Cryptography and Security · Computer Science 2026-01-27 Krystal Jackson , Deepika Raman , Jessica Newman , Nada Madkour , Charlotte Yuan , Evan R. Murphy

As AI systems appear to exhibit ever-increasing capability and generality, assessing their true potential and safety becomes paramount. This paper contends that the prevalent evaluation methods for these systems are fundamentally…

Artificial Intelligence · Computer Science 2024-07-15 John Burden

This paper presents a theoretical framework for addressing the challenges posed by generative artificial intelligence (AI) in higher education assessment through a machine-versus-machine approach. Large language models like GPT-4, Claude,…

Computers and Society · Computer Science 2025-06-04 Mohammad Saleh Torkestani , Taha Mansouri

The rapid development of Artificial Intelligence (AI) technology has enabled the deployment of various systems based on it. However, many current AI systems are found vulnerable to imperceptible attacks, biased against underrepresented…

Artificial Intelligence · Computer Science 2022-05-27 Bo Li , Peng Qi , Bo Liu , Shuai Di , Jingen Liu , Jiquan Pei , Jinfeng Yi , Bowen Zhou

Artificial intelligence (AI) has been advancing at a fast pace and it is now poised for deployment in a wide range of applications, such as autonomous systems, medical diagnosis and natural language processing. Early adoption of AI…

Machine Learning · Computer Science 2023-09-21 Marta Kwiatkowska , Xiyue Zhang

Artificial Intelligence (AI) technology epitomizes the complex challenges posed by human-made artifacts, particularly those widely integrated into society and exerting significant influence, highlighting potential benefits and their…

Artificial Intelligence · Computer Science 2025-10-06 Michael Papademas , Xenia Ziouvelou , Antonis Troumpoukis , Vangelis Karkaletsis