English
Related papers

Related papers: Testing Framework for Black-box AI Models

200 papers

Explainability features are intended to provide insight into the internal mechanisms of an AI device, but there is a lack of evaluation techniques for assessing the quality of provided explanations. We propose a framework to assess and…

Artificial Intelligence · Computer Science 2025-06-18 Miguel A. Lago , Ghada Zamzmi , Brandon Eich , Jana G. Delfino

This paper explores the rapidly evolving ecosystem of publicly available AI models, and their potential implications on the security and safety landscape. As AI models become increasingly prevalent, understanding their potential risks and…

Computers and Society · Computer Science 2024-11-20 Huzaifa Sidhpurwala , Garth Mollett , Emily Fox , Mark Bestavros , Huamin Chen

The integration of Artificial Intelligence (AI) into automation systems has the potential to enhance efficiency and to address currently unsolved existing technical challenges. However, the industry-wide adoption of AI is hindered by the…

Systems and Control · Electrical Eng. & Systems 2024-07-04 Marvin Schieseck , Philip Topalis , Lasse Reinpold , Felix Gehlhoff , Alexander Fay

The use of Artificial Intelligence (AI) in high-risk, decision-making scenarios presents technical, safety, and normative challenges; problems that may only be ameliorated by human oversight. However, notions of human oversight lack a…

Formal models are essential to specifying large, complex computer systems and verifying their correctness, but are notoriously expensive to write and maintain. Recent advances in generative AI show promise in generating certain forms of…

Artificial Intelligence · Computer Science 2026-01-29 Qian Cheng , Ruize Tang , Emilie Ma , Finn Hackett , Peiyang He , Yiming Su , Ivan Beschastnikh , Yu Huang , Xiaoxing Ma , Tianyin Xu

This paper proposes a comprehensive analysis of existing concepts coming from different disciplines tackling the notion of intelligence, namely psychology and engineering, and from disciplines aiming to regulate AI innovations, namely AI…

Artificial Intelligence · Computer Science 2021-05-10 Gauthier Chassang , Mogens Thomsen , Pierre Rumeau , Florence Sèdes , Alejandra Delfin

Model checking and testing are two areas with a similar goal: to verify that a system satisfies a property. They start with different hypothesis on the systems and develop many techniques with different notions of approximation, when an…

Logic in Computer Science · Computer Science 2013-04-19 M. C. Gaudel , R. Lassaigne , F. Magniez , M. de Rougemont

As AI systems increasingly influence critical sectors like telecommunications, finance, healthcare, and public services, ensuring fairness in decision-making is essential to prevent biased or unjust outcomes that disproportionately affect…

Computers and Society · Computer Science 2025-04-11 Avinash Agarwal , Mayashankar Kumar , Manisha J. Nene

Algorithmic stability is a concept from learning theory that expresses the degree to which changes to the input data (e.g., removal of a single data point) may affect the outputs of a regression algorithm. Knowing an algorithm's stability…

Machine Learning · Computer Science 2022-12-23 Byol Kim , Rina Foygel Barber

AI is poised to revolutionize telecommunication networks by boosting efficiency, automation, and decision-making. However, the black-box nature of most AI models introduces substantial risk, possibly deterring adoption by network operators.…

Information Theory · Computer Science 2025-04-29 Osvaldo Simeone , Sangwoo Park , Matteo Zecchin

The advances in Artificial Intelligence are creating new opportunities to improve lives of people around the world, from business to healthcare, from lifestyle to education. For example, some systems profile the users using their…

Machine Learning · Computer Science 2023-01-02 Arkadipta De , Satya Swaroop Gudipudi , Sourab Panchanan , Maunendra Sankar Desarkar

Generative AI technology has become increasingly integrated into our daily lives, offering powerful capabilities to enhance productivity. However, these same capabilities can be exploited by adversaries for malicious purposes. While…

Cryptography and Security · Computer Science 2025-07-17 Dayong Ye , Tianqing Zhu , Shang Wang , Bo Liu , Leo Yu Zhang , Wanlei Zhou , Yang Zhang

Local explanation frameworks aim to rationalize particular decisions made by a black-box prediction model. Existing techniques are often restricted to a specific type of predictor or based on input saliency, which may be undesirably…

Machine Learning · Computer Science 2019-02-12 Brandon Carter , Jonas Mueller , Siddhartha Jain , David Gifford

Safety cases, structured arguments that a system is acceptably safe, are becoming central to the governance of AI systems. Yet, traditional safety-case practices from aviation or nuclear engineering rely on well-specified system boundaries,…

Software Engineering · Computer Science 2026-03-09 Sung Une Lee , Liming Zhu , Md Shamsujjoha , Liming Dong , Qinghua Lu , Jieshan Chen , Lionel Briand

Trust in clinical artificial intelligence (AI) cannot be reduced to model accuracy, fluency of generation, or overall positive user impression. In medicine, trust must be engineered as a measurable system property grounded in evidence,…

Computation and Language · Computer Science 2026-04-30 Serhii Zabolotnii , Viktoriia Holinko , Olha Antonenko

The software industry aims to provide customers with quality software. Testing software is a critical and sensitive stage in ensuring software quality. Due to the increasing popularity of mobile devices, the use of Android applications has…

Software Engineering · Computer Science 2022-09-07 Fatemeh Mosayeb , Shohreh Ajoudanian

Artificial Intelligence (AI) has demonstrated unprecedented performance across various domains, and its application to communication systems is an active area of research. While current methods focus on task-specific solutions, the broader…

Artificial Intelligence · Computer Science 2025-05-21 Davide Buffelli , Sowmen Das , Yu-Wei Lin , Sattar Vakili , Chien-Yi Wang , Masoud Attarifar , Pritthijit Nath , Da-shan Shiu

Real-world data often exhibits bias, imbalance, and privacy risks. Synthetic datasets have emerged to address these issues. This paradigm relies on generative AI models to generate unbiased, privacy-preserving data while maintaining…

With the rise of artificial intelligence (A.I.) and large language models like ChatGPT, a new race for achieving artificial general intelligence (A.G.I) has started. While many speculate how and when A.I. will achieve A.G.I., there is no…

Artificial Intelligence · Computer Science 2025-12-05 Georgios Mappouras

In high-stakes domains like legal question-answering, the accuracy and trustworthiness of generative AI systems are of paramount importance. This work presents a comprehensive benchmark of various methods to assess the groundedness of…

Computation and Language · Computer Science 2024-10-14 Dietrich Trautmann , Natalia Ostapuk , Quentin Grail , Adrian Alan Pol , Guglielmo Bonifazi , Shang Gao , Martin Gajek