English
Related papers

Related papers: Auditing AI models for Verified Deployment under S…

200 papers

In pulmonary tracheal segmentation, the scarcity of annotated data is a prevalent issue in medical segmentation. Additionally, Deep Learning (DL) methods face challenges: the opacity of 'black box' models and the need for performance…

Image and Video Processing · Electrical Eng. & Systems 2024-07-24 Shiyi Wang , Yang Nan , Sheng Zhang , Federico Felder , Xiaodan Xing , Yingying Fang , Javier Del Ser , Simon L F Walsh , Guang Yang

Modern AI systems frequently rely on opaque black-box models, most notably Deep Neural Networks, whose performance stems from complex architectures with millions of learned parameters. While powerful, their complexity poses a major…

Machine Learning · Computer Science 2026-02-23 David Dembinsky , Adriano Lucieri , Stanislav Frolov , Hiba Najjar , Ko Watanabe , Andreas Dengel

In sensitive contexts, providers of machine learning algorithms are increasingly required to give explanations for their algorithms' decisions. However, explanation receivers might not trust the provider, who potentially could output…

Machine Learning · Computer Science 2024-07-19 Robi Bhattacharjee , Ulrike von Luxburg

For strategic problems, intelligent systems based on Deep Reinforcement Learning (DRL) have demonstrated an impressive ability to learn advanced solutions that can go far beyond human capabilities, especially when dealing with complex…

Artificial Intelligence · Computer Science 2020-11-16 Jonas Andrulis , Ole Meyer , Grégory Schott , Samuel Weinbach , Volker Gruhn

The industry increasingly relies on deep learning (DL) technology for manufacturing inspections, which are challenging to automate with rule-based machine vision algorithms. DL-powered inspection systems derive defect patterns from labeled…

Machine Learning · Computer Science 2024-09-17 Altaf Allah Abbassi , Houssem Ben Braiek , Foutse Khomh , Thomas Reid

Data analysis is challenging as it requires synthesizing domain knowledge, statistical expertise, and programming skills. Assistants powered by large language models (LLMs), such as ChatGPT, can assist analysts by translating natural…

Human-Computer Interaction · Computer Science 2024-03-05 Ken Gu , Ruoxi Shang , Tim Althoff , Chenglong Wang , Steven M. Drucker

Auditing plays a pivotal role in the development of trustworthy AI. However, current research primarily focuses on creating auditable AI documentation, which is intended for regulators and experts rather than end-users affected by AI…

Computers and Society · Computer Science 2023-05-31 Nicolas Scharowski , Michaela Benk , Swen J. Kühne , Léane Wettstein , Florian Brühlmann

Auditing Large Language Models (LLMs) is a crucial and challenging task. In this study, we focus on auditing black-box LLMs without access to their parameters, only to the provided service. We treat this type of auditing as a black-box…

Artificial Intelligence · Computer Science 2025-01-07 Xiang Zheng , Longxiang Wang , Yi Liu , Xingjun Ma , Chao Shen , Cong Wang

Issues regarding explainable AI involve four components: users, laws & regulations, explanations and algorithms. Together these components provide a context in which explanation methods can be evaluated regarding their adequacy. The goal of…

Artificial Intelligence · Computer Science 2018-03-30 Gabrielle Ras , Marcel van Gerven , Pim Haselager

The deployment of AI models in clinical practice faces a critical challenge: models achieving expert-level performance on benchmarks can fail catastrophically when confronted with real-world variations in medical imaging. Minor shifts in…

Artificial Intelligence · Computer Science 2025-07-09 Lukas Kuhn , Florian Buettner

Deep learning (DL) research yields accuracy and product improvements from both model architecture changes and scale: larger data sets and models, and more computation. For hardware design, it is difficult to predict DL model changes.…

Machine Learning · Computer Science 2019-09-05 Joel Hestness , Newsha Ardalani , Greg Diamos

Deep Learning (DL) , a variant of the neural network algorithms originally proposed in the 1980s, has made surprising progress in Artificial Intelligence (AI), ranging from language translation, protein folding, autonomous cars, and more…

Artificial Intelligence · Computer Science 2023-07-24 Stephen Josè Hanson , Vivek Yadav , Catherine Hanson

We study the feasibility of conducting alignment audits: investigations into whether models have undesired objectives. As a testbed, we train a language model with a hidden objective. Our training pipeline first teaches the model about…

Deep Learning (DL) models processing images to recognize the health state of large infrastructure components can exhibit biases and rely on non-causal shortcuts. eXplainable Artificial Intelligence (XAI) can address these issues but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Giovanni Floreale , Piero Baraldi , Enrico Zio , Olga Fink

Deep Learning (DL) modeling has been a recent topic of interest. With the accelerating need to embed Deep Learning Networks (DLNs) to the Internet of Things (IoT) applications, many DL optimization techniques were developed to enable…

Networking and Internet Architecture · Computer Science 2025-01-14 Samaa Elnagar , Kweku-Muata Osei-Bryson

Ensuring the trustworthiness and robustness of deep learning models remains a fundamental challenge, particularly in high-stakes scientific applications. In this study, we present a framework called attention-guided training that combines…

Materials Science · Physics 2026-02-04 Jesco Talies , Eric Breitbarth , David Melching

National and international guidelines for trustworthy artificial intelligence (AI) consider explainability to be a central facet of trustworthy systems. This paper outlines a multi-disciplinary rationale for explainability auditing.…

Computers and Society · Computer Science 2025-04-22 Markus Langer , Kevin Baum , Kathrin Hartmann , Stefan Hessel , Timo Speith , Jonas Wahl

Artificial Intelligence (AI) has recently attracted a lot of attention, transitioning from research labs to a wide range of successful deployments in many fields, which is particularly true for Deep Learning (DL) techniques. Ultimately, DL…

Artificial Intelligence · Computer Science 2022-03-01 Lixuan Yang , Dario Rossi

The growing AI field faces trust, transparency, fairness, and discrimination challenges. Despite the need for new regulations, there is a mismatch between regulatory science and AI, preventing a consistent framework. A five-layer nested…

Computers and Society · Computer Science 2024-08-27 Akshat Dubey , Zewen Yang , Georges Hattab

The rapid progress in Large Language Models (LLMs) could transform many fields, but their fast development creates significant challenges for oversight, ethical creation, and building user trust. This comprehensive review looks at key trust…

Computers and Society · Computer Science 2024-07-22 Md Meftahul Ferdaus , Mahdi Abdelguerfi , Elias Ioup , Kendall N. Niles , Ken Pathak , Steven Sloan