English
Related papers

Related papers: Trust in AI: Interpretability is not necessary or …

200 papers

Artificial Intelligence (AI) has paved the way for revolutionary decision-making processes, which if harnessed appropriately, can contribute to advancements in various sectors, from healthcare to economics. However, its black box nature…

Trust is not just a cognitive issue but also an emotional one, yet the research in human-AI interactions has primarily focused on the cognitive route of trust development. Recent work has highlighted the importance of studying affective…

Human-Computer Interaction · Computer Science 2024-11-11 Ruoxi Shang , Gary Hsieh , Chirag Shah

Auditing plays a pivotal role in the development of trustworthy AI. However, current research primarily focuses on creating auditable AI documentation, which is intended for regulators and experts rather than end-users affected by AI…

Computers and Society · Computer Science 2023-05-31 Nicolas Scharowski , Michaela Benk , Swen J. Kühne , Léane Wettstein , Florian Brühlmann

Despite the importance of trust in human-AI interactions, researchers must adopt questionnaires from other disciplines that lack validation in the AI context. Motivated by the need for reliable and valid measures, we investigated the…

Trustworthy Artificial Intelligence (AI) is based on seven technical requirements sustained over three main pillars that should be met throughout the system's entire life cycle: it should be (1) lawful, (2) ethical, and (3) robust, both…

As researchers strive to narrow the gap between machine intelligence and human through the development of artificial intelligence technologies, it is imperative that we recognize the critical importance of trustworthiness in open-world,…

Machine Learning · Statistics 2023-10-19 Shide Du , Zihan Fang , Shiyang Lan , Yanchao Tan , Manuel Günther , Shiping Wang , Wenzhong Guo

Frontier AI systems require governance mechanisms that can verify internal alignment, not just behavioral compliance. Private governance mechanisms audits, certification, insurance, and procurement are emerging to complement public…

Machine Learning · Computer Science 2025-11-21 Aadit Sengupta , Pratinav Seth , Vinay Kumar Sankarapu

As artificial intelligence (AI), including machine learning (ML) models and foundation models (FMs), is increasingly deployed in high-stakes domains, ensuring their trustworthiness has become a central challenge. However, the core…

Artificial Intelligence · Computer Science 2026-05-05 Ruta Binkyte , Ivaxi Sheth , Zhijing Jin , Mohammad Havaei , Bernhard Schölkopf , Mario Fritz

Handling trust is one of the core requirements for facilitating effective interaction between the human and the AI agent. Thus, any decision-making framework designed to work with humans must possess the ability to estimate and leverage…

Artificial Intelligence · Computer Science 2023-01-31 Zahra Zahedi , Sarath Sreedharan , Subbarao Kambhampati

Context: Blockchain and AI are increasingly explored to enhance trustworthiness in software engineering (SE), particularly in supporting software evolution tasks. Method: We conducted a systematic literature review (SLR) using a predefined…

Software Engineering · Computer Science 2026-02-03 Mohammad Naserameri , Juergen Rilling

This study explores the integration of contextual explanations into AI-powered loan decision systems to enhance trust and usability. While traditional AI systems rely heavily on algorithmic transparency and technical accuracy, they often…

Human-Computer Interaction · Computer Science 2025-10-07 Allen Daniel Sunny

As AI systems advance beyond human capabilities, scalable oversight becomes critical: how can we supervise AI that exceeds our abilities? A key challenge is that human evaluators may form incorrect beliefs about AI behavior in complex…

Artificial Intelligence · Computer Science 2025-10-22 Leon Lang , Patrick Forré

A central goal of explainable artificial intelligence (XAI) is to improve the trust relationship in human-AI interaction. One assumption underlying research in transparent AI systems is that explanations help to better assess predictions of…

Artificial Intelligence · Computer Science 2021-06-23 Felix Biessmann , Viktor Treu

Understanding AI systems' inner workings is critical for ensuring value alignment and safety. This review explores mechanistic interpretability: reverse engineering the computational mechanisms and representations learned by neural networks…

Artificial Intelligence · Computer Science 2024-08-27 Leonard Bereska , Efstratios Gavves

Artificial Intelligence (AI) is an important part of our everyday lives. We use it in self-driving cars and smartphone assistants. People often call it a "black box" because its complex systems, especially deep neural networks, are hard to…

Black box neural networks are an indispensable part of modern robots. Nevertheless, deploying such high-stakes systems in real-world scenarios poses significant challenges when the stakeholders, such as engineers and legislative bodies,…

Robotics · Computer Science 2025-10-10 Som Sagar , Aditya Taparia , Harsh Mankodiya , Pranav Bidare , Yifan Zhou , Ransalu Senanayake

Building trustworthy AI systems for mental health support is a shared priority across stakeholders from multiple disciplines. However, "trustworthy" remains loosely defined and inconsistently operationalized. AI research often focuses on…

Computation and Language · Computer Science 2026-04-23 Xin Sun , Yue Su , Yifan Mo , Qingyu Meng , Yuxuan Li , Saku Sugawara , Mengyuan Zhang , Charlotte Gerritsen , Sander L. Koole , Koen Hindriks , Jiahuan Pei

Trustworthy artificial intelligence (AI) has become an important topic because trust in AI systems and their creators has been lost. Researchers, corporations, and governments have long and painful histories of excluding marginalized groups…

Computers and Society · Computer Science 2022-03-07 Ashwin , William Agnew , Umut Pajaro , Hetvi Jethwani , Arjun Subramonian

AI systems have seen significant adoption in various domains. At the same time, further adoption in some domains is hindered by inability to fully trust an AI system that it will not harm a human. Besides the concerns for fairness, privacy,…

Artificial Intelligence · Computer Science 2021-08-04 Amit Sheth , Manas Gaur , Kaushik Roy , Keyur Faldu

AI services are known to have unstable behavior when subjected to changes in data, models or users. Such behaviors, whether triggered by omission or commission, lead to trust issues when AI works with humans. The current approach of…

Human-Computer Interaction · Computer Science 2023-02-21 Biplav Srivastava , Kausik Lakkaraju , Mariana Bernagozzi , Marco Valtorta