中文
相关论文

相关论文: How Much Can We Really Trust You? Towards Simple, …

200 篇论文

There has long been debates on how we could interpret neural networks and understand the decisions our models make. Specifically, why deep neural networks tend to be error-prone when dealing with samples that output low softmax scores. We…

计算机视觉与模式识别 · 计算机科学 2018-12-04 Simiao Zuo , Jialin Wu

The widespread utilization of AI systems has drawn attention to the potential impacts of such systems on society. Of particular concern are the consequences that prediction errors may have on real-world scenarios, and the trust humanity…

计算机与社会 · 计算机科学 2021-06-22 Mary Roszel , Robert Norvill , Jean Hilger , Radu State

Artificial neural networks (NN) are instrumental in realizing highly-automated driving functionality. An overarching challenge is to identify best safety engineering practices for NN and other learning-enabled components. In particular,…

机器学习 · 计算机科学 2018-06-11 Chih-Hong Cheng , Georg Nührenberg , Chung-Hao Huang , Harald Ruess , Hirotoshi Yasuoka

As deep neural networks (DNNs) are increasingly used in safety-critical applications, there is a growing concern for their reliability. Even highly trained, high-performant networks are not 100% accurate. However, it is very difficult to…

神经与进化计算 · 计算机科学 2024-07-30 Eduard Pinconschi , Divya Gopinath , Rui Abreu , Corina S. Pasareanu

Artificial Intelligence (AI) and Machine Learning (ML) providers have a responsibility to develop valid and reliable systems. Much has been discussed about trusting AI and ML inferences (the process of running live data through a trained AI…

机器学习 · 计算机科学 2024-07-09 Dalmo Cirne , Veena Calambur

In the past few years, significant progress has been made on deep neural networks (DNNs) in achieving human-level performance on several long-standing tasks. With the broader deployment of DNNs on various applications, the concerns over…

机器学习 · 计算机科学 2020-06-02 Xiaowei Huang , Daniel Kroening , Wenjie Ruan , James Sharp , Youcheng Sun , Emese Thamo , Min Wu , Xinping Yi

The reliable measurement of confidence in classifiers' predictions is very important for many applications and is, therefore, an important part of classifier design. Yet, although deep learning has received tremendous attention in recent…

人工智能 · 计算机科学 2020-07-01 Amit Mandelbaum , Daphna Weinshall

Confidence estimation, a task that aims to evaluate the trustworthiness of the model's prediction output during deployment, has received lots of research attention recently, due to its importance for the safe deployment of deep models.…

计算机视觉与模式识别 · 计算机科学 2022-10-14 Haoxuan Qu , Yanchao Li , Lin Geng Foo , Jason Kuen , Jiuxiang Gu , Jun Liu

Recently, a series of studies have tried to extract interactions between input variables modeled by a DNN and define such interactions as concepts encoded by the DNN. However, strictly speaking, there still lacks a solid guarantee whether…

机器学习 · 计算机科学 2024-09-16 Mingjie Li , Quanshi Zhang

Handling trust is one of the core requirements for facilitating effective interaction between the human and the AI agent. Thus, any decision-making framework designed to work with humans must possess the ability to estimate and leverage…

人工智能 · 计算机科学 2023-01-31 Zahra Zahedi , Sarath Sreedharan , Subbarao Kambhampati

Neuron identification is a popular tool in mechanistic interpretability, aiming to uncover the human-interpretable concepts represented by individual neurons in deep networks. While algorithms such as Network Dissection and CLIP-Dissect…

人工智能 · 计算机科学 2025-12-23 Ge Yan , Tuomas Oikarinen , Tsui-Wei , Weng

Trust can be defined as a measure to determine which source of information is reliable and with whom we should share or from whom we should accept information. There are several applications for trust in Online Social Networks (OSNs),…

社会与信息网络 · 计算机科学 2020-03-24 Seyed Mohssen Ghafari

Across several branches of conversational interaction research including interactions with social robots, embodied agents, and conversational assistants, users have identified trust as a critical part of those interactions. Nevertheless,…

人机交互 · 计算机科学 2019-07-04 Justin Edwards , Elaheh Sanoubari

Deep learning architectures have proved versatile in a number of drug discovery applications, including the modelling of in vitro compound activity. While controlling for prediction confidence is essential to increase the trust,…

机器学习 · 计算机科学 2018-10-23 Isidro Cortes-Ciriano , Andreas Bender

Along with the great success of deep neural networks, there is also growing concern about their black-box nature. The interpretability issue affects people's trust on deep learning systems. It is also related to many ethical problems, e.g.,…

机器学习 · 计算机科学 2022-02-01 Yu Zhang , Peter Tiňo , Aleš Leonardis , Ke Tang

Uncertainty-quantification methods are applied to estimate the confidence of deep-neural-networks classifiers over their predictions. However, most widely used methods are known to be overconfident. We address this problem by developing an…

机器学习 · 计算机科学 2023-05-19 Luigi Sbailò , Luca M. Ghiringhelli

Deep neural networks provide flexible frameworks for learning data representations and functions relating data to other properties and are often claimed to achieve 'super-human' performance in inferring relationships between input data and…

材料科学 · 物理学 2021-05-26 Keith T. Butler , Manh Duc Le , Jeyarajan Thiyagalingam , Toby G. Perring

Trustworthy machine learning is of primary importance to the practical deployment of deep learning models. While state-of-the-art models achieve astonishingly good performance in terms of accuracy, recent literature reveals that their…

机器学习 · 计算机科学 2023-02-07 Ailin Deng , Shen Li , Miao Xiong , Zhirui Chen , Bryan Hooi

Few concepts are as ubiquitous in computational fields as trust. However, in the case of information visualization, there are several unique and complex challenges, chief among them: defining and measuring trust. In this paper, we…

人机交互 · 计算机科学 2023-08-10 Saugat Pandey , Oen G. McKinley , R. Jordan Crouser , Alvitta Ottley

People's trust in prediction models can be affected by many factors, including domain expertise like knowledge about the application domain and experience with predictive modelling. However, to what extent and why domain expertise impacts…

人机交互 · 计算机科学 2021-09-20 Jeroen Ooge , Katrien Verbert