中文
相关论文

相关论文: F1 is Not Enough! Models and Evaluation Towards Us…

200 篇论文

Is explainability a false promise? This debate has emerged from the insufficient evidence that explanations help people in situations they are introduced for. More human-centered, application-grounded evaluations of explanations are needed…

计算与语言 · 计算机科学 2024-11-06 Fateme Hashemi Chaleshtori , Atreya Ghosal , Alexander Gill , Purbid Bambroo , Ana Marasović

When answering a question, humans utilize the information available across different modalities to synthesize a consistent and complete chain of thought (CoT). This process is normally a black box in the case of deep learning models like…

计算与语言 · 计算机科学 2022-10-18 Pan Lu , Swaroop Mishra , Tony Xia , Liang Qiu , Kai-Wei Chang , Song-Chun Zhu , Oyvind Tafjord , Peter Clark , Ashwin Kalyan

Artificial intelligence-augmented technology represents a considerable opportunity for improving healthcare delivery. Significant progress has been made to demonstrate the value of complex models to enhance clinicians` efficiency in…

人机交互 · 计算机科学 2025-04-08 Mohammad Golam Kibria , Lauren Kucirka , Javed Mostafa

Explainable AI provides insight into the "why" for model predictions, offering potential for users to better understand and trust a model, and to recognize and correct AI predictions that are incorrect. Prior research on human and…

机器学习 · 计算机科学 2020-06-22 Yasmeen Alufaisan , Laura R. Marusich , Jonathan Z. Bakdash , Yan Zhou , Murat Kantarcioglu

When Question-Answering (QA) systems are deployed in the real world, users query them through a variety of interfaces, such as speaking to voice assistants, typing questions into a search engine, or even translating questions to languages…

计算与语言 · 计算机科学 2021-02-17 Abhilasha Ravichander , Siddharth Dalmia , Maria Ryskina , Florian Metze , Eduard Hovy , Alan W Black

Question answer generation using Natural Language Processing models is ubiquitous in the world around us. It is used in many use cases such as the building of chat bots, suggestive prompts in google search and also as a way of navigating…

计算与语言 · 计算机科学 2023-11-28 Shashidhar Reddy Javaji , Haoran Hu , Sai Sameer Vennam , Vijaya Gajanan Buddhavarapu

A growing body of research runs human subject evaluations to study whether providing users with explanations of machine learning models can help them with practical real-world use cases. However, running user studies is challenging and…

人机交互 · 计算机科学 2022-08-23 Valerie Chen , Nari Johnson , Nicholay Topin , Gregory Plumb , Ameet Talwalkar

The current literature on AI-advised decision making -- involving explainable AI systems advising human decision makers -- presents a series of inconclusive and confounding results. To synthesize these findings, we propose a simple theory…

人工智能 · 计算机科学 2024-02-05 Raymond Fok , Daniel S. Weld

Interest in the field of Explainable Artificial Intelligence has been growing for decades and has accelerated recently. As Artificial Intelligence models have become more complex, and often more opaque, with the incorporation of complex…

人工智能 · 计算机科学 2020-03-18 Shruthi Chari , Daniel M. Gruen , Oshani Seneviratne , Deborah L. McGuinness

The increasing reliance on digital information necessitates advancements in conversational search systems, particularly in terms of information transparency. While prior research in conversational information-seeking has concentrated on…

信息检索 · 计算机科学 2024-05-07 Weronika Łajewska , Damiano Spina , Johanne Trippas , Krisztian Balog

While much research focused on producing explanations, it is still unclear how the produced explanations' quality can be evaluated in a meaningful way. Today's predominant approach is to quantify explanations using proxy scores which…

计算与语言 · 计算机科学 2023-03-10 Hendrik Schuff , Heike Adel , Peng Qi , Ngoc Thang Vu

Automated decision making is used routinely throughout our everyday life. Recommender systems decide which jobs, movies, or other user profiles might be interesting to us. Spell checkers help us to make good use of language. Fraud detection…

机器学习 · 计算机科学 2020-07-15 Alexander Jung , Pedro H. J. Nardelli

Algorithmic approaches to interpreting machine learning models have proliferated in recent years. We carry out human subject tests that are the first of their kind to isolate the effect of algorithmic explanations on a key aspect of model…

计算与语言 · 计算机科学 2020-05-06 Peter Hase , Mohit Bansal

Explaining the behaviour of intelligent systems will get increasingly and perhaps intractably challenging as models grow in size and complexity. We may not be able to expect an explanation for every prediction made by a brain-scale model,…

人工智能 · 计算机科学 2022-05-23 Advait Sarkar

Recommender systems play a fundamental role in web applications in filtering massive information and matching user interests. While many efforts have been devoted to developing more effective models in various scenarios, the exploration on…

机器学习 · 计算机科学 2020-08-24 Ninghao Liu , Yong Ge , Li Li , Xia Hu , Rui Chen , Soo-Hyun Choi

Question Answering (QA) is key for making possible a robust communication between human and machine. Modern language models used for QA have surpassed the human-performance in several essential tasks; however, these models require large…

计算与语言 · 计算机科学 2021-09-08 Liubov Nikolenko , Pouya Rezazadeh Kalehbasti

Explainability and interpretability of AI models is an essential factor affecting the safety of AI. While various explainable AI (XAI) approaches aim at mitigating the lack of transparency in deep networks, the evidence of the effectiveness…

人工智能 · 计算机科学 2020-03-03 Kamran Alipour , Jurgen P. Schulze , Yi Yao , Avi Ziskind , Giedrius Burachas

In today's digitalized world, where software systems are becoming increasingly ubiquitous and complex, the quality aspect of explainability is gaining relevance. A major challenge in achieving adequate explanations is the elicitation of…

软件工程 · 计算机科学 2025-06-23 Hannah Deters , Laura Reinhardt , Jakob Droste , Martin Obaidi , Kurt Schneider

Typically, machine learning models are trained and evaluated without making any distinction between users (e.g, using traditional hold-out and cross-validation). However, this produces inaccurate performance metrics estimates in multi-user…

机器学习 · 计算机科学 2023-12-11 Enrique Garcia-Ceja , Luciano Garcia-Banuelos , Nicolas Jourdan

A core assumption of explainable AI systems is that explanations change what users know, thereby enabling them to act within their complex socio-technical environments. Despite the centrality of action, explanations are often organized and…

人机交互 · 计算机科学 2023-05-11 Gennie Mansi , Mark Riedl