English
Related papers

Related papers: Learning from the Best: Rationalizing Prediction b…

200 papers

Models that generate extractive rationales (i.e., subsets of features) or natural language explanations (NLEs) for their predictions are important for explainable AI. While an extractive rationale provides a quick view of the features most…

Computation and Language · Computer Science 2022-09-19 Bodhisattwa Prasad Majumder , Oana-Maria Camburu , Thomas Lukasiewicz , Julian McAuley

A growing line of work has investigated the development of neural NLP models that can produce rationales--subsets of input that can explain their model predictions. In this paper, we ask whether such rationale models can also provide…

Computation and Language · Computer Science 2022-05-05 Howard Chen , Jacqueline He , Karthik Narasimhan , Danqi Chen

Open information extraction (IE) is the task of extracting open-domain assertions from natural language sentences. A key step in open IE is confidence modeling, ranking the extractions based on their estimated quality to adjust precision…

Computation and Language · Computer Science 2019-06-03 Zhengbao Jiang , Pengcheng Yin , Graham Neubig

Well-calibrated predictions of user preferences are essential for many applications. Since recommender systems typically select the top-N items for users, calibration for those top-N items, rather than for all items, is important. We show…

Information Retrieval · Computer Science 2024-08-22 Masahiro Sato

Decision analysis deals with modeling and enhancing decision processes. A principal challenge in improving behavior is in obtaining a transparent description of existing behavior in the first place. In this paper, we develop an expressive,…

Machine Learning · Statistics 2023-10-31 Daniel Jarrett , Alihan Hüyük , Mihaela van der Schaar

Human explanations of natural language, rationales, form a tool to assess whether models learn a label for the right reasons or rely on dataset-specific shortcuts. Sufficiency is a common metric for estimating the informativeness of…

Computation and Language · Computer Science 2025-11-21 Jonathan Kamp , Lisa Beinborn , Antske Fokkens

In medical imaging, particularly in early disease detection and prognosis tasks, discerning the rationale behind an AI model's predictions is crucial for evaluating the reliability of its decisions. Conventional explanation methods face…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yingying Fang , Zihao Jin , Xiaodan Xing , Simon Walsh , Guang Yang

In the last years decision-focused learning framework, also known as predict-and-optimize, have received increasing attention. In this setting, the predictions of a machine learning model are used as estimated cost coefficients in the…

Machine Learning · Computer Science 2022-06-20 Jayanta Mandi , Víctor Bucarey , Maxime Mulamba , Tias Guns

The task of rationalization aims to extract pieces of input text as rationales to justify neural network predictions on text classification tasks. By definition, rationales represent key text pieces used for prediction and thus should have…

Computation and Language · Computer Science 2021-06-02 Yongfeng Huang , Yujun Chen , Yulun Du , Zhilin Yang

Human-annotated textual explanations are becoming increasingly important in Explainable Natural Language Processing. Rationale extraction aims to provide faithful (i.e., reflective of the behavior of the model) and plausible (i.e.,…

Computation and Language · Computer Science 2023-10-24 Mohammad Reza Ghasemi Madani , Pasquale Minervini

Automated decision making is used routinely throughout our everyday life. Recommender systems decide which jobs, movies, or other user profiles might be interesting to us. Spell checkers help us to make good use of language. Fraud detection…

Machine Learning · Computer Science 2020-07-15 Alexander Jung , Pedro H. J. Nardelli

A reliable deep learning system should be able to accurately express its confidence with respect to its predictions, a quality known as calibration. One of the most effective ways to produce reliable confidence estimates with a pre-trained…

Machine Learning · Computer Science 2024-10-10 Thomas P. Zollo , Zhun Deng , Jake C. Snell , Toniann Pitassi , Richard Zemel

We consider the problem of strategic classification, where a learner must build a model to classify agents based on features that have been strategically modified. Previous work in this area has concentrated on the case when the learner is…

Machine Learning · Computer Science 2025-05-19 Jack Geary , Henry Gouk

Explanations in a recommender system assist users in making informed decisions among a set of recommended items. Great research attention has been devoted to generating natural language explanations to depict how the recommendations are…

Information Retrieval · Computer Science 2022-02-22 Peng Wang , Renqin Cai , Hongning Wang

Work on "learning with rationales" shows that humans providing explanations to a machine learning system can improve the system's predictive accuracy. However, this work has not been connected to work in "explainable AI" which concerns…

Computation and Language · Computer Science 2019-06-03 Julia Strout , Ye Zhang , Raymond J. Mooney

In many practical applications of AI, an AI model is used as a decision aid for human users. The AI provides advice that a human (sometimes) incorporates into their decision-making process. The AI advice is often presented with some measure…

Artificial Intelligence · Computer Science 2022-10-31 Kailas Vodrahalli , Tobias Gerstenberg , James Zou

Concept-based explanation methods aim at making machine learning models more transparent by finding the most important semantic features of an input (e.g., colors, patterns, shapes) for a given prediction task. However, these methods…

Machine Learning · Computer Science 2025-10-02 Jacopo Teneggi , Zhenzhen Wang , Paul H. Yi , Tianmin Shu , Jeremias Sulam

Most successful information extraction systems operate with access to a large collection of documents. In this work, we explore the task of acquiring and incorporating external evidence to improve extraction accuracy in domains where the…

Computation and Language · Computer Science 2016-09-29 Karthik Narasimhan , Adam Yala , Regina Barzilay

When used in complex engineered systems, such as communication networks, artificial intelligence (AI) models should be not only as accurate as possible, but also well calibrated. A well-calibrated AI model is one that can reliably quantify…

Machine Learning · Computer Science 2022-12-16 Kfir M. Cohen , Sangwoo Park , Osvaldo Simeone , Shlomo Shamai

In Explainable AI, rule extraction translates model knowledge into logical rules, such as IF-THEN statements, crucial for understanding patterns learned by black-box models. This could significantly aid in fields like disease diagnosis,…

Machine Learning · Computer Science 2024-08-16 Yu Chen , Tianyu Cui , Alexander Capstick , Nan Fletcher-Loyd , Payam Barnaghi