English
Related papers

Related papers: Rationalizing Predictions by Adversarial Informati…

200 papers

Human-annotated textual explanations are becoming increasingly important in Explainable Natural Language Processing. Rationale extraction aims to provide faithful (i.e., reflective of the behavior of the model) and plausible (i.e.,…

Computation and Language · Computer Science 2023-10-24 Mohammad Reza Ghasemi Madani , Pasquale Minervini

Predictive models are being increasingly used to support consequential decision making at the individual level in contexts such as pretrial bail and loan approval. As a result, there is increasing social and legal pressure to provide…

Machine Learning · Computer Science 2020-03-02 Amir-Hossein Karimi , Gilles Barthe , Borja Balle , Isabel Valera

Language models are prone to memorizing their training data, making them vulnerable to extraction attacks. While existing research often examines isolated setups, such as a single model or a fixed prompt, real-world adversaries have a…

Cryptography and Security · Computer Science 2025-08-11 Yash More , Prakhar Ganesh , Golnoosh Farnadi

Although deep models achieve high predictive performance, it is difficult for humans to understand the predictions they made. Explainability is important for real-world applications to justify their reliability. Many example-based…

Machine Learning · Statistics 2021-12-08 Tomoharu Iwata , Yuya Yoshikawa

While a vast collection of explainable AI (XAI) algorithms have been developed in recent years, they are often criticized for significant gaps with how humans produce and consume explanations. As a result, current XAI techniques are often…

Artificial Intelligence · Computer Science 2023-08-08 Vivian Lai , Yiming Zhang , Chacha Chen , Q. Vera Liao , Chenhao Tan

Rationalization empowers deep learning models with self-explaining capabilities through a cooperative game, where a generator selects a semantically consistent subset of the input as a rationale, and a subsequent predictor makes predictions…

Artificial Intelligence · Computer Science 2023-12-18 Wei Liu , Haozhao Wang , Jun Wang , Zhiying Deng , YuanKai Zhang , Cheng Wang , Ruixuan Li

Decisions in organizations are about evaluating alternatives and choosing the one that would best serve organizational goals. To the extent that the evaluation of alternatives could be formulated as a predictive task with appropriate…

Human-Computer Interaction · Computer Science 2022-06-30 Charles Wan , Rodrigo Belo , Leid Zejnilović

Pre-trained language models have been successful on text classification tasks, but are prone to learning spurious correlations from biased datasets, and are thus vulnerable when making inferences in a new domain. Prior work reveals such…

Computation and Language · Computer Science 2022-01-03 Huihan Yao , Ying Chen , Qinyuan Ye , Xisen Jin , Xiang Ren

Model extraction increasingly attracts research attentions as keeping commercial AI models private can retain a competitive advantage. In some scenarios, AI models are trained proprietarily, where neither pre-trained models nor sufficient…

Machine Learning · Computer Science 2021-04-14 Xinyi Zhang , Chengfang Fang , Jie Shi

Rationalization models, which select a subset of input text as rationale-crucial for humans to understand and trust predictions-have recently emerged as a prominent research area in eXplainable Artificial Intelligence. However, most of…

Computation and Language · Computer Science 2024-09-20 Yuankai Zhang , Lingxiao Kong , Haozhao Wang , Ruixuan Li , Jun Wang , Yuhua Li , Wei Liu

Concept-based explanation methods aim at making machine learning models more transparent by finding the most important semantic features of an input (e.g., colors, patterns, shapes) for a given prediction task. However, these methods…

Machine Learning · Computer Science 2025-10-02 Jacopo Teneggi , Zhenzhen Wang , Paul H. Yi , Tianmin Shu , Jeremias Sulam

While the need for interpretable machine learning has been established, many common approaches are slow, lack fidelity, or hard to evaluate. Amortized explanation methods reduce the cost of providing interpretations by learning a global…

Machine Learning · Statistics 2021-03-03 Neil Jethani , Mukund Sudarshan , Yindalon Aphinyanaphongs , Rajesh Ranganath

In medical imaging, particularly in early disease detection and prognosis tasks, discerning the rationale behind an AI model's predictions is crucial for evaluating the reliability of its decisions. Conventional explanation methods face…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yingying Fang , Zihao Jin , Xiaodan Xing , Simon Walsh , Guang Yang

Document-level models for information extraction tasks like slot-filling are flexible: they can be applied to settings where information is not necessarily localized in a single sentence. For example, key features of a diagnosis in a…

Computation and Language · Computer Science 2022-05-19 Liyan Tang , Dhruv Rajan , Suyash Mohan , Abhijeet Pradhan , R. Nick Bryan , Greg Durrett

Automated decision making is used routinely throughout our everyday life. Recommender systems decide which jobs, movies, or other user profiles might be interesting to us. Spell checkers help us to make good use of language. Fraud detection…

Machine Learning · Computer Science 2020-07-15 Alexander Jung , Pedro H. J. Nardelli

Argumentation accommodates various rhetorical devices, such as questions, reported speech, and imperatives. These rhetorical tools usually assert argumentatively relevant propositions rather implicitly, so understanding their true meaning…

Computation and Language · Computer Science 2020-10-07 Yohan Jo , Jacky Visser , Chris Reed , Eduard Hovy

Artificial neural networks have been successfully applied to a variety of business application problems involving classification and regression. Although backpropagation neural networks generally predict better than decision trees do for…

Neural and Evolutionary Computing · Computer Science 2010-09-28 S. M. Kamruzzaman , Ahmed Ryadh Hasan

Information Extraction aims to distill structured, decision-relevant information from unstructured text, serving as a foundation for downstream understanding and reasoning. However, it is traditionally treated merely as a terminal…

Computation and Language · Computer Science 2026-04-17 Hang Lv , Sheng Liang , Hongchao Gu , Wei Guo , Defu Lian , Yong Liu , Hao Wang , Enhong Chen

Large pre-trained language models achieve impressive results across many tasks. However, recent works point out that pre-trained language models may memorize a considerable fraction of their training data, leading to the privacy risk of…

Computation and Language · Computer Science 2023-07-11 Zhexin Zhang , Jiaxin Wen , Minlie Huang

We introduce instancewise feature selection as a methodology for model interpretation. Our method is based on learning a function to extract a subset of features that are most informative for each given example. This feature selector is…

Machine Learning · Computer Science 2018-06-15 Jianbo Chen , Le Song , Martin J. Wainwright , Michael I. Jordan