English
Related papers

Related papers: Linear Model Extraction via Factual and Counterfac…

200 papers

In science and medicine, model interpretations may be reported as discoveries of natural phenomena or used to guide patient treatments. In such high-stakes tasks, false discoveries may lead investigators astray. These applications would…

Machine Learning · Statistics 2020-08-18 Collin Burns , Jesse Thomason , Wesley Tansey

When a language model is fed a wrong answer, what happens inside the network? Current understanding treats truthfulness as a static property of individual-layer representations-a direction to be probed, a feature to be extracted. Less is…

Computation and Language · Computer Science 2026-03-17 Javier Marín

To ensure trust in AI models, it is becoming increasingly apparent that evaluation of models must be extended beyond traditional performance metrics, like accuracy, to other dimensions, such as fairness, explainability, adversarial…

Machine Learning · Computer Science 2021-10-01 Moninder Singh , Gevorg Ghalachyan , Kush R. Varshney , Reginald E. Bryant

Two widely-used computational paradigms for sublinear algorithms are using linear measurements to perform computations on a high dimensional input and using structured queries to access a massive input. Typically, algorithms in the former…

Computational Complexity · Computer Science 2021-07-14 Amit Chakrabarti , Manuel Stoeckl

Counterfactual frameworks have grown popular in machine learning for both explaining algorithmic decisions but also defining individual notions of fairness, more intuitive than typical group fairness conditions. However, state-of-the-art…

Artificial Intelligence · Computer Science 2023-01-09 Lucas de Lara , Alberto González-Sanz , Nicholas Asher , Laurent Risser , Jean-Michel Loubes

Understanding the predictions made by deep learning models remains a central challenge, especially in high-stakes applications. A promising approach is to equip models with the ability to answer counterfactual questions -- hypothetical…

Machine Learning · Computer Science 2025-10-28 Inwoo Hwang , Yushu Pan , Elias Bareinboim

Counterfactual examples are an appealing class of post-hoc explanations for machine learning models. Given input $x$ of class $y_1$, its counterfactual is a contrastive example $x^\prime$ of another class $y_0$. Current approaches primarily…

Machine Learning · Computer Science 2022-05-17 Xiaoting Shao , Kristian Kersting

Reinforcement Learning (RL) has shown great promise in domains like healthcare and robotics but often struggles with adoption due to its lack of interpretability. Counterfactual explanations, which address "what if" scenarios, provide a…

Machine Learning · Computer Science 2025-05-20 Shuyang Dong , Shangtong Zhang , Lu Feng

Counterfactual explanations emerge as a powerful approach in explainable AI, providing what-if scenarios that reveal how minimal changes to an input time series can alter the model's prediction. This work presents a survey of recent…

Machine Learning · Computer Science 2026-03-31 Udo Schlegel , Thomas Seidl

A prominent weakness of modern language models (LMs) is their tendency to generate factually incorrect text, which hinders their usability. A natural question is whether such factual errors can be detected automatically. Inspired by…

Computation and Language · Computer Science 2023-05-23 Roi Cohen , May Hamri , Mor Geva , Amir Globerson

These days, deep learning models have achieved great success in multiple fields, from autonomous driving to medical diagnosis. These models have expanded the abilities of artificial intelligence by offering great solutions to complex…

Cryptography and Security · Computer Science 2023-11-27 Gopichandh Golla

Present language understanding methods have demonstrated extraordinary ability of recognizing patterns in texts via machine learning. However, existing methods indiscriminately use the recognized patterns in the testing phase that is…

Computation and Language · Computer Science 2021-06-08 Fuli Feng , Jizhi Zhang , Xiangnan He , Hanwang Zhang , Tat-Seng Chua

Model extraction is a growing concern for the security of AI systems. For deep neural network models, the architecture is the most important information an adversary aims to recover. Being a sequence of repeated computation blocks, neural…

Cryptography and Security · Computer Science 2024-02-07 Raphael Joud , Pierre-Alain Moellic , Simon Pontie , Jean-Baptiste Rigaud

Many deployed learned models are black boxes: given input, returns output. Internal information about the model, such as the architecture, optimisation procedure, or training data, is not disclosed explicitly as it might contain proprietary…

Machine Learning · Statistics 2018-02-15 Seong Joon Oh , Max Augustin , Bernt Schiele , Mario Fritz

Machine learning (ML) models play an increasingly prevalent role in many software engineering tasks. However, because most models are now powered by opaque deep neural networks, it can be difficult for developers to understand why the model…

Software Engineering · Computer Science 2021-11-11 Jürgen Cito , Isil Dillig , Vijayaraghavan Murali , Satish Chandra

Counterfactual Explanations are becoming a de-facto standard in post-hoc interpretable machine learning. For a given classifier and an instance classified in an undesired class, its counterfactual explanation corresponds to small…

Machine Learning · Computer Science 2024-01-17 Veronica Piccialli , Dolores Romero Morales , Cecilia Salvatore

A new type of robust estimation problem is introduced where the goal is to recover a statistical model that has been corrupted after it has been estimated from data. Methods are proposed for "repairing" the model using only the design and…

Statistics Theory · Mathematics 2020-05-21 Chao Gao , John Lafferty

Counterfactual explanations are an emerging tool to enhance interpretability of deep learning models. Given a sample, these methods seek to find and display to the user similar samples across the decision boundary. In this paper, we propose…

Machine Learning · Computer Science 2023-08-22 Cassio F. Dantas , Diego Marcos , Dino Ienco

Pretrained language models sometimes possess knowledge that we do not wish them to, including memorized personal information and knowledge that could be used to harm people. They can also output toxic or harmful text. To mitigate these…

Computation and Language · Computer Science 2023-10-02 Vaidehi Patil , Peter Hase , Mohit Bansal

As new Model-X knockoff construction techniques are developed, primarily concerned with determining the correct conditional distribution from which to sample, we focus less on deriving the correct multivariate distribution and instead ask…

Methodology · Statistics 2025-02-05 Christopher Hemmens , Stephan Robert-Nicoud