中文
相关论文

相关论文: Compensated Integrated Gradients to Reliably Inter…

200 篇论文

The complex nature of artificial neural networks raises concerns on their reliability, trustworthiness, and fairness in real-world scenarios. The Shapley value -- a solution concept from game theory -- is one of the most popular explanation…

机器学习 · 计算机科学 2023-12-29 Jacopo Teneggi , Beepul Bharti , Yaniv Romano , Jeremias Sulam

We address the challenging problem of deep representation learning--the efficient adaption of a pre-trained deep network to different tasks. Specifically, we propose to explore gradient-based features. These features are gradients of the…

机器学习 · 计算机科学 2020-04-14 Fangzhou Mu , Yingyu Liang , Yin Li

Current methods for the interpretability of discriminative deep neural networks commonly rely on the model's input-gradients, i.e., the gradients of the output logits w.r.t. the inputs. The common assumption is that these input-gradients…

机器学习 · 计算机科学 2021-03-04 Suraj Srinivas , Francois Fleuret

Originally introduced in game theory, Shapley values have emerged as a central tool in explainable machine learning, where they are used to attribute model predictions to specific input features. However, computing Shapley values exactly is…

机器学习 · 计算机科学 2025-03-11 Christopher Musco , R. Teal Witter

Many problems involve the use of models which learn probability distributions or incorporate randomness in some way. In such problems, because computing the true expected gradient may be intractable, a gradient estimator is used to update…

机器学习 · 计算机科学 2022-12-29 Ronan Keane , H. Oliver Gao

Shapley values has established itself as one of the most appropriate and theoretically sound frameworks for explaining predictions from complex machine learning models. The popularity of Shapley values in the explanation setting is probably…

机器学习 · 统计学 2021-06-24 Martin Jullum , Annabelle Redelmeier , Kjersti Aas

This paper presents an algorithmic framework for solving unconstrained stochastic optimization problems using only stochastic function evaluations. We employ central finite-difference based gradient estimation methods to approximate the…

最优化与控制 · 数学 2025-01-14 Raghu Bollapragada , Cem Karamanli

Variational inference in Bayesian deep learning often involves computing the gradient of an expectation that lacks a closed-form solution. In these cases, pathwise and score-function gradient estimators are the most common approaches. The…

机器学习 · 统计学 2024-10-10 Kenyon Ng , Susan Wei

Active learning algorithms select a subset of data for annotation to maximize the model performance on a budget. One such algorithm is Expected Gradient Length, which as the name suggests uses the approximate gradient induced per example in…

计算机视觉与模式识别 · 计算机科学 2022-06-02 Megh Shukla

Labeled data can be expensive to acquire in several application domains, including medical imaging, robotics, and computer vision. To efficiently train machine learning models under such high labeling costs, active learning (AL) judiciously…

机器学习 · 计算机科学 2022-06-13 Konstantinos D. Polyzos , Qin Lu , Georgios B. Giannakis

Attribution-based explanation techniques capture key patterns to enhance visual interpretability; however, these patterns often lack the granularity needed for insight in fine-grained tasks, particularly in cases of model misclassification,…

人工智能 · 计算机科学 2025-11-12 Lintong Zhang , Kang Yin , Seong-Whan Lee

Although input-gradients techniques have evolved to mitigate and tackle the challenges associated with gradients, modern gradient-weighted CAM approaches still rely on vanilla gradients, which are inherently susceptible to the saturation…

机器学习 · 计算机科学 2024-06-27 Vincenzo Buono , Peyman Sheikholharam Mashhadi , Mahmoud Rahat , Prayag Tiwari , Stefan Byttner

Gradient sampling (GS) has proved to be an effective methodology for the minimization of objective functions that may be nonconvex and/or nonsmooth. The most computationally expensive component of a contemporary GS method is the need to…

最优化与控制 · 数学 2021-08-10 Frank E. Curtis , Minhan Li

Data valuation -- quantifying the contribution of individual data sources to certain predictive behaviors of a model -- is of great importance to enhancing the transparency of machine learning and designing incentive systems for data…

机器学习 · 计算机科学 2023-07-28 Zhihong Liu , Hoang Anh Just , Xiangyu Chang , Xi Chen , Ruoxi Jia

Forced alignment is a common tool to align audio with orthographic and phonetic transcriptions. Most forced alignment tools provide only point-estimates of boundaries. The present project introduces a method of producing gradient boundaries…

音频与语音处理 · 电气工程与系统科学 2026-05-06 Matthew C. Kelley

Large language models (LLMs) excel on new tasks without additional training, simply by providing natural language prompts that demonstrate how the task should be performed. Prompt ensemble methods comprehensively harness the knowledge of…

计算与语言 · 计算机科学 2024-12-17 Hanxi Liu , Xiaokai Mao , Haocheng Xia , Jian Lou , Jinfei Liu , Kui Ren

Obtaining high certainty in predictive models is crucial for making informed and trustworthy decisions in many scientific and engineering domains. However, extensive experimentation required for model accuracy can be both costly and…

机器学习 · 计算机科学 2024-12-17 Giorgio Morales , John Sheppard

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

机器学习 · 统计学 2025-03-25 Zehao Li , Yijie Peng

In this paper, we present a novel derivative-free optimization framework for solving unconstrained stochastic optimization problems. Many problems in fields ranging from simulation optimization to reinforcement learning involve settings…

最优化与控制 · 数学 2024-04-19 Raghu Bollapragada , Cem Karamanli , Stefan M. Wild

Feature selection remains a major challenge in medical prediction, where existing approaches such as LASSO often lack robustness and interpretability. We introduce GRASP, a novel framework that couples Shapley value driven attribution with…

机器学习 · 计算机科学 2026-05-01 Yuheng Luo , Shuyan Li , Zhong Cao