English
Related papers

Related papers: Feature Attribution Stability Suite: How Stable Ar…

200 papers

Feature selection, as a vital dimension reduction technique, reduces data dimension by identifying an essential subset of input features, which can facilitate interpretable insights into learning and inference processes. Algorithmic…

Machine Learning · Computer Science 2022-01-06 Xinxing Wu , Qiang Cheng

Feature attribution methods, or saliency maps, are one of the most popular approaches for explaining the decisions of complex machine learning models such as deep neural networks. In this study, we propose a stochastic optimization approach…

Machine Learning · Statistics 2018-07-17 Kouichi Ikeno , Satoshi Hara

Deep neural networks are very successful on many vision tasks, but hard to interpret due to their black box nature. To overcome this, various post-hoc attribution methods have been proposed to identify image regions most influential to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Sukrut Rao , Moritz Böhle , Bernt Schiele

While unbiased machine learning models are essential for many applications, bias is a human-defined concept that can vary across tasks. Given only input-label pairs, algorithms may lack sufficient information to distinguish stable (causal)…

Machine Learning · Computer Science 2022-06-28 Yujia Bao , Shiyu Chang , Regina Barzilay

Machine and deep learning have grown in popularity and use in biological research over the last decade but still present challenges in interpretability of the fitted model. The development and use of metrics to determine features driving…

Machine Learning · Statistics 2025-07-31 Daniel Claborne , Javier Flores , Samantha Erwin , Luke Durell , Rachel Richardson , Ruby Fore , Lisa Bramer

In this study, we examine the efficacy of post-hoc local attribution methods in identifying features with predictive power from irrelevant ones in domains characterized by a low signal-to-noise ratio (SNR), a common scenario in real-world…

Machine Learning · Computer Science 2024-06-19 Ge Shi , Ziwen Kan , Jason Smucny , Ian Davidson

We study feature selection in high-dimensional regression under two distinct sources of instability: sampling variability and measurement error in the design matrix. Stability Selection addresses the former through sub-sampling and…

Methodology · Statistics 2026-05-05 Mahdi Nouraie , Houying Zhu , Samuel Muller

We present a new algorithm for boosting generalized additive models for location, scale and shape (GAMLSS) that allows to incorporate stability selection, an increasingly popular way to obtain stable sets of covariates while controlling the…

Computation · Statistics 2017-05-16 Janek Thomas , Andreas Mayr , Bernd Bischl , Matthias Schmid , Adam Smith , Benjamin Hofner

The attribution method provides a direction for interpreting opaque neural networks in a visual way by identifying and visualizing the input regions/pixels that dominate the output of a network. Regarding the attribution method for visually…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Zhenqiang Li , Weimin Wang , Zuoyue Li , Yifei Huang , Yoichi Sato

The class of $\alpha$-stable distributions is widely used in various applications, especially for modelling heavy-tailed data. Although the $\alpha$-stable distributions have been used in practice for many years, new methods for…

Methodology · Statistics 2022-12-29 Kewin Pączek , Damian Jelito , Marcin Pitera , Agnieszka Wyłomańska

Selecting regularization parameters in penalized high-dimensional graphical models in a principled, data-driven, and computationally efficient manner continues to be one of the key challenges in high-dimensional statistics. We present…

Methodology · Statistics 2016-10-19 Christian L. Müller , Richard Bonneau , Zachary Kurtz

Enhancing the robustness of vision algorithms in real-world scenarios is challenging. One reason is that existing robustness benchmarks are limited, as they either rely on synthetic data or ignore the effects of individual nuisance factors.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Bingchen Zhao , Shaozuo Yu , Wufei Ma , Mingxin Yu , Shenxiao Mei , Angtian Wang , Ju He , Alan Yuille , Adam Kortylewski

We study the problem of linear feature selection when features are highly correlated. Such settings pose two fundamental challenges. First, how should model similarity be defined? Simply counting features in common can be misleading: two…

Methodology · Statistics 2026-03-24 Xiaozhu Zhang , Jacob Bien , Armeen Taeb

Feature attribution methods (FAs) are popular approaches for providing insights into the model reasoning process of making predictions. The more faithful a FA is, the more accurately it reflects which parts of the input are more important…

Computation and Language · Computer Science 2024-01-31 Zhixue Zhao , Nikolaos Aletras

The most popular image matching algorithm SIFT, introduced by D. Lowe a decade ago, has proven to be sufficiently scale invariant to be used in numerous applications. In practice, however, scale invariance may be weakened by various sources…

Computer Vision and Pattern Recognition · Computer Science 2015-11-30 Ives Rey-Otero , Jean-Michel Morel , Mauricio Delbracio

Image attribution analysis seeks to highlight the feature representations learned by visual models such that the highlighted feature maps can reflect the pixel-wise importance of inputs. Gradient integration is a building block in the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Róisín Luo , James McDermott , Colm O'Riordan

Despite significant advancements in out-of-distribution (OOD) detection, existing methods still struggle to maintain robustness against adversarial attacks, compromising their reliability in critical real-world applications. Previous…

Machine Learning · Computer Science 2025-04-22 Hossein Mirzaei , Mackenzie W. Mathis

Current deep visual local feature detectors do not model the spatial uncertainty of detected features, producing suboptimal results in downstream applications. In this work, we propose two post-hoc covariance estimates that can be plugged…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Javier Tirado-Garín , Frederik Warburg , Javier Civera

Enhancing the robustness of vision algorithms in real-world scenarios is challenging. One reason is that existing robustness benchmarks are limited, as they either rely on synthetic data or ignore the effects of individual nuisance factors.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Bingchen Zhao , Jiahao Wang , Wufei Ma , Artur Jesslen , Siwei Yang , Shaozuo Yu , Oliver Zendel , Christian Theobalt , Alan Yuille , Adam Kortylewski

The robustness of algorithms against covariate shifts is a fundamental problem with critical implications for the deployment of machine learning algorithms in the real world. Current evaluation methods predominantly measure robustness…