English
Related papers

Related papers: Improved Feature Importance Computations for Tree …

200 papers

Explainable artificial intelligence promises to yield insights into relevant features, thereby enabling humans to examine and scrutinize machine learning models or even facilitating scientific discovery. Considering the widespread technique…

Machine Learning · Computer Science 2026-03-30 Jörg Martin , Stefan Haufe

Many existing approaches for estimating feature importance are problematic because they ignore or hide dependencies among features. A causal graph, which encodes the relationships among input variables, can aid in assigning feature…

Machine Learning · Computer Science 2021-03-01 Jiaxuan Wang , Jenna Wiens , Scott Lundberg

Reliability-oriented sensitivity analysis aims at combining both reliability and sensitivity analyses by quantifying the influence of each input variable of a numerical model on a quantity of interest related to its failure. In particular,…

Statistics Theory · Mathematics 2022-10-25 Julien Demange-Chryst , François Bachoc , Jérôme Morio

Deep Neural Networks are widely used in academy as well as corporate and public applications, including safety critical applications such as health care and autonomous driving. The ability to explain their output is critical for safety…

Machine Learning · Computer Science 2024-03-14 Florian Eilers , Xiaoyi Jiang

Machine Learning (ML) is gaining popularity for hypothesis-free discovery of risk and protective factors in healthcare studies. ML is strong at discovering nonlinearities and interactions, but this power is compromised by a lack of reliable…

Machine Learning · Statistics 2026-01-01 Giorgio Spadaccini , Marjolein Fokkema , Mark A. van de Wiel

Top tagging has emerged as a fast-evolving subject due to the top quark's significant role in probing physics beyond the standard model. For the reconstruction of top jets, machine learning models have shown a substantial improvement in the…

High Energy Physics - Phenomenology · Physics 2024-12-30 Biplob Bhattacherjee , Camellia Bose , Amit Chakraborty , Rhitaja Sengupta

Recent work demonstrated the existence of Boolean functions for which Shapley values provide misleading information about the relative importance of features in rule-based explanations. Such misleading information was broadly categorized…

Artificial Intelligence · Computer Science 2024-02-14 Xuanxiang Huang , Joao Marques-Silva

Machine learning models often deteriorate in their performance when they are used to predict the outcomes over data on which they were not trained. These scenarios can often arise in real world when the distribution of data changes…

Machine Learning · Computer Science 2024-01-19 Narayanan U. Edakunni , Utkarsh Tekriwal , Anukriti Jain

Large Language Models (LLMs) are increasingly used in systems that retrieve and summarize content from multiple sources, such as search engines and AI assistants. While these systems enhance user experience through coherent summaries, they…

Computation and Language · Computer Science 2026-01-08 Zikun Ye , Hema Yoganarasimhan

Large language models (LLMs) demonstrate strong capabilities in in-context learning, but verifying the correctness of their generated responses remains a challenge. Prior work has explored attribution at the sentence level, but these…

Computation and Language · Computer Science 2025-07-10 Yingtai Xiao , Yuqing Zhu , Sirat Samyoun , Wanrong Zhang , Jiachen T. Wang , Jian Du

The recent increase in the deployment of machine learning models in critical domains such as healthcare, criminal justice, and finance has highlighted the need for trustworthy methods that can explain these models to stakeholders. Feature…

Machine Learning · Computer Science 2021-10-04 Angeline Yasodhara , Azin Asgarian , Diego Huang , Parinaz Sobhani

Tree-based ensembles such as random forests remain the go-to for tabular data over deep learning models due to their prediction performance and computational efficiency. These advantages have led to their widespread deployment in…

Machine Learning · Computer Science 2026-05-28 Zhongyuan Liang , Zachary T. Rewolinski , Abhineet Agarwal , Tiffany M. Tang , Bin Yu

The main contribution of this paper is the development of a new decision tree algorithm. The proposed approach allows users to guide the algorithm through the data partitioning process. We believe this feature has many applications but in…

Machine Learning · Statistics 2020-10-27 Cédric Beaulac , Jeffrey S. Rosenthal

Workflow mining discovers hierarchical process trees from event logs, but it remains unclear why such models satisfy or violate logical properties, or how individual elements contribute to overall behavior. We propose to translate mined…

Software Engineering · Computer Science 2025-12-11 Radoslaw Klimek , Jakub Blazowski

Shapley values have become increasingly popular in the machine learning literature thanks to their attractive axiomatisation, flexibility, and uniqueness in satisfying certain notions of `fairness'. The flexibility arises from the myriad…

Machine Learning · Statistics 2021-03-09 Daniel Vidali Fryer , Inga Strümke , Hien Nguyen

Shapley values are widely recognized as a principled method for attributing importance to input features in machine learning. However, the exact computation of Shapley values scales exponentially with the number of features, severely…

Machine Learning · Computer Science 2025-08-21 Majid Mohammadi , Krikamol Muandet , Ilaria Tiddi , Annette Ten Teije , Siu Lun Chau

Models often need to be constrained to a certain size for them to be considered interpretable. For example, a decision tree of depth 5 is much easier to understand than one of depth 50. Limiting model size, however, often reduces accuracy.…

Machine Learning · Computer Science 2020-07-02 Abhishek Ghose , Balaraman Ravindran

Because of their strong theoretical properties, Shapley values have become very popular as a way to explain predictions made by black box models. Unfortuately, most existing techniques to compute Shapley values are computationally very…

Machine Learning · Computer Science 2022-08-29 Arne Gevaert , Yvan Saeys

We study instancewise feature importance scoring as a method for model interpretation. Any such method yields, for each predicted instance, a vector of importance scores associated with the feature vector. Methods based on the Shapley score…

Machine Learning · Computer Science 2018-08-09 Jianbo Chen , Le Song , Martin J. Wainwright , Michael I. Jordan

Recently, several fast algorithms have been proposed to decompose predicted value into Shapley values, enabling individualized feature contribution analysis in tree models. While such local decomposition offers valuable insights, it…

Machine Learning · Statistics 2025-05-28 Zhongli Jiang , Min Zhang , Dabao Zhang
‹ Prev 1 8 9 10 Next ›