English
Related papers

Related papers: Context-dependent feature analysis with random for…

200 papers

Note that a newer expanded version of this paper is now available at: arXiv:1802.03888 It is critical in many applications to understand what features are important for a model, and why individual predictions were made. For tree ensemble…

Artificial Intelligence · Computer Science 2018-02-20 Scott M. Lundberg , Su-In Lee

This paper introduces a novel supervised classification strategy that integrates functional data analysis (FDA) with tree-based methods, addressing the challenges of high-dimensional data and enhancing the classification performance of…

Machine Learning · Statistics 2024-08-26 Fabrizio Maturo , Annamaria Porreca

A random forest prediction can be computed by the scalar product of the labels of the training examples and a set of weights that are determined by the leafs of the forest into which the test object falls; each prediction can hence be…

Machine Learning · Computer Science 2023-11-27 Henrik Boström

The amount of information in the form of features and variables avail- able to machine learning algorithms is ever increasing. This can lead to classifiers that are prone to overfitting in high dimensions, high di- mensional models do not…

Machine Learning · Computer Science 2014-02-12 Aaron Karper

Machine learning algorithms such as linear regression, SVM and neural network have played an increasingly important role in the process of scientific discovery. However, none of them is both interpretable and accurate on nonlinear datasets.…

Quantitative Methods · Quantitative Biology 2017-10-31 Chengyu Liu , Wei Wang

Additive feature explanations using Shapley values have become popular for providing transparency into the relative importance of each feature to an individual prediction of a machine learning model. While Shapley values provide a unique…

Machine Learning · Computer Science 2021-12-21 Thomas W. Campbell , Heinrich Roder , Robert W. Georgantas , Joanna Roder

Understanding the importance of the inputs on the output is useful across many tasks. This work provides an information-theoretic framework to analyse the influence of inputs for text classification tasks. Natural language processing (NLP)…

Computation and Language · Computer Science 2024-02-05 Luran Wang , Mark Gales , Vatsal Raina

Studying the effects of one-way variation of any number of parameters on any number of output probabilities quickly becomes infeasible in practice, especially if various evidence profiles are to be taken into consideration. To provide for…

Artificial Intelligence · Computer Science 2012-07-09 Silja Renooij , Linda C. van der Gaag

Functional dependencies restrict the potential interactions among variables connected in a probabilistic network. This restriction can be exploited in qualitative probabilistic reasoning by introducing deterministic variables and modifying…

Artificial Intelligence · Computer Science 2013-04-05 Michael P. Wellman

The interpretation of feature importance in machine learning models is challenging when features are dependent. Permutation feature importance (PFI) ignores such dependencies, which can cause misleading interpretations due to extrapolation.…

Machine Learning · Statistics 2023-11-09 Christoph Molnar , Gunnar König , Bernd Bischl , Giuseppe Casalicchio

Random forests have been widely used for their ability to provide so-called importance measures, which give insight at a global (per dataset) level on the relevance of input variables to predict a certain output. On the other hand, methods…

Machine Learning · Statistics 2021-11-04 Antonio Sutera , Gilles Louppe , Van Anh Huynh-Thu , Louis Wehenkel , Pierre Geurts

Interpretable machine learning has emerged as central in leveraging artificial intelligence within high-stakes domains such as healthcare, where understanding the rationale behind model predictions is as critical as achieving high…

Machine Learning · Computer Science 2024-04-30 Christel Sirocchi , Martin Urschler , Bastian Pfeifer

As Artificial Intelligence (AI) is used in more applications, the need to consider and mitigate biases from the learned models has followed. Most works in developing fair learning algorithms focus on the offline setting. However, in many…

Machine Learning · Computer Science 2021-08-24 Wenbin Zhang , Albert Bifet , Xiangliang Zhang , Jeremy C. Weiss , Wolfgang Nejdl

In this paper, we introduce a novel situation aware approach to improve a context based recommender system. To build situation aware user profiles, we rely on evidence issued from retrieval situations. A retrieval situation refers to the…

Information Retrieval · Computer Science 2014-04-01 Djallel Bouneffouf

We explore the factors influencing the dependence of single sentences on their larger textual context in order to automatically identify candidate sentences for language learning exercises from corpora which are presentable in isolation. An…

Computation and Language · Computer Science 2016-05-09 Ildikó Pilán

This paper provides new theory to support to the eXplainable AI (XAI) method Contextual Importance and Utility (CIU). CIU arithmetic is based on the concepts of Multi-Attribute Utility Theory, which gives CIU a solid theoretical foundation.…

Artificial Intelligence · Computer Science 2022-02-16 Kary Främling

A context-aware language model uses location, user and/or domain metadata (context) to adapt its predictions. In neural language models, context information is typically represented as an embedding and it is given to the RNN as an…

Computation and Language · Computer Science 2018-05-08 Aaron Jaech , Mari Ostendorf

Estimating the persuasiveness of messages is critical in various applications, from recommender systems to safety assessment of LLMs. While it is imperative to consider the target persuadee's characteristics, such as their values,…

Computation and Language · Computer Science 2026-04-21 Sejun Park , Yoonah Park , Jongwon Lim , Yohan Jo

Factor copula models for item response data are more interpretable and fit better than (truncated) vine copula models when dependence can be explained through latent variables, but are not robust to violations of conditional independence.…

Methodology · Statistics 2025-01-08 Sayed H. Kadhem , Aristidis K. Nikoloulopoulos

In naturalistic learning problems, a model's input contains a wide range of features, some useful for the task at hand, and others not. Of the useful features, which ones does the model use? Of the task-irrelevant features, which ones does…

Machine Learning · Computer Science 2020-10-26 Katherine L. Hermann , Andrew K. Lampinen