English
Related papers

Related papers: Context-dependent feature analysis with random for…

200 papers

Feature selection is a critical step in high-dimensional classification tasks, particularly under challenging conditions of double imbalance, namely settings characterized by both class imbalance in the response variable and dimensional…

Methodology · Statistics 2025-06-13 Fabio Demaria

Information seeking is an interactive behaviour of the end users with information systems, which occurs in a real environment known as context. Context affects information-seeking behaviour in many different ways. The purpose of this paper…

Information Retrieval · Computer Science 2018-05-18 Shahram Sedghi , Zeinab Shourmeij , Iman Tahamtan

It is becoming increasingly important for machine learning methods to make predictions that are interpretable as well as accurate. In many practical applications, it is of interest which features and feature interactions are relevant to the…

Machine Learning · Statistics 2016-02-09 Viktoriya Krakovna , Jiong Du , Jun S. Liu

Context matters! Nevertheless, there has not been much research in exploiting contextual information in deep neural networks. For most part, the entire usage of contextual information has been limited to recurrent neural networks. Attention…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Ismail Elezi

Object ranking is an important problem in the realm of preference learning. On the basis of training data in the form of a set of rankings of objects, which are typically represented as feature vectors, the goal is to learn a ranking…

Machine Learning · Statistics 2018-12-07 Karlson Pfannschmidt , Pritha Gupta , Eyke Hüllermeier

Personalized news recommendation aims to provide attractive articles for readers by predicting their likelihood of clicking on a certain article. To accurately predict this probability, plenty of studies have been proposed that actively…

Information Retrieval · Computer Science 2021-12-30 Sungmin Cho , Hongjun Lim , Keunchan Park , Sungjoo Yoo , Eunhyeok Park

We develop Clustered Random Forests, a random forests algorithm for clustered data, arising from independent groups that exhibit within-cluster dependence. The leaf-wise predictions for each decision tree making up clustered random forests…

Methodology · Statistics 2026-01-26 Elliot H. Young , Peter Bühlmann

Tree ensemble methods such as random forests [Breiman, 2001] are very popular to handle high-dimensional tabular data sets, notably because of their good predictive accuracy. However, when machine learning is used for decision-making…

Statistics Theory · Mathematics 2021-12-28 Erwan Scornet

We propose a modification that corrects for split-improvement variable importance measures in Random Forests and other tree-based methods. These methods have been shown to be biased towards increasing the importance of features with more…

Machine Learning · Statistics 2020-03-25 Zhengze Zhou , Giles Hooker

Explaining why the species lives at a particular location is important for understanding ecological systems and conserving biodiversity. However, existing ecological workflows are fragmented and often inaccessible to non-specialists. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Yutong Zhou , Masahiro Ryo

We introduce a new notion, that of a contextuality profile of a system of random variables. Rather than characterizing a system's contextuality by a single number, its overall degree of contextuality, we show how it can be characterized by…

Quantum Physics · Physics 2026-05-04 Ehtibar N. Dzhafarov , Victor H. Cervantes

In high dimensional analysis, effects of explanatory variables on responses sometimes rely on certain exposure variables, such as time or environmental factors. In this paper, to characterize the importance of each predictor, we utilize its…

Methodology · Statistics 2018-04-11 Yeqing Zhou , Jingyuan Liu , Zhihui Hao , Liping Zhu

In data analysis, latent variables play a central role because they help provide powerful insights into a wide variety of phenomena, ranging from biological to human sciences. The latent tree model, a particular type of probabilistic…

Machine Learning · Computer Science 2014-02-05 Raphaël Mourad , Christine Sinoquet , Nevin L. Zhang , Tengfei Liu , Philippe Leray

Feature attribution is often loosely presented as the process of selecting a subset of relevant features as a rationale of a prediction. Task-dependent by nature, precise definitions of "relevance" encountered in the literature are however…

Machine Learning · Computer Science 2021-07-12 Darius Afchar , Romain Hennequin , Vincent Guigue

Choice functions accept a set of alternatives as input and produce a preferred subset of these alternatives as output. We study the problem of learning such functions under conditions of context-dependence of preferences, which means that…

Machine Learning · Computer Science 2021-10-25 Karlson Pfannschmidt , Pritha Gupta , Björn Haddenhorst , Eyke Hüllermeier

In surveys, the interest lies in estimating finite population parameters such as population totals and means. In most surveys, some auxiliary information is available at the estimation stage. This information may be incorporated in the…

Methodology · Statistics 2022-08-23 Mehdi Dagdoug , Camelia Goga , David Haziza

Have you ever wondered how your feature space is impacting the prediction of a specific sample in your dataset? In this paper, we introduce Single Sample Feature Importance (SSFI), which is an interpretable feature importance algorithm that…

Machine Learning · Computer Science 2019-11-28 Joseph Gatto , Ravi Lanka , Yumi Iwashita , Adrian Stoica

Addressing selection bias in latent variable causal discovery is important yet underexplored, largely due to a lack of suitable statistical tools: While various tools beyond basic conditional independencies have been developed to handle…

Machine Learning · Computer Science 2025-12-15 Haoyue Dai , Yiwen Qiu , Ignavier Ng , Xinshuai Dong , Peter Spirtes , Kun Zhang

Deep forest is a non-differentiable deep model which has achieved impressive empirical success across a wide variety of applications, especially on categorical/symbolic or mixed modeling tasks. Many of the application fields prefer…

Machine Learning · Computer Science 2023-05-02 Yi-Xiao He , Shen-Huan Lyu , Yuan Jiang

This paper describes how to analyze the influence of Earth system variables on the errors when providing temperature forecasts. The initial framework to get the data has been based on previous research work, which resulted in a very…

Machine Learning · Computer Science 2024-03-14 M. Julia Flores , Melissa Ruiz-Vásquez , Ana Bastos , René Orth