中文
相关论文

相关论文: A Method for Avoiding Bias from Feature Selection …

200 篇论文

Regression models are used in a wide range of applications providing a powerful scientific tool for researchers from different fields. Linear, or simple parametric, models are often not sufficient to describe complex relationships between…

机器学习 · 统计学 2021-11-24 Aliaksandr Hubin , Geir Storvik , Florian Frommlet

Constant (naive) imputation is still widely used in practice as this is a first easy-to-use technique to deal with missing data. Yet, this simple method could be expected to induce a large bias for prediction purposes, as the imputed input…

统计理论 · 数学 2024-02-07 Alexis Ayme , Claire Boyer , Aymeric Dieuleveut , Erwan Scornet

A new empirical Bayes approach to variable selection in the context of generalized linear models is developed. The proposed algorithm scales to situations in which the number of putative explanatory variables is very large, possibly much…

统计方法学 · 统计学 2021-06-29 Haim Bar , James Booth , Martin T. Wells

We evaluated whether model explanations could efficiently detect bias in image classification by highlighting discriminating features, thereby removing the reliance on sensitive attributes for fairness calculations. To this end, we…

计算机视觉与模式识别 · 计算机科学 2020-12-11 Schrasing Tong , Lalana Kagal

There is increasing interest in the use of diagnostic rules based on microarray data. These rules are formed by considering the expression levels of thousands of genes in tissue samples taken on patients of known classification with respect…

统计理论 · 数学 2008-12-18 G. J. McLachlan , J. Chevelu , J. Zhu

As a consequence of the strong and usually violated conditional independence assumption (CIA) of naive Bayes (NB) classifier, the performance of NB becomes less and less favorable compared to sophisticated classifiers when the sample size…

机器学习 · 统计学 2014-12-23 Kim-Hung Li , Cheuk Ting Li

Suppose that the only available information in a multi-class problem are expert estimates of the conditional probabilities of occurrence for a set of binary features. The aim is to select a subset of features to be measured in subsequent…

人工智能 · 计算机科学 2012-07-19 Ludmila Kuncheva , C. Whitaker , P. Cockcroft , Z. S. Hoare

Bayesian linear mixed-effects models and Bayesian ANOVA are increasingly being used in the cognitive sciences to perform null hypothesis tests, where a null hypothesis that an effect is zero is compared with an alternative hypothesis that…

统计方法学 · 统计学 2023-08-15 Daniel J. Schad , Bruno Nicenboim , Shravan Vasishth

The original formulation of BEAMS - Bayesian Estimation Applied to Multiple Species - showed how to use a dataset contaminated by points of multiple underlying types to perform unbiased parameter estimation. An example is cosmological…

天体物理仪器与方法 · 物理学 2016-03-02 James Newling , Bruce. A. Bassett , Renée Hlozek , Martin Kunz , Mathew Smith , Melvin Varughese

Feature selection, identifying a subset of variables that are relevant for predicting a response, is an important and challenging component of many methods in statistics and machine learning. Feature selection is especially difficult and…

定量方法 · 定量生物学 2014-08-01 Charles K. Fisher , Pankaj Mehta

Bayesian variable selection is a powerful tool for data analysis, as it offers a principled method for variable selection that accounts for prior information and uncertainty. However, wider adoption of Bayesian variable selection has been…

统计方法学 · 统计学 2023-12-06 Martin Jankowiak

We propose a fast and theoretically grounded method for Bayesian variable selection and model averaging in latent variable regression models. Our framework addresses three interrelated challenges: (i) intractable marginal likelihoods, (ii)…

统计方法学 · 统计学 2025-09-16 Gregor Zens , Mark F. J. Steel

We provide a flexible framework for selecting among a class of additive partial linear models that allows both linear and nonlinear additive components. In practice, it is challenging to determine which additive components should be…

统计方法学 · 统计学 2021-09-20 Seonghyun Jeong , Taeyoung Park , David A. van Dyk

A set of probabilistic predictions is well calibrated if the events that are predicted to occur with probability p do in fact occur about p fraction of the time. Well calibrated predictions are particularly important when machine learning…

机器学习 · 统计学 2014-01-14 Mahdi Pakdaman Naeini , Gregory F. Cooper , Milos Hauskrecht

Presence of bias (in datasets or tasks) is inarguably one of the most critical challenges in machine learning applications that has alluded to pivotal debates in recent years. Such challenges range from spurious associations between…

计算机视觉与模式识别 · 计算机科学 2020-11-23 Ehsan Adeli , Qingyu Zhao , Adolf Pfefferbaum , Edith V. Sullivan , Li Fei-Fei , Juan Carlos Niebles , Kilian M. Pohl

Parameter estimates for associated genetic variants, report ed in the initial discovery samples, are often grossly inflated compared to the values observed in the follow-up replication samples. This type of bias is a consequence of the…

应用统计 · 统计学 2011-04-15 Lizhen Xu , Radu V. Craiu , Lei Sun

Refining one's hypotheses in the light of data is a common scientific practice; however, the dependency on the data introduces selection bias and can lead to specious statistical analysis. An approach for addressing this is via conditioning…

Subset selection is a valuable tool for interpretable learning, scientific discovery, and data compression. However, classical subset selection is often avoided due to selection instability, lack of regularization, and difficulties with…

机器学习 · 统计学 2022-02-17 Daniel R. Kowal

Selecting a small set of informative features from a large number of possibly noisy candidates is a challenging problem with many applications in machine learning and approximate Bayesian computation. In practice, the cost of computing…

统计方法学 · 统计学 2022-09-05 Louis Raynal , Till Hoffmann , Jukka-Pekka Onnela

In this paper, we study the accuracy of values aggregated over classes predicted by a classification algorithm. The problem is that the resulting aggregates (e.g., sums of a variable) are known to be biased. The bias can be large even for…

机器学习 · 统计学 2019-12-02 Q. A. Meertens , C. G. H. Diks , H. J. van den Herik , F W Takes