中文
相关论文

相关论文: A Method for Avoiding Bias from Feature Selection …

200 篇论文

We study fairness in supervised few-shot meta-learning models that are sensitive to discrimination (or bias) in historical data. A machine learning model trained based on biased data tends to make unfair predictions for users from minority…

机器学习 · 计算机科学 2020-09-25 Chen Zhao , Feng Chen

Variable selection for structured covariates lying on an underlying known graph is a problem motivated by practical applications, and has been a topic of increasing interest. However, most of the existing methods may not be scalable to high…

统计方法学 · 统计学 2016-04-27 Changgee Chang , Suprateek Kundu , Qi Long

This paper proposes the use of causal modeling to detect and mitigate algorithmic bias. We provide a brief description of causal modeling and a general overview of our approach. We then use the Adult dataset, which is available for download…

机器学习 · 计算机科学 2023-11-10 Wendy Hui , Wai Kwong Lau

High-throughput genetic and epigenetic data are often screened for associations with an observed phenotype. For example, one may wish to test hundreds of thousands of genetic variants, or DNA methylation sites, for an association with…

统计方法学 · 统计学 2017-10-20 Eric F. Lock , David B. Dunson

Naive Bayes estimator is widely used in text classification problems. However, it doesn't perform well with small-size training dataset. We propose a new method based on Naive Bayes estimator to solve this problem. A correlation factor is…

信息检索 · 计算机科学 2019-05-16 Jiangning Chen , Zhibo Dai , Juntao Duan , Heinrich Matzinger , Ionel Popescu

Feature selection represents a measure to reduce the complexity of high-dimensional datasets and gain insights into the systematic variation in the data. This aspect is of specific importance in domains that rely on model interpretability,…

机器学习 · 计算机科学 2022-09-07 Anna Jenul , Stefan Schrunner , Jürgen Pilz , Oliver Tomic

Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on…

机器学习 · 计算机科学 2022-04-05 Seonguk Seo , Joon-Young Lee , Bohyung Han

Nested error regression models are useful tools for analysis of grouped data, especially in the case of small area estimation. This paper suggests a nested error regression model using uncertain random effects in which the random effect in…

统计方法学 · 统计学 2017-02-28 Shonosuke Sugasawa , Tatsuya Kubokawa

Many analyses require linking records from two databases comprising overlapping sets of individuals. In the absence of unique identifiers, the linkage procedure often involves matching on a set of categorical variables, such as…

应用统计 · 统计学 2017-06-12 Nicole M. Dalzell , Jerome P. Reiter

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

机器学习 · 计算机科学 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

Approximate Bayesian inference on the basis of summary statistics is well-suited to complex problems for which the likelihood is either mathematically or computationally intractable. However the methods that use rejection suffer from the…

统计计算 · 统计学 2010-05-04 M. G. B. Blum , O. Francois

$n$-gram profiles have been successfully and widely used to analyse long sequences of potentially differing lengths for clustering or classification. Mainly, machine learning algorithms have been used for this purpose but, despite their…

统计方法学 · 统计学 2024-09-04 José A. Perusquía , Jim E. Griffin , Cristiano Villa

For the vast majority of genome wide association studies (GWAS) published so far, statistical analysis was performed by testing markers individually. In this article we present some elementary statistical considerations which clearly show…

应用统计 · 统计学 2010-10-04 Florian Frommlet , Felix Ruhaltinger , Piotr Twarog , Malgorzata Bogdan

Simplicity bias is the concerning tendency of deep networks to over-depend on simple, weakly predictive features, to the exclusion of stronger, more complex features. This is exacerbated in real-world applications by limited training data…

机器学习 · 计算机科学 2023-06-07 Rishabh Tiwari , Pradeep Shenoy

External controls from historical trials or observational data can augment randomized controlled trials when large-scale randomization is impractical or unethical, such as in drug evaluation for rare diseases. However, non-randomized…

统计方法学 · 统计学 2025-05-08 Ke Zhu , Shu Yang , Xiaofei Wang

As an alternative to variable selection or shrinkage in high dimensional regression, we propose to randomly compress the predictors prior to analysis. This dramatically reduces storage and computational bottlenecks, performing well when the…

机器学习 · 统计学 2013-03-26 Rajarshi Guhaniyogi , David B. Dunson

In the Naive Bayes classification model the class conditional densities are estimated as the products of their marginal densities along the cardinal basis directions. We study the problem of obtaining an alternative basis for this…

机器学习 · 统计学 2025-08-19 David P. Hofmeyr , Francois Kamper , Michail C. Melonas

Feature selection (FS) is assumed to improve predictive performance and identify meaningful features in high-dimensional datasets. Surprisingly, small random subsets of features (0.02-1%) match or outperform the predictive performance of…

机器学习 · 计算机科学 2025-09-22 Bhavesh Neekhra , Debayan Gupta , Partha Pratim Chakrabarti

Discovering statistically significant patterns from databases is an important challenging problem. The main obstacle of this problem is in the difficulty of taking into account the selection bias, i.e., the bias arising from the fact that…

机器学习 · 统计学 2016-03-10 Shinya Suzumura , Kazuya Nakagawa , Mahito Sugiyama , Koji Tsuda , Ichiro Takeuchi

This paper considers multiple binary hypothesis tests with adaptive allocation of sensing resources from a shared budget over a small number of stages. A Bayesian formulation is provided for the multistage allocation problem of minimizing…

统计方法学 · 统计学 2014-11-05 Dennis Wei