中文
相关论文

相关论文: A Method for Avoiding Bias from Feature Selection …

200 篇论文

We develop a Bayesian framework for variable selection in linear regression with autocorrelated errors, accommodating lagged covariates and autoregressive structures. This setting occurs in time series applications where responses depend on…

统计方法学 · 统计学 2025-08-18 Alokesh Manna , Sujit K. Ghosh

This article focuses on the question of learning how to automatically select a subset of items among a bigger set. We introduce a methodology for the inference of ensembles of discrete values, based on the Naive Bayes assumption. Our…

机器学习 · 计算机科学 2017-07-20 Luca Mossina , Emmanuel Rachelson

Diagnostic datasets that can detect biased models are an important prerequisite for bias reduction within natural language processing. However, undesired patterns in the collected data can make such tests incorrect. For example, if the…

计算与语言 · 计算机科学 2020-12-16 Vid Kocijan , Oana-Maria Camburu , Thomas Lukasiewicz

Gaussian graphical models are used for determining conditional relationships between variables. This is accomplished by identifying off-diagonal elements in the inverse-covariance matrix that are non-zero. When the ratio of variables (p) to…

应用统计 · 统计学 2018-08-07 Donald R. Williams , Juho Piironen , Aki Vehtari , Philippe Rast

Microarrays are made it possible to simultaneously monitor the expression profiles of thousands of genes under various experimental conditions. Identification of co-expressed genes and coherent patterns is the central goal in microarray or…

计算工程、金融与科学 · 计算机科学 2013-07-15 T. Chandrasekhar , K. Thangavel , E. Elayaraja , E. N. Sathishkumar

Predictive modeling is increasingly being employed to assist human decision-makers. One purported advantage of replacing or augmenting human judgment with computer models in high stakes settings-- such as sentencing, hiring, policing,…

应用统计 · 统计学 2017-03-16 James E. Johndrow , Kristian Lum

Subject selection plays a critical role in experimental studies, especially ones with human subjects. Anecdotal evidence suggests that many such studies, done at or near university campus settings suffer from selection bias, i.e., the…

机器学习 · 计算机科学 2020-12-21 Tahereh Arabghalizi , Alexandros Labrinidis

Bias in AI/ML-based systems is a ubiquitous problem and bias in AI/ML systems may negatively impact society. There are many reasons behind a system being biased. The bias can be due to the algorithm we are using for our problem or may be…

计算机视觉与模式识别 · 计算机科学 2024-09-02 Vedant V. Kandge , Siddhant V. Kandge , Kajal Kumbharkar , Tanuja Pattanshetti

We propose a Bayesian variable selection method in the framework of modal regression for heavy-tailed responses. An efficient expectation-maximization algorithm is employed to expedite parameter estimation. A test statistic is constructed…

统计方法学 · 统计学 2025-10-29 Jiasong Duan , Hongmei Zhang , Xianzheng Huang

This paper proposes the use of causal modeling to detect and mitigate algorithmic bias that is nonlinear in the protected attribute. We provide a general overview of our approach. We use the German Credit data set, which is available for…

机器学习 · 计算机科学 2024-05-08 Wendy Hui , Wai Kwong Lau

In many conventional scientific investigations with high or ultra-high dimensional feature spaces, the relevant features, though sparse, are large in number compared with classical statistical problems, and the magnitude of their effects…

统计理论 · 数学 2011-07-14 Shan Luo , Zehua Chen

Astronomers are often confronted with funky populations and distributions of objects: brighter objects are more likely to be detected; targets are selected based on colour cuts; imperfect classification yields impure samples. Failing to…

宇宙学与河外天体物理 · 物理学 2017-06-21 Samuel R. Hinton , Alex Kim , Tamara M. Davis

Recommending items to users is a challenging task due to the large amount of missing information. In many cases, the data solely consist of ratings or tags voluntarily contributed by each user on a very limited subset of the available…

机器学习 · 统计学 2015-10-01 Claire Vernade , Olivier Cappé

This paper presents an efficient Bayesian framework for solving nonlinear, high-dimensional model calibration problems. It is based on a Variational Bayesian formulation that aims at approximating the exact posterior by means of solving an…

应用统计 · 统计学 2015-11-02 Isabell M. Franck , P. S. Koutsourelakis

Bayesian methods - either based on Bayes Factors or BIC - are now widely used for model selection. One property that might reasonably be demanded of any model selection method is that if a model ${M}_{1}$ is preferred to a model ${M}_{0}$,…

统计方法学 · 统计学 2012-08-20 Piotr Zwiernik , Jim Q. Smith

Estimating the causal effect of a treatment or health policy with observational data can be challenging due to an imbalance of and a lack of overlap between treated and control covariate distributions. In the presence of limited overlap,…

统计方法学 · 统计学 2025-03-24 Martha Barnard , Jared D. Huling , Julian Wolfson

A wide range of machine learning algorithms iteratively add data to the training sample. Examples include semi-supervised learning, active learning, multi-armed bandits, and Bayesian optimization. We embed this kind of data addition into…

机器学习 · 统计学 2024-06-25 Julian Rodemann

Genetic risk prediction is an important component of individualized medicine, but prediction accuracies remain low for many complex diseases. A fundamental limitation is the sample sizes of the studies on which the prediction algorithms are…

统计方法学 · 统计学 2017-06-20 Sihai Dave Zhao

Bayesian interpretations of neural processing require that biological mechanisms represent and operate upon probability distributions in accordance with Bayes' theorem. Many have speculated that synaptic failure constitutes a mechanism of…

神经元与认知 · 定量生物学 2022-10-05 Kevin McKee , Ian Crandell , Rishidev Chaudhuri , Randall O'Reilly

A learned generative model often produces biased statistics relative to the underlying data distribution. A standard technique to correct this bias is importance sampling, where samples from the model are weighted by the likelihood ratio…