English
Related papers

Related papers: Achieving Fairness with a Simple Ridge Penalty

200 papers

Given a discriminating neural network, the problem of fairness improvement is to systematically reduce discrimination without significantly scarifies its performance (i.e., accuracy). Multiple categories of fairness improving methods have…

Machine Learning · Computer Science 2022-09-16 Mengdi Zhang , Jun Sun

For high-dimensional linear regression models, we review and compare several estimators of variances $\tau^2$ and $\sigma^2$ of the random slopes and errors, respectively. These variances relate directly to ridge regression penalty…

Computation · Statistics 2019-02-08 Jurre R. Veerman , Gwenael G. R. Leday , Mark A. van de Wiel

We consider the estimation of regression models on strata defined using a categorical covariate, in order to identify interactions between this categorical covariate and the other predictors. A basic approach requires the choice of a…

Statistics Theory · Mathematics 2016-11-09 Edouard Ollier , Vivian Viallon

Fairness of classification and regression has received much attention recently and various, partially non-compatible, criteria have been proposed. The fairness criteria can be enforced for a given classifier or, alternatively, the data can…

Machine Learning · Statistics 2019-11-18 Drago Plečko , Nicolai Meinshausen

Any decision, such as one about who to hire, involves two components. First, a rational component, i.e., they have a good education, they speak clearly. Second, an affective component, based on observables such as visual features of race…

Computers and Society · Computer Science 2022-05-03 Jesse Hoey , Gabrielle Chan

Many popular piecewise regression models rely on minimizing a cost function on the model fit with a linear penalty on the number of segments. However, this penalty does not take into account varying complexities of the model functions on…

Methodology · Statistics 2025-03-06 Stefan Volz , Martin Storath , Andreas Weinmann

Recent regulatory proposals for artificial intelligence emphasize fairness requirements for machine learning models. However, precisely defining the appropriate measure of fairness is challenging due to philosophical, cultural and political…

Artificial Intelligence · Computer Science 2026-02-19 Caleb J. S. Barr , Olivia Erdelyi , Paul D. Docherty , Randolph C. Grace

Linear regression models have been extensively considered in the literature. However, in some practical applications they may not be appropriate all over the range of the covariate. In this paper, a more flexible model is introduced by…

Statistics Theory · Mathematics 2023-12-19 Graciela Boente , Florencia Leonardi , Daniela Rodriguez , Mariela Sued

Machine learning is used to make decisions for individuals in various fields, which require us to achieve good prediction accuracy while ensuring fairness with respect to sensitive features (e.g., race and gender). This problem, however,…

Machine Learning · Computer Science 2021-03-01 Yoichi Chikahara , Shinsaku Sakaue , Akinori Fujino , Hisashi Kashima

We introduce an innovative approach to enhancing the empirical risk minimization (ERM) process in model training through a refined reweighting scheme of the training data to enhance fairness. This scheme aims to uphold the sufficiency rule…

Machine Learning · Computer Science 2024-10-02 Xuan Zhao , Klaus Broelemann , Salvatore Ruggieri , Gjergji Kasneci

Understanding socio-academic and economic factors influencing students' performance is crucial for effective educational interventions. This study employs several machine learning techniques and causal analysis to predict and elucidate the…

Machine Learning · Computer Science 2025-06-17 Md. Biplob Hosen , Sabbir Ahmed , Bushra Akter , Mehrin Anannya

We introduce a discriminative regression approach to supervised classification in this paper. It estimates a representation model while accounting for discriminativeness between classes, thereby enabling accurate derivation of categorical…

Machine Learning · Computer Science 2020-01-01 Chong Peng , Qiang Cheng

A supervised machine learning algorithm determines a model from a learning sample that will be used to predict new observations. To this end, it aggregates individual characteristics of the observations of the learning sample. But this…

Econometrics · Economics 2022-02-21 Samuele Centorrino , Jean-Pierre Florens , Jean-Michel Loubes

When using machine learning to aid decision-making, it is critical to ensure that an algorithmic decision is fair and does not discriminate against specific individuals/groups, particularly those from underprivileged populations. Existing…

Machine Learning · Computer Science 2024-11-20 Yifei Wang , Zhengyang Zhou , Liqin Wang , John Laurentiev , Peter Hou , Li Zhou , Pengyu Hong

Machine learning models have achieved widespread success but often inherit and amplify historical biases, resulting in unfair outcomes. Traditional fairness methods typically impose constraints at the prediction level, without addressing…

Machine Learning · Statistics 2026-02-10 Enze Shi , Pankaj Bhagwat , Zhixian Yang , Linglong Kong , Bei Jiang

The vast majority of techniques to train fair models require access to the protected attribute (e.g., race, gender), either at train time or in production. However, in many important applications this protected attribute is largely…

Machine Learning · Computer Science 2023-10-04 Hadi Elzayn , Emily Black , Patrick Vossler , Nathanael Jo , Jacob Goldin , Daniel E. Ho

Kernel ridge regression, KRR, is a generalization of linear ridge regression that is non-linear in the data, but linear in the model parameters. Here, we introduce an equivalent formulation of the objective function of KRR, which opens up…

Machine Learning · Statistics 2025-03-10 Oskar Allerbo

We present a systematic approach for achieving fairness in a binary classification setting. While we focus on two well-known quantitative definitions of fairness, our approach encompasses many other previously studied definitions as special…

Machine Learning · Computer Science 2018-07-17 Alekh Agarwal , Alina Beygelzimer , Miroslav Dudík , John Langford , Hanna Wallach

Fairness in artificial intelligence (AI) prediction models is increasingly emphasized to support responsible adoption in high-stakes domains such as health care and criminal justice. Guidelines and implementation frameworks highlight the…

Machine Learning · Computer Science 2025-04-14 Yilin Ning , Yian Ma , Mingxuan Liu , Xin Li , Nan Liu

As AI systems develop in complexity it is becoming increasingly hard to ensure non-discrimination on the basis of protected attributes such as gender, age, and race. Many recent methods have been developed for dealing with this issue as…

Machine Learning · Computer Science 2020-04-21 Yair Horesh , Noa Haas , Elhanan Mishraky , Yehezkel S. Resheff , Shir Meir Lador