English
Related papers

Related papers: Achieving Fairness with a Simple Ridge Penalty

200 papers

We propose a theoretical framework for the problem of learning a real-valued function which meets fairness requirements. This framework is built upon the notion of $\alpha$-relative (fairness) improvement of the regression function which we…

Statistics Theory · Mathematics 2022-01-11 Evgenii Chzhen , Nicolas Schreuder

We initiate the study of fairness for ordinal regression. We adapt two fairness notions previously considered in fair ranking and propose a strategy for training a predictor that is approximately fair according to either notion. Our…

The potential lack of fairness in the outputs of machine learning algorithms has recently gained attention both within the research community as well as in society more broadly. Surprisingly, there is no prior work developing tree-induction…

Machine Learning · Statistics 2017-12-25 Edward Raff , Jared Sylvester , Steven Mills

Induction benefits from useful priors. Penalized regression approaches, like ridge regression, shrink weights toward zero but zero association is usually not a sensible prior. Inspired by simple and robust decision heuristics humans use, we…

Machine Learning · Computer Science 2021-10-26 Sebastian Bobadilla-Suarez , Matt Jones , Bradley C. Love

With a focus on linear models with smooth functional covariates, we propose a penalization framework (SACR) based on the nonzero centered ridge, where the center of the penalty is optimally reweighted in a supervised way, starting from the…

Methodology · Statistics 2020-11-03 Edoardo Belli

Fairness-accuracy trade-offs are a central concern in the deployment of fairness-aware machine learning methods. When sensitive attributes are unavailable at inference time-the so called unawareness setting, principled methods for obtaining…

Machine Learning · Statistics 2026-05-28 M. Generali Lince , V. Divol , R. Flamary , S. Gaucher , P. Loiseau

Ensuring fairness in machine learning is a critical and challenging task, as biased data representations often lead to unfair predictions. To address this, we propose Deep Fair Learning, a framework that integrates nonlinear sufficient…

Machine Learning · Statistics 2025-04-10 Enze Shi , Linglong Kong , Bei Jiang

Fairness-aware learning aims to mitigate discrimination against specific protected social groups (e.g., those categorized by gender, ethnicity, age) while minimizing predictive performance loss. Despite efforts to improve fairness in…

Machine Learning · Computer Science 2025-05-02 Kewen Peng , Yicheng Yang , Hao Zhuo

Algorithmic fairness is typically studied from the perspective of predictions. Instead, here we investigate fairness from the perspective of recourse actions suggested to individuals to remedy an unfavourable classification. We propose two…

Machine Learning · Computer Science 2022-03-08 Julius von Kügelgen , Amir-Hossein Karimi , Umang Bhatt , Isabel Valera , Adrian Weller , Bernhard Schölkopf

Decisions are increasingly taken by both humans and machine learning models. However, machine learning models are currently trained for full automation -- they are not aware that some of the decisions may still be taken by humans. In this…

Machine Learning · Computer Science 2021-03-16 Abir De , Nastaran Okati , Paramita Koley , Niloy Ganguly , Manuel Gomez-Rodriguez

High-dimensional prediction with multiple data types needs to account for potentially strong differences in predictive signal. Ridge regression is a simple model for high-dimensional data that has challenged the predictive performance of…

Methodology · Statistics 2021-04-02 Mark A. van de Wiel , Mirrelijn M. van Nee , Armin Rauschenberger

We propose a unified framework for fair regression tasks formulated as risk minimization problems subject to a demographic parity constraint. Unlike many existing approaches that are limited to specific loss functions or rely on challenging…

Methodology · Statistics 2026-01-16 Yongzhen Feng , Weiwei Wang , Raymond K. W. Wong , Xianyang Zhang

Fairness in machine learning has become a critical concern. Existing approaches often focus on achieving full fairness across all score ranges generated by predictive models, ensuring fairness in both high- and low-percentile populations.…

Machine Learning · Computer Science 2026-04-07 Yutian He , Yankun Huang , Yao Yao , Qihang Lin

Penalization schemes like Lasso or ridge regression are routinely used to regress a response of interest on a high-dimensional set of potential predictors. Despite being decisive, the question of the relative strength of penalization is…

Methodology · Statistics 2018-11-08 Britta Velten , Wolfgang Huber

Predictive modeling is increasingly being employed to assist human decision-makers. One purported advantage of replacing human judgment with computer models in high stakes settings-- such as sentencing, hiring, policing, college admissions,…

Machine Learning · Statistics 2016-10-27 Kristian Lum , James Johndrow

This paper tackles the problem of selecting among several linear estimators in non-parametric regression; this includes model selection for linear regression, the choice of a regularization parameter in kernel ridge regression, spline…

Statistics Theory · Mathematics 2011-09-15 Sylvain Arlot , Francis Bach

Random forests remain among the most popular off-the-shelf supervised machine learning tools with a well-established track record of predictive accuracy in both regression and classification settings. Despite their empirical success as well…

Machine Learning · Statistics 2020-09-15 Lucas Mentch , Siyu Zhou

A conventional wisdom in statistical learning is that large models require strong regularization to prevent overfitting. Here we show that this rule can be violated by linear regression in the underdetermined $n\ll p$ situation under…

Statistics Theory · Mathematics 2024-06-06 Dmitry Kobak , Jonathan Lomond , Benoit Sanchez

Machine learning models often inherit biases from historical data, raising critical concerns about fairness and accountability. Conventional fairness interventions typically require access to sensitive attributes like gender or race, but…

Machine Learning · Statistics 2026-04-21 Yixiao Lin , James Booth

Recent work on algorithmic fairness has largely focused on the fairness of discrete decisions, or classifications. While such decisions are often based on risk score models, the fairness of the risk models themselves has received…

Machine Learning · Computer Science 2023-02-24 Eike Petersen , Melanie Ganz , Sune Hannibal Holm , Aasa Feragen