English
Related papers

Related papers: Individually Fair Gradient Boosting

200 papers

Recent advances in the literature have demonstrated that standard supervised learning algorithms are ill-suited for problems with endogenous explanatory variables. To correct for the endogeneity bias, many variants of nonparameteric…

Econometrics · Economics 2021-01-18 Edvard Bakhitov , Amandeep Singh

Clustering algorithms may unintentionally propagate or intensify existing disparities, leading to unfair representations or biased decision-making. Current fair clustering methods rely on notions of fairness that do not capture any…

Machine Learning · Statistics 2023-12-15 Fritz Bayer , Drago Plecko , Niko Beerenwinkel , Jack Kuipers

Multi-layered representation is believed to be the key ingredient of deep neural networks especially in cognitive tasks like computer vision. While non-differentiable models such as gradient boosting decision trees (GBDTs) are the dominant…

Machine Learning · Computer Science 2020-07-07 Ji Feng , Yang Yu , Zhi-Hua Zhou

Statistical learning methods for automated variable selection, such as the Least Absolute Shrinkage and Selection Operator (LASSO), elastic nets, and gradient boosting, have become increasingly popular tools for building powerful prediction…

Machine Learning · Statistics 2026-04-13 Robert Kuchen

Machine learning systems are notoriously prone to biased predictions about certain demographic groups, leading to algorithmic fairness issues. Due to privacy concerns and data quality problems, some demographic information may not be…

Machine Learning · Computer Science 2024-12-31 Yingtao Luo , Zhixun Li , Qiang Liu , Jun Zhu

We present nonparametric algorithms for estimating optimal individualized treatment rules. The proposed algorithms are based on the XGBoost algorithm, which is known as one of the most powerful algorithms in the machine learning literature.…

Machine Learning · Statistics 2020-02-04 Duzhe Wang , Haoda Fu , Po-Ling Loh

Training ML models which are fair across different demographic groups is of critical importance due to the increased integration of ML in crucial decision-making scenarios such as healthcare and recruitment. Federated learning has been…

Machine Learning · Computer Science 2022-11-28 Yahya H. Ezzeldin , Shen Yan , Chaoyang He , Emilio Ferrara , Salman Avestimehr

The use of machine learning (ML) in high-stakes societal decisions has encouraged the consideration of fairness throughout the ML lifecycle. Although data integration is one of the primary steps to generate high quality training data, most…

Machine Learning · Computer Science 2022-04-01 Sainyam Galhotra , Karthikeyan Shanmugam , Prasanna Sattigeri , Kush R. Varshney

We develop an algorithm to train individually fair learning-to-rank (LTR) models. The proposed approach ensures items from minority groups appear alongside similar items from majority groups. This notion of fair ranking is based on the…

Machine Learning · Statistics 2021-03-23 Amanda Bower , Hamid Eftekhari , Mikhail Yurochkin , Yuekai Sun

Gradient-based methods enable efficient search capabilities in high dimensions. However, in order to apply them effectively in offline optimization paradigms such as offline Reinforcement Learning (RL) or Imitation Learning (IL), we require…

Machine Learning · Computer Science 2023-10-18 H. J. Terry Suh , Glen Chou , Hongkai Dai , Lujie Yang , Abhishek Gupta , Russ Tedrake

Algorithmic fairness has become an important machine learning problem, especially for mission-critical Web applications. This work presents a self-supervised model, called DualFair, that can debias sensitive attributes like gender and race…

Machine Learning · Computer Science 2023-03-16 Sungwon Han , Seungeon Lee , Fangzhao Wu , Sundong Kim , Chuhan Wu , Xiting Wang , Xing Xie , Meeyoung Cha

Gradient Boosting Decision Trees (GBDTs) dominate tabular machine learning, with modern implementations like XGBoost, LightGBM, and CatBoost being based on Newton boosting: a second-order descent step in the space of decision trees. Despite…

Machine Learning · Statistics 2026-05-04 Nikita Zozoulenko , Daniel Falkowski , Thomas Cass , Lukas Gonon

In this paper we analyze boosting algorithms in linear regression from a new perspective: that of modern first-order methods in convex optimization. We show that classic boosting algorithms in linear regression, namely the incremental…

Statistics Theory · Mathematics 2015-05-19 Robert M. Freund , Paul Grigas , Rahul Mazumder

No methods currently exist for making arbitrary neural networks fair. In this work we introduce GRAD, a new and simplified method to producing fair neural networks that can be used for auto-encoding fair representations or directly with…

Machine Learning · Statistics 2018-07-03 Edward Raff , Jared Sylvester

Computers are increasingly used to make decisions that have significant impact in people's lives. Often, these predictions can affect different population subgroups disproportionately. As a result, the issue of fairness has received much…

This paper investigates the privacy-preserving distributed optimization problem, aiming to protect agents' private information from potential attackers during the optimization process. Gradient tracking, an advanced technique for improving…

Machine Learning · Computer Science 2025-09-24 Furan Xie , Bing Liu , Li Chai

The issue of fairness in machine learning models has recently attracted a lot of attention as ensuring it will ensure continued confidence of the general public in the deployment of machine learning systems. We focus on mitigating the harm…

Machine Learning · Statistics 2021-02-24 Thomas Kehrenberg , Zexun Chen , Novi Quadrianto

In this paper we tackle the problem of point and probabilistic forecasting by describing a blending methodology of machine learning models that belong to gradient boosted trees and neural networks families. These principles were…

Machine Learning · Computer Science 2023-10-23 Ioannis Nasios , Konstantinos Vogklis

Fairness in both Machine Learning (ML) predictions and human decision-making is essential, yet both are susceptible to different forms of bias, such as algorithmic and data-driven in ML, and cognitive or subjective in humans. In this study,…

Computation and Language · Computer Science 2025-08-28 Junhua Liu , Roy Ka-Wei Lee , Kwan Hui Lim

Equity of educational outcome and fairness of AI with respect to race have been topics of increasing importance in education. In this work, we address both with empirical evaluations of grade prediction in higher education, an important…

Computers and Society · Computer Science 2021-05-17 Weijie Jiang , Zachary A. Pardos