English
Related papers

Related papers: Unleashing Linear Optimizers for Group-Fair Learni…

200 papers

Machine learning methods often assume that the test data have the same distribution as the training data. However, this assumption may not hold due to multiple levels of heterogeneity in applications, raising issues in algorithmic fairness…

Machine Learning · Statistics 2024-04-03 Sai Li , Linjun Zhang

This material provides thorough tutorials on some optimization techniques frequently used in various engineering disciplines, including convex optimization, linearization techniques and mixed-integer linear programming, robust optimization,…

Optimization and Control · Mathematics 2020-07-28 Wei Wei

Virtually all machine learning tasks are characterized using some form of loss function, and "good performance" is typically stated in terms of a sufficiently small average loss, taken over the random draw of test data. While optimizing for…

Machine Learning · Statistics 2023-12-01 Matthew J. Holland , Kazuki Tanabe

We design and analyze minimax-optimal algorithms for online linear optimization games where the player's choice is unconstrained. The player strives to minimize regret, the difference between his loss and the loss of a post-hoc benchmark…

Machine Learning · Computer Science 2013-02-12 H. Brendan McMahan

Systematic discriminatory biases present in our society influence the way data is collected and stored, the way variables are defined, and the way scientific findings are put into practice as policy. Automated decision procedures and…

Machine Learning · Computer Science 2019-05-29 Razieh Nabi , Daniel Malinsky , Ilya Shpitser

In recent years fairness in machine learning (ML) has emerged as a highly active area of research and development. Most define fairness in simple terms, where fairness means reducing gaps in performance or outcomes between demographic…

Artificial Intelligence · Computer Science 2023-03-14 Brent Mittelstadt , Sandra Wachter , Chris Russell

Group fairness is achieved by equalising prediction distributions between protected sub-populations; individual fairness requires treating similar individuals alike. These two objectives, however, are incompatible when a scoring model is…

Machine Learning · Computer Science 2024-04-22 Edward A. Small , Kacper Sokol , Daniel Manning , Flora D. Salim , Jeffrey Chan

Ensuring fairness in matching algorithms is a key challenge in allocating scarce resources and positions. Focusing on Optimal Transport (OT), we introduce a novel notion of group fairness requiring that the probability of matching two…

Machine Learning · Statistics 2026-02-02 Linus Bleistein , Mathieu Dagréou , Francisco Andrade , Thomas Boudou , Aurélien Bellet

Majorization-minimization schemes are a broad class of iterative methods targeting general optimization problems, including nonconvex, nonsmooth and stochastic. These algorithms minimize successively a sequence of upper bounds of the…

Optimization and Control · Mathematics 2024-01-11 Daniela Lupu , Ion Necoara

We revisit the foundations of fairness and its interplay with utility and efficiency in settings where the training data contain richer labels, such as individual types, rankings, or risk estimates, rather than just binary outcomes. In this…

Machine Learning · Computer Science 2025-05-23 Noga Amit , Omer Reingold , Guy N. Rothblum

Algorithms are now regularly used to decide whether defendants awaiting trial are too dangerous to be released back into the community. In some cases, black defendants are substantially more likely than white defendants to be incorrectly…

Computers and Society · Computer Science 2017-06-13 Sam Corbett-Davies , Emma Pierson , Avi Feller , Sharad Goel , Aziz Huq

Linear optimization is many times algorithmically simpler than non-linear convex optimization. Linear optimization over matroid polytopes, matching polytopes and path polytopes are example of problems for which we have simple and efficient…

Machine Learning · Computer Science 2015-08-17 Dan Garber , Elad Hazan

To attain the best learning accuracy, people move on with difficulties and frustrations. Though one can optimize the empirical objective using a given set of samples, its generalization ability to the entire sample distribution remains…

Machine Learning · Computer Science 2010-12-21 Zeyuan Allen Zhu

An algorithm which computes a solution of a set optimization problem is provided. The graph of the objective map is assumed to be given by finitely many linear inequalities. A solution is understood to be a set of points in the domain…

Optimization and Control · Mathematics 2014-05-29 Andreas Löhne , Carola Schrage

The problem of optimizing a linear objective function,given a number of linear constraints has been a long standing problem ever since the times of Kantorovich, Dantzig and von Neuman. These developments have been followed by a different…

Numerical Analysis · Computer Science 2013-03-21 K. Eswaran

We propose a new framework that unifies different fairness measures into a general, parameterized class of convex fairness measures suitable for optimization contexts. First, we propose a new class of order-based fairness measures, discuss…

Optimization and Control · Mathematics 2025-01-30 Man Yiu Tsang , Karmel S. Shehadeh

Linear superiorization considers linear programming problems but instead of attempting to solve them with linear optimization methods it employs perturbation resilient feasibility-seeking algorithms and steers them toward reduced (not…

Optimization and Control · Mathematics 2017-04-05 Yair Censor

Learning to learn has emerged as an important direction for achieving artificial intelligence. Two of the primary barriers to its adoption are an inability to scale to larger problems and a limited ability to generalize to new tasks. We…

Learned Optimizers (LOs), a type of Meta-learning, have gained traction due to their ability to be parameterized and trained for efficient optimization. Traditional gradient-based methods incorporate explicit regularization techniques such…

Machine Learning · Computer Science 2025-10-13 Suraj Kumar Sahoo , Narayanan C Krishnan

It is widely recognized in modern machine learning practice that access to a diverse set of tasks can enhance performance across those tasks. This observation suggests that, unlike in general multi-objective optimization, the objectives in…

Machine Learning · Computer Science 2025-09-09 Ben Kretzu , Karen Ullrich , Yonathan Efroni