English
Related papers

Related papers: Fundamental Limits and Tradeoffs in Invariant Repr…

200 papers

As financial institutions increasingly rely on machine learning models to automate lending decisions, concerns about algorithmic fairness have risen. This paper explores the tradeoff between enforcing fairness constraints (such as…

Computers and Society · Computer Science 2025-06-05 Aayam Bansal

Multi-objective optimization (MOO) problems require balancing competing objectives, often under constraints. The Pareto optimal solution set defines all possible optimal trade-offs over such objectives. In this work, we present a novel…

Machine Learning · Computer Science 2022-04-19 Soumyajit Gupta , Gurpreet Singh , Raghu Bollapragada , Matthew Lease

Algorithm designers increasingly optimize not only for accuracy, but also for the fairness of the algorithm across pre-defined groups. We study the tradeoff between fairness and accuracy for any given set of inputs to the algorithm. We…

Theoretical Economics · Economics 2024-05-10 Annie Liang , Jay Lu , Xiaosheng Mu , Kyohei Okumura

Improving the fairness of machine learning models is a nuanced task that requires decision makers to reason about multiple, conflicting criteria. The majority of fair machine learning methods transform the error-fairness trade-off into a…

Neural and Evolutionary Computing · Computer Science 2023-04-25 William G. La Cava

We provide a general framework for characterizing the trade-off between accuracy and robustness in supervised learning. We propose a method and define quantities to characterize the trade-off between accuracy and robustness for a given…

Machine Learning · Computer Science 2025-05-26 Zhun Deng , Cynthia Dwork , Jialiang Wang , Yao Zhao

By searching for shared inductive biases across tasks, meta-learning promises to accelerate learning on novel tasks, but with the cost of solving a complex bilevel optimization problem. We introduce and rigorously define the trade-off…

Machine Learning · Computer Science 2021-04-15 Katelyn Gao , Ozan Sener

Estimating treatment effects from observational data is challenging due to two main reasons: (a) hidden confounding, and (b) covariate mismatch (control and treatment groups not having identical distributions). Long lines of works exist…

Machine Learning · Computer Science 2025-04-30 Praharsh Nanavati , Ranjitha Prasad , Karthikeyan Shanmugam

Individualized treatment rules (ITRs) have gained significant attention due to their wide-ranging applications in fields such as precision medicine, ridesharing, and advertising recommendations. However, when ITRs are influenced by…

Machine Learning · Statistics 2025-08-01 Wenhai Cui , Xiaoting Ji , Wen Su , Xiaodong Yan , Xingqiu Zhao

Federated learning (FL) has gain growing interests for its capability of learning from distributed data sources collectively without the need of accessing the raw data samples across different sources. So far FL research has mostly focused…

Machine Learning · Computer Science 2021-10-22 Sen Cui , Weishen Pan , Jian Liang , Changshui Zhang , Fei Wang

This paper investigates to what degree and magnitude tradeoffs exist between utility, fairness and attribute privacy in computer vision. Regarding privacy, we look at this important problem specifically in the context of attribute inference…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 William Paul , Philip Mathew , Fady Alajaji , Philippe Burlina

Privacy-preserving data analysis is a rising challenge in contemporary statistics, as the privacy guarantees of statistical methods are often achieved at the expense of accuracy. In this paper, we investigate the tradeoff between…

Machine Learning · Statistics 2020-11-11 T. Tony Cai , Yichen Wang , Linjun Zhang

Fairness-accuracy trade-offs are a central concern in the deployment of fairness-aware machine learning methods. When sensitive attributes are unavailable at inference time-the so called unawareness setting, principled methods for obtaining…

Machine Learning · Statistics 2026-05-28 M. Generali Lince , V. Divol , R. Flamary , S. Gaucher , P. Loiseau

We consider a variant of online convex optimization in which both the instances (input vectors) and the comparator (weight vector) are unconstrained. We exploit a natural scale invariance symmetry in our unconstrained setting: the…

Machine Learning · Computer Science 2017-08-24 Wojciech Kotłowski

Data augmentation is one of the most widely used techniques to improve generalization in modern machine learning, often justified by its ability to promote invariance to label-irrelevant transformations. However, its theoretical role…

Machine Learning · Computer Science 2026-02-17 Abdelali Bouyahia , Frédéric LeBlanc , Mario Marchand

Deep models, while being extremely versatile and accurate, are vulnerable to adversarial attacks: slight perturbations that are imperceptible to humans can completely flip the prediction of deep models. Many attack and defense mechanisms…

Machine Learning · Computer Science 2019-07-30 Kaiwen Wu , Yaoliang Yu

A crucial aspect in reliable machine learning is to design a deployable system in generalizing new related but unobserved environments. Domain generalization aims to alleviate such a prediction gap between the observed and unseen…

Machine Learning · Computer Science 2021-06-01 Changjian Shui , Boyu Wang , Christian Gagné

Differential privacy is a strong notion for privacy that can be used to prove formal guarantees, in terms of a privacy budget, $\epsilon$, about how much information is leaked by a mechanism. However, implementations of privacy-preserving…

Machine Learning · Computer Science 2019-08-14 Bargav Jayaraman , David Evans

The i.i.d. assumption is a useful idealization that underpins many successful approaches to supervised machine learning. However, its violation can lead to models that learn to exploit spurious correlations in the training data, rendering…

Machine Learning · Computer Science 2020-06-15 Daniel Pace , Alessandra Russo , Murray Shanahan

As they have a vital effect on social decision-making, AI algorithms should be not only accurate but also fair. Among various algorithms for fairness AI, learning fair representation (LFR), whose goal is to find a fair representation with…

Machine Learning · Statistics 2023-01-12 Dongha Kim , Kunwoong Kim , Insung Kong , Ilsang Ohn , Yongdai Kim

A key value proposition of machine learning is generalizability: the same methods and model architecture should be able to work across different domains and different contexts. While powerful, this generalization can sometimes go too far,…

Computers and Society · Computer Science 2025-09-25 Angelina Wang