English
Related papers

Related papers: Group conditional validity via multi-group learnin…

200 papers

The field of distribution-free predictive inference provides tools for provably valid prediction without any assumptions on the distribution of the data, which can be paired with any regression algorithm to provide accurate and reliable…

Statistics Theory · Mathematics 2023-01-19 Michael Bian , Rina Foygel Barber

We study supervised learning problems using clustering constraints to impose structure on either features or samples, seeking to help both prediction and interpretation. The problem of clustering features arises naturally in text…

Machine Learning · Computer Science 2016-09-20 Vincent Roulet , Fajwel Fogel , Alexandre d'Aspremont , Francis Bach

The fair-ranking problem, which asks to rank a given set of items to maximize utility subject to group fairness constraints, has received attention in the fairness, information retrieval, and machine learning literature. Recent works,…

Machine Learning · Computer Science 2022-12-01 Anay Mehrotra , Nisheeth K. Vishnoi

Machine learning applications often require calibrated predictions, e.g. a 90\% credible interval should contain the true outcome 90\% of the times. However, typical definitions of calibration only require this to hold on average, and offer…

Machine Learning · Statistics 2020-09-10 Shengjia Zhao , Tengyu Ma , Stefano Ermon

Distributionally robust optimization (DRO) can improve the robustness and fairness of learning methods. In this paper, we devise stochastic algorithms for a class of DRO problems including group DRO, subpopulation fairness, and empirical…

Machine Learning · Computer Science 2025-02-03 Tasuku Soma , Khashayar Gatmiry , Sharut Gupta , Stefanie Jegelka

Representation learning is increasingly employed to generate representations that are predictive across multiple downstream tasks. The development of representation learning algorithms that provide strong fairness guarantees is thus…

Machine Learning · Computer Science 2023-10-25 Yuhong Luo , Austin Hoag , Philip S. Thomas

Variable selection for models including interactions between explanatory variables often needs to obey certain hierarchical constraints. The weak or strong structural hierarchy requires that the existence of an interaction term implies at…

Statistics Theory · Mathematics 2016-11-10 Yiyuan She , Zhifeng Wang , He Jiang

Conformal Prediction methods have finite-sample distribution-free marginal coverage guarantees. However, they generally do not offer conditional coverage guarantees, which can be important for high-stakes decisions. In this paper, we…

Machine Learning · Statistics 2024-09-27 Ruijiang Gao , Mingzhang Yin , James McInerney , Nathan Kallus

Deploying trustworthy AI systems requires principled uncertainty quantification. Conformal prediction (CP) is a widely used framework for constructing prediction sets with distribution-free coverage guarantees. In many practical settings,…

Machine Learning · Computer Science 2026-03-18 Haifeng Wen , Osvaldo Simeone , Hong Xing

We consider semi-supervised binary classification for applications in which data points are naturally grouped (e.g., survey responses grouped by state) and the labeled data is biased (e.g., survey respondents are not representative of the…

Machine Learning · Statistics 2022-12-08 Daniel Zeiberg , Shantanu Jain , Predrag Radivojac

We develop a new approach to multi-label conformal prediction in which we aim to output a precise set of promising prediction candidates with a bounded number of incorrect answers. Standard conformal prediction provides the ability to adapt…

Machine Learning · Computer Science 2022-02-16 Adam Fisch , Tal Schuster , Tommi Jaakkola , Regina Barzilay

We study the problem of multivariate regression where the data are naturally grouped, and a regression matrix is to be estimated for each group. We propose an approach in which a dictionary of low rank parameter matrices is estimated across…

Machine Learning · Computer Science 2012-07-03 Min Xu , John Lafferty

Social and real-world considerations such as robustness, fairness, social welfare and multi-agent tradeoffs have given rise to multi-distribution learning paradigms, such as collaborative learning, group distributionally robust…

Machine Learning · Computer Science 2024-04-04 Nika Haghtalab , Michael I. Jordan , Eric Zhao

Algorithmic fairness plays an increasingly critical role in machine learning research. Several group fairness notions and algorithms have been proposed. However, the fairness guarantee of existing fair classification methods mainly depends…

Machine Learning · Statistics 2025-03-13 Puheng Li , James Zou , Linjun Zhang

Machine learning classification tasks often benefit from predicting a set of possible labels with confidence scores to capture uncertainty. However, existing methods struggle with the high-dimensional nature of the data and the lack of…

Machine Learning · Computer Science 2024-07-08 Rui Luo , Zhixin Zhou

Multi-group learning is a learning task that focuses on controlling predictors' conditional losses over specified subgroups. We propose ShakyPrepend, a method that leverages tools inspired by differential privacy to obtain improved…

Machine Learning · Computer Science 2026-03-10 Lujing Zhang , Daniel Hsu , Sivaraman Balakrishnan

Many existing fairness criteria for machine learning involve equalizing some metric across protected groups such as race or gender. However, practitioners trying to audit or enforce such group-based criteria can easily face the problem of…

Machine Learning · Computer Science 2020-11-11 Serena Wang , Wenshuo Guo , Harikrishna Narasimhan , Andrew Cotter , Maya Gupta , Michael I. Jordan

We consider the problem of distribution-free predictive inference, with the goal of producing predictive coverage guarantees that hold conditionally rather than marginally. Existing methods such as conformal prediction offer marginal…

Statistics Theory · Mathematics 2020-04-16 Rina Foygel Barber , Emmanuel J. Candès , Aaditya Ramdas , Ryan J. Tibshirani

Conformal prediction methods are statistical tools designed to quantify uncertainty and generate predictive sets with guaranteed coverage probabilities. This work introduces an innovative refinement to these methods for classification…

Machine Learning · Statistics 2025-12-04 Jean-Baptiste Fermanian , Mohamed Hebiri , Joseph Salmon

Conformal prediction is a popular technique for constructing prediction intervals with distribution-free coverage guarantees. The coverage is marginal, meaning it only holds on average over the entire population but not necessarily for any…

Methodology · Statistics 2026-05-28 Yao Zhang , Emmanuel J. Candès