English
Related papers

Related papers: ScoreMatchingRiesz: Score Matching for Debiased Ma…

200 papers

Score-based divergences have been widely used in machine learning and statistics applications. Despite their empirical success, a blindness problem has been observed when using these for multi-modal distributions. In this work, we discuss…

Machine Learning · Statistics 2025-11-25 Mingtian Zhang , Oscar Key , Peter Hayes , David Barber , Brooks Paige , François-Xavier Briol

We propose a regression-based approach to removing implicit biases in representations. On tasks where the protected attribute is observed, the method is statistically more efficient than known approaches. Further, we show that this approach…

Computers and Society · Computer Science 2018-07-03 Amanda Bower , Laura Niss , Yuekai Sun , Alexander Vargo

Boosting as gradient descent algorithms is one popular method in machine learning. In this paper a novel Boosting-type algorithm is proposed based on restricted gradient descent with structural sparsity control whose underlying dynamics are…

Machine Learning · Statistics 2017-04-18 Chendi Huang , Xinwei Sun , Jiechao Xiong , Yuan Yao

The model implied by factor score predictors does not reproduce the non-diagonal elements of the observed covariance matrix as well as the factor loadings. It is therefore investigated whether it is possible to estimate factor loadings for…

Applications · Statistics 2019-09-26 André Beauducel , Norbert Hilger

Causal mediation analysis has been extended to estimate path-specific effects with multiple intermediate variables, isolating treatment effects through a mediator of interest while excluding pathways through its ancestors. Such analyses…

Methodology · Statistics 2026-05-12 Yang Bai , Sihan Wu , Baoluo Sun , Yifan Cui

Explainable AI aims to render model behavior understandable by humans, which can be seen as an intermediate step in extracting causal relations from correlative patterns. Due to the high risk of possible fatal decisions in image-based…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Lukas Klein , João B. S. Carvalho , Mennatallah El-Assady , Paolo Penna , Joachim M. Buhmann , Paul F. Jaeger

While real-world decisions involve many competing objectives, algorithmic decisions are often evaluated with a single objective function. In this paper, we study algorithmic policies which explicitly trade off between a private objective…

Machine Learning · Computer Science 2020-07-17 Esther Rolf , Max Simchowitz , Sarah Dean , Lydia T. Liu , Daniel Björkegren , Moritz Hardt , Joshua Blumenstock

We consider the problem of statistical inference for a class of partially-observed diffusion processes, with discretely-observed data and finite-dimensional parameters. We construct unbiased estimators of the score function, i.e. the…

Methodology · Statistics 2021-05-12 Jeremy Heng , Jeremie Houssineau , Ajay Jasra

The discovery of discriminatory bias in human or automated decision making is a task of increasing importance and difficulty, exacerbated by the pervasive use of machine learning and data mining. Currently, discrimination discovery largely…

Computers and Society · Computer Science 2019-11-05 Bilal Qureshi , Faisal Kamiran , Asim Karim , Salvatore Ruggieri , Dino Pedreschi

Gradient-based dimension reduction decreases the cost of Bayesian inference and probabilistic modeling by identifying maximally informative (and informed) low-dimensional projections of the data and parameters, allowing high-dimensional…

Computation · Statistics 2025-06-02 Ricardo Baptista , Michael Brennan , Youssef Marzouk

Evaluation of treatment effects and more general estimands is typically achieved via parametric modelling, which is unsatisfactory since model misspecification is likely. Data-adaptive model building (e.g. statistical/machine learning) is…

Statistics Theory · Mathematics 2022-01-14 Oliver Hines , Oliver Dukes , Karla Diaz-Ordaz , Stijn Vansteelandt

Principal stratification is a framework for making sense of causal effects conditioned on variables that may themselves have been affected by the treatment. For instance, in an evaluation of an educational intervention, some subjects in the…

Methodology · Statistics 2026-05-05 Adam C. Sales , Kirk P. Vanacore , Erin R. Ottmar

Modern machine learning datasets can have biases for certain representations that are leveraged by algorithms to achieve high performance without learning to solve the underlying task. This problem is referred to as "representation bias".…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Yi Li , Nuno Vasconcelos

Causal machine learning methods which flexibly generate heterogeneous treatment effect estimates could be very useful tools for governments trying to make and implement policy. However, as the critical artificial intelligence literature has…

Econometrics · Economics 2023-09-06 Patrick Rehill , Nicholas Biddle

Score-based diffusion models provide a powerful way to model images using the gradient of the data distribution. Leveraging the learned score function as a prior, here we introduce a way to sample data from a conditional distribution given…

Image and Video Processing · Electrical Eng. & Systems 2022-07-19 Hyungjin Chung , Jong Chul Ye

This paper presents an integrated framework for estimation and inference from generalized linear models using adjusted score equations that result in mean and median bias reduction. The framework unifies theoretical and methodological…

Methodology · Statistics 2019-01-15 Ioannis Kosmidis , Euloge Clovis Kenne Pagui , Nicola Sartori

When using machine learning to aid decision-making, it is critical to ensure that an algorithmic decision is fair and does not discriminate against specific individuals/groups, particularly those from underprivileged populations. Existing…

Machine Learning · Computer Science 2024-11-20 Yifei Wang , Zhengyang Zhou , Liqin Wang , John Laurentiev , Peter Hou , Li Zhou , Pengyu Hong

Language-model agents increasingly emit uncertainty signals throughout a trajectory, but existing agentic UQ evaluations often conflate ranking usefulness with probabilistic truthfulness. AUROC, AUPRC, risk-coverage, Trajectory ECE, and…

Artificial Intelligence · Computer Science 2026-05-26 Suresh Raghu , Satwik Pandey , Shashwat Pandey

Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on…

Machine Learning · Computer Science 2022-04-05 Seonguk Seo , Joon-Young Lee , Bohyung Han

Imbalanced data commonly exists in real world, espacially in sentiment-related corpus, making it difficult to train a classifier to distinguish latent sentiment in text data. We observe that humans often express transitional emotion between…

Computation and Language · Computer Science 2019-03-29 Tao Zhang , Xing Wu , Meng Lin , Jizhong Han , Songlin Hu