English
Related papers

Related papers: RieszNet and ForestRiesz: Automatic Debiased Machi…

200 papers

Biased attributes, spuriously correlated with target labels in a dataset, can problematically lead to neural networks that learn improper shortcuts for classifications and limit their capabilities for out-of-distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jinyung Hong , Eun Som Jeon , Changhoon Kim , Keun Hee Park , Utkarsh Nath , Yezhou Yang , Pavan Turaga , Theodore P. Pavlic

Why do reinforcement learning (RL) policies fail or succeed? This is a challenging question due to the complex, high-dimensional nature of agent-environment interactions. In this work, we take a causal perspective on explaining the behavior…

Machine Learning · Statistics 2025-07-22 Armin Kekić , Jan Schneider , Dieter Büchler , Bernhard Schölkopf , Michel Besserve

Many scientific and engineering challenges -- ranging from personalized medicine to customized marketing recommendations -- require an understanding of treatment effect heterogeneity. In this paper, we develop a non-parametric causal forest…

Methodology · Statistics 2017-07-11 Stefan Wager , Susan Athey

In machine learning and statistical modeling, the mean square or absolute error is commonly used as an error metric, also called a "loss function." While effective in reducing the average error, this approach may fail to address localized…

Optimization and Control · Mathematics 2025-09-10 John M. Hanna , Hugues Talbot , Irene E. Vignon-Clementel

Combining matching and regression for causal inference provides double-robustness in removing treatment effect estimation bias due to confounding variables. In most real-world applications, however, treatment and control populations are not…

Methodology · Statistics 2015-07-14 Alireza S. Mahani , Mansour T. A. Sharabiani

Many classification tasks involve imbalanced data, in which a class is largely underrepresented. Several techniques consists in creating a rebalanced dataset on which a classifier is trained. In this paper, we study theoretically such a…

Machine Learning · Statistics 2025-06-11 Moria Mayala , Erwan Scornet , Charles Tillier , Olivier Wintenberger

In this paper, we demonstrate the application of generalised rational uniform (Chebyshev) approximation in neural networks. In particular, our activation functions are one degree rational functions and the loss function is based on the…

Optimization and Control · Mathematics 2021-11-05 Vinesha Peiris

The potential lack of fairness in the outputs of machine learning algorithms has recently gained attention both within the research community as well as in society more broadly. Surprisingly, there is no prior work developing tree-induction…

Machine Learning · Statistics 2017-12-25 Edward Raff , Jared Sylvester , Steven Mills

This paper proposes a new algorithm for learning accurate tree-based models while ensuring the existence of recourse actions. Algorithmic Recourse (AR) aims to provide a recourse action for altering the undesired prediction result given by…

Machine Learning · Computer Science 2024-06-04 Kentaro Kanamori , Takuya Takagi , Ken Kobayashi , Yuichi Ike

Natural language understanding (NLU) models often suffer from unintended dataset biases. Among bias mitigation methods, ensemble-based debiasing methods, especially product-of-experts (PoE), have stood out for their impressive empirical…

Computation and Language · Computer Science 2023-05-30 Fei Wang , James Y. Huang , Tianyi Yan , Wenxuan Zhou , Muhao Chen

Linear regression is effective at identifying interpretable trends in a data set, but averages out potentially different effects on subgroups within data. We propose an iterative algorithm based on the randomized Kaczmarz (RK) method to…

Numerical Analysis · Mathematics 2022-12-09 Erin George , Yotam Yaniv , Deanna Needell

Understanding biases and stereotypes encoded in the weights of Large Language Models (LLMs) is crucial for developing effective mitigation strategies. However, biased behaviour is often subtle and non-trivial to isolate, even when…

Computation and Language · Computer Science 2026-02-03 Sekh Mainul Islam , Nadav Borenstein , Siddhesh Milind Pawar , Haeun Yu , Arnav Arora , Isabelle Augenstein

Fairness is a central pillar of trustworthy machine learning, especially in domains where accuracy- or profit-driven optimization is insufficient. While most fairness research focuses on supervised learning, fairness in policy learning…

Machine Learning · Statistics 2026-02-11 Zeyu Bian , Lan Wang , Chengchun Shi , Zhengling Qi

We present a psychoacoustically enhanced cost function to balance network complexity and perceptual performance of deep neural networks for speech denoising. While training the network, we utilize perceptual weights added to the ordinary…

Sound · Computer Science 2018-01-31 Kai Zhen , Aswin Sivaraman , Jongmo Sung , Minje Kim

Causal mediation analysis can unpack the black box of causality and is therefore a powerful tool for disentangling causal pathways in biomedical and social sciences, and also for evaluating machine learning fairness. To reduce bias for…

Machine Learning · Statistics 2022-12-27 Siqi Xu , Lin Liu , Zhonghua Liu

We propose an approach to reduce the bias of ridge regression and regularization kernel network. When applied to a single data set the new algorithms have comparable learning performance with the original ones. When applied to incremental…

Machine Learning · Statistics 2016-03-17 Qiang Wu

Metric learning makes it plausible to learn distances for complex distributions of data from labeled data. However, to date, most metric learning methods are based on a single Mahalanobis metric, which cannot handle heterogeneous data well.…

Machine Learning · Statistics 2012-01-04 Caiming Xiong , David Johnson , Ran Xu , Jason J. Corso

Recently, recommender system (RS) based on causal inference has gained much attention in the industrial community, as well as the states of the art performance in many prediction and debiasing tasks. Nevertheless, a unified causal analysis…

Information Retrieval · Computer Science 2022-05-19 Peng Wu , Haoxuan Li , Yuhao Deng , Wenjie Hu , Quanyu Dai , Zhenhua Dong , Jie Sun , Rui Zhang , Xiao-Hua Zhou

Feed-forward neural networks can be understood as a combination of an intermediate representation and a linear hypothesis. While most previous works aim to diversify the representations, we explore the complementary direction by performing…

Machine Learning · Computer Science 2019-10-24 Han Zhao , Yao-Hung Hubert Tsai , Ruslan Salakhutdinov , Geoffrey J. Gordon

In this paper, we introduce a unified framework, inspired by classical regularization theory, for designing and analyzing a broad class of linear regression approaches. Our framework encompasses traditional methods like least squares…

Statistics Theory · Mathematics 2025-03-04 Ying-Ao Wang , Yunyi Zhang , Ye Zhang