English
Related papers

Related papers: Optimally weighted average derivative effects

200 papers

Model Weight Averaging (MWA) is a technique that seeks to enhance model's performance by averaging the weights of multiple trained models. This paper first empirically finds that 1) the vanilla MWA can benefit the class-imbalanced learning,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Zitong Huang , Ze Chen , Bowen Dong , Chaoqi Liang , Erjin Zhou , Wangmeng Zuo

In causal inference, a fundamental task is to estimate the effect resulting from a specific treatment, which is often handled with inverse probability weighting. Despite an abundance of attention to the advancement of this task, most…

Methodology · Statistics 2025-07-30 Kuan-Hsun Wu

Estimators computed from adaptively collected data do not behave like their non-adaptive brethren. Rather, the sequential dependence of the collection policy can lead to severe distributional biases that persist even in the infinite data…

Machine Learning · Statistics 2020-01-06 Yash Deshpande , Lester Mackey , Vasilis Syrgkanis , Matt Taddy

We propose the Wasserstein Auto-Encoder (WAE)---a new algorithm for building a generative model of the data distribution. WAE minimizes a penalized form of the Wasserstein distance between the model distribution and the target distribution,…

Machine Learning · Statistics 2019-12-06 Ilya Tolstikhin , Olivier Bousquet , Sylvain Gelly , Bernhard Schoelkopf

In this paper I revisit the interpretation of the linear instrumental variables (IV) estimand as a weighted average of conditional local average treatment effects (LATEs). I focus on a situation in which additional covariates are required…

Econometrics · Economics 2026-04-30 Tymon Słoczyński

Quantifying causal effects in the presence of complex and multivariate outcomes remains a key challenge in treatment evaluation. For hierarchical multivariate outcomes, the FDA recommends the Win Ratio and Generalized Pairwise Comparisons…

Methodology · Statistics 2026-03-24 Mathieu Even , Julie Josse

Active learning for regression reduces labeling costs by selecting the most informative samples. Improved Greedy Sampling is a prominent method that balances feature-space diversity and output-space uncertainty using a static,…

Machine Learning · Statistics 2026-03-12 Simon D. Nguyen , Troy Russo , Kentaro Hoffman , Tyler H. McCormick

As an important problem in causal inference, we discuss the identification and estimation of treatment effects (TEs) under limited overlap; that is, when subjects with certain features belong to a single treatment group. We use a latent…

Machine Learning · Statistics 2022-04-22 Pengzhou Wu , Kenji Fukumizu

A new semi-parametric Expected Shortfall (ES) estimation and forecasting framework is proposed. The proposed approach is based on a two-step estimation procedure. The first step involves the estimation of Value-at-Risk (VaR) at different…

Risk Management · Quantitative Finance 2021-03-16 Giuseppe Storti , Chao Wang

The estimation of average treatment effects (ATEs), defined as the difference in expected outcomes between treatment and control groups, is a central topic in causal inference. This study develops semiparametric efficient estimators for ATE…

Machine Learning · Computer Science 2025-05-29 Masahiro Kato , Fumiaki Kozai , Ryo Inokuchi

Personalized medicine aims to tailor treatments to individual patients, especially when people respond heterogeneously to therapies. A key objective is to learn individualized treatment rules that recommend optimal treatments from patient…

Methodology · Statistics 2026-03-12 Zhu Wang

In the multidimensional setting, we consider the errors-in-variables model. We aim at estimating the unknown nonparametric multivariate regression function with errors in the covariates. We devise an adaptive estimator based on projection…

Statistics Theory · Mathematics 2016-01-13 Michaël Chichignoud , Van Ha Hoang , Thanh Mai Pham Ngoc , Vincent Rivoirard

The Neural Autoregressive Distribution Estimator (NADE) and its real-valued version RNADE are competitive density models of multidimensional data across a variety of domains. These models use a fixed, arbitrary ordering of the data…

Machine Learning · Statistics 2014-01-14 Benigno Uria , Iain Murray , Hugo Larochelle

Real-World Data (RWD), with its large sample sizes and rich clinical detail, offers a compelling alternative to randomized controlled trials (RCTs) for studying treatment effects in diverse and complex patient populations. However, its…

Applications · Statistics 2026-05-26 Yifei Xu , Hwiyoung Lee , Zhenyao Ye , Yezhi Pan , Jingsong Zhou , Yun Yang , Chixiang Chen , Shuo Chen

A biomechanical model often requires parameter estimation and selection in a known but complicated nonlinear function. Motivated by observing that data from a head-neck position tracking system, one of biomechanical models, show…

Methodology · Statistics 2024-02-13 Hojun You , Kyubaek Yoon , Wei-Ying Wu , Jongeun Choi , Chae Young Lim

Data-driven reduced-order models based on autoencoders generally lack interpretability compared to classical methods such as the proper orthogonal decomposition. More interpretability can be gained by disentangling the latent variables and…

Machine Learning · Computer Science 2025-02-21 Henning Schwarz , Pyei Phyo Lin , Jens-Peter M. Zemke , Thomas Rung

The Importance Weighted Auto Encoder (IWAE) objective has been shown to improve the training of generative models over the standard Variational Auto Encoder (VAE) objective. Here, we derive importance weighted extensions to AVB and AAE.…

Machine Learning · Computer Science 2019-10-24 Daniel Jiwoong Im , Sridhama Prakhya , Jinyao Yan , Srinivas Turaga , Kristin Branson

It is becoming increasingly common for researchers to consider incorporating external information from large studies to improve the accuracy of statistical inference instead of relying on a modestly sized dataset collected internally. With…

Methodology · Statistics 2021-07-20 Tian Gu , Jeremy M. G. Taylor , Bhramar Mukherjee

Motivated by applications in precision medicine and treatment effect heterogeneity, recent research has focused on estimating conditional average treatment effects (CATEs) using machine learning (ML). CATE estimates may represent…

Methodology · Statistics 2025-12-30 Oliver J. Hines , Karla Diaz-Ordaz , Stijn Vansteelandt

Linear regressions with period and group fixed effects are widely used to estimate treatment effects. We show that they estimate weighted sums of the average treatment effects (ATE) in each group and period, with weights that may be…

Econometrics · Economics 2023-04-18 Clément de Chaisemartin , Xavier D'Haultfœuille