English
Related papers

Related papers: Riesz Regression As Direct Density Ratio Estimatio…

200 papers

This study considers the estimation of the direct bias-correction term for estimating the average treatment effect (ATE). Let $\{(X_i, D_i, Y_i)\}_{i=1}^{n}$ be the observations, where $X_i$ denotes $K$-dimensional covariates, $D_i \in \{0,…

Econometrics · Economics 2026-02-02 Masahiro Kato

Imputing missing potential outcomes using an estimated regression function is a natural idea for estimating causal effects. In the literature, estimators that combine imputation and regression adjustments are believed to be comparable to…

Statistics Theory · Mathematics 2023-01-20 Zhexiao Lin , Fang Han

We consider a generalization of the classifier-based density-ratio estimation task to a quasiprobabilistic setting where probability densities can be negative. The problem with most loss functions used for this task is that they implicitly…

Machine Learning · Statistics 2025-12-24 Matthew Drnevich , Stephen Jiggins , Kyle Cranmer

Density estimation plays a crucial role in many data analysis tasks, as it infers a continuous probability density function (PDF) from discrete samples. Thus, it is used in tasks as diverse as analyzing population data, spatial locations in…

Machine Learning · Computer Science 2021-07-26 Patrik Puchert , Pedro Hermosilla , Tobias Ritschel , Timo Ropinski

In Regression Discontinuity (RD) design, self-selection leads to different distributions of covariates on two sides of the policy intervention, which essentially violates the continuity of potential outcome assumption. The standard RD…

Methodology · Statistics 2019-11-22 Sida Peng , Yang Ning

We consider inference on a scalar regression coefficient under a constraint on the magnitude of the control coefficients. A class of estimators based on a regularized propensity score regression is shown to exactly solve a tradeoff between…

Econometrics · Economics 2023-08-11 Timothy B. Armstrong , Michal Kolesár , Soonwoo Kwon

Fr\'echet regression generalizes linear regression to metric-space-valued responses by defining fitted values as minimizers of weighted Fr\'echet functionals. Since these weights may have mixed signs, the resulting objective is a signed…

Optimization and Control · Mathematics 2026-05-25 Yamin Zhou , César A. Uribe

We propose a new marginal data density estimator (MDDE) that uses the variational Bayes posterior density as a weighting density of the reciprocal importance sampling (RIS) MDDE. This computationally convenient estimator is based on…

Applications · Statistics 2020-05-12 Gholamreza Hajargasht , Tomasz Woźniak

Deep neural networks have long been criticized for being black-box. To unveil the inner workings of modern neural architectures, a recent work \cite{yu2024white} proposed an information-theoretic objective function called Sparse Rate…

Machine Learning · Computer Science 2024-11-27 Yunzhe Hu , Difan Zou , Dong Xu

The estimation of the ratio of two density probability functions is of great interest in many statistics fields, including causal inference. In this study, we develop an ensemble estimator of density ratios with a novel loss function based…

Machine Learning · Statistics 2024-08-12 Wencheng Wu , David Benkeser

Chemical Exchange Saturation Transfer (CEST) MRI demonstrates its capability in significantly enhancing the detection of proteins and metabolites with low concentrations through exchangeable protons. The clinical application of CEST,…

Image and Video Processing · Electrical Eng. & Systems 2024-07-10 Chu Chen , Yang Liu , Se Weon Park , Jizhou Li , Kannie W. Y. Chan , Raymond H. F. Chan

We present TraDE, a self-attention-based architecture for auto-regressive density estimation with continuous and discrete valued data. Our model is trained using a penalized maximum likelihood objective, which ensures that samples from the…

Machine Learning · Computer Science 2020-10-16 Rasool Fakoor , Pratik Chaudhari , Jonas Mueller , Alexander J. Smola

The statistical convergence is handled for sequences with the natural density, in general. In a recent paper, the statistical convergence for nets in Riesz spaces has been studied and investigated by developing topology-free techniques in…

Functional Analysis · Mathematics 2021-05-28 Fatih Temizsu , Abdullah Aydın

Our investigation concerns the estimation of predictive densities and a study of efficiency as measured by the frequentist risk of such predictive densities with integrated $L_2$ and $L_1$ losses. Our findings relate to a $p-$variate…

Statistics Theory · Mathematics 2014-08-25 Tatsuya Kubokawa , Éric Marchand , William E. Strawderman

Rank-based statistical metrics, such as the invariant statistical loss (ISL), have recently emerged as robust and practically effective tools for training implicit generative models. In this work, we introduce dual-ISL, a novel…

Machine Learning · Computer Science 2025-11-07 José Manuel de Frutos , Manuel A. Vázquez , Pablo M. Olmos , Joaquín Míguez

In a large class of statistical inverse problems it is necessary to suppose that the transformation that is inverted is known. Although, in many applications, it is unrealistic to make this assumption, the problem is often insoluble without…

Statistics Theory · Mathematics 2008-12-18 Aurore Delaigle , Peter Hall , Alexander Meister

A basic principle in the design of observational studies is to approximate the randomized experiment that would have been conducted under controlled circumstances. Now, linear regression models are commonly used to analyze observational…

Methodology · Statistics 2022-07-08 Ambarish Chattopadhyay , Jose R. Zubizarreta

We provide a unified analysis of the predictive risk of ridge regression and regularized discriminant analysis in a dense random effects model. We work in a high-dimensional asymptotic regime where $p, n \to \infty$ and $p/n \to \gamma \in…

Statistics Theory · Mathematics 2015-11-05 Edgar Dobriban , Stefan Wager

This paper studies density estimation and regression analysis with contaminated data observed on the unit hypersphere S^d. Our methodology and theory are based on harmonic analysis on general S^d. We establish novel nonparametric density…

Statistics Theory · Mathematics 2023-01-10 Jeong Min Jeon , Ingrid Van Keilegom

We introduce a novel and scalable Bayesian framework for multivariate-density-density regression (DDR), designed to model relationships between multivariate distributions. Our approach addresses the critical issue of distributions residing…

Methodology · Statistics 2025-09-24 Khai Nguyen , Yang Ni , Peter Mueller