English
Related papers

Related papers: Inference Functions for Semiparametric Models

200 papers

This paper discusses a nonparametric regression model that naturally generalizes neural network models. The model is based on a finite number of one-dimensional transformations and can be estimated with a one-dimensional rate of…

Statistics Theory · Mathematics 2008-12-18 Joel L. Horowitz , Enno Mammen

Probabilistic programming has emerged as a powerful paradigm in statistics, applied science, and machine learning: by decoupling modelling from inference, it promises to allow modellers to directly reason about the processes generating…

Machine Learning · Statistics 2019-06-10 Maria I. Gorinova , Dave Moore , Matthew D. Hoffman

Statistics is sometimes described as the science of reasoning under uncertainty. Statistical models provide one view of this uncertainty, but what is frequently neglected is the 'invisible' portion of uncertainty: that assumed not to exist…

Methodology · Statistics 2026-03-18 Oliver L. Pescott , Robin J. Boyd , Gary D. Powney , Gavin B. Stewart

We develop a model-free theory of general types of parametric regression for iid observations. The theory replaces the parameters of parametric models with statistical functionals, to be called "regression functionals'', defined on large…

Statistics Theory · Mathematics 2019-07-09 Andreas Buja , Lawrence Brown , Arun Kumar Kuchibhotla , Richard Berk , Ed George , Linda Zhao

We explore a method of statistical estimation called Maximum Entropy on the Mean (MEM) which is based on an information-driven criterion that quantifies the compliance of a given point with a reference prior probability measure. At the core…

Statistics Theory · Mathematics 2022-12-20 Yakov Vaisbourd , Rustum Choksi , Ariel Goodwin , Tim Hoheisel , Carola-Bibiane Schönlieb

Information divergence functions play a critical role in statistics and information theory. In this paper we show that a non-parametric f-divergence measure can be used to provide improved bounds on the minimum binary classification…

Information Theory · Computer Science 2015-02-11 Visar Berisha , Alan Wisler , Alfred O. Hero , Andreas Spanias

This paper develops semiparametric methods for estimation and inference of widely used inequality measures when survey data are subject to nonignorable nonresponse, a challenging setting in which response probabilities depend on the…

Econometrics · Economics 2026-01-16 Xinyu Wang , Chunlin Wang , Tao Yu , Pengfei Li

The framework of Inferential Models (IMs) has recently been developed in search of what is referred to as the holy grail of statistical theory, that is, prior-free probabilistic inference. Its method of Conditional IMs (CIMs) is a critical…

Statistics Theory · Mathematics 2023-01-13 Rongrong Zhang , Michael Y. Zhu , Chuanhai Liu

We propose a likelihood ratio based inferential framework for high dimensional semiparametric generalized linear models. This framework addresses a variety of challenging problems in high dimensional data analysis, including incomplete…

Machine Learning · Statistics 2015-11-24 Yang Ning , Tianqi Zhao , Han Liu

This paper presents a simple yet efficient method for statistical inference of tensor linear forms using incomplete and noisy observations. Under the Tucker low-rank tensor model and the missing-at-random assumption, we utilize an…

Statistics Theory · Mathematics 2024-11-04 Wanteng Ma , Dong Xia

We propose a framework for computing, optimizing and integrating with respect to a smooth marginal likelihood in statistical models that involve high-dimensional parameters/latent variables and continuous low-dimensional hyperparameters.…

Methodology · Statistics 2026-02-10 Omiros Papaspiliopoulos , Timothée Stumpf-Fétizon , Jonathan Weare

Asymptotic statistical theory for estimating functions is reviewed in a generality suitable for stochastic processes. Conditions concerning existence of a consistent estimator, uniqueness, rate of convergence, and the asymptotic…

Statistics Theory · Mathematics 2018-09-06 Jean Jacod , Michael Sørensen

Covariate-adaptive randomization (CAR) procedures are frequently used in comparative studies to increase the covariate balance across treatment groups. However, because randomization inevitably uses the covariate information when forming…

Statistics Theory · Mathematics 2022-07-08 Wei Ma , Yichen Qin , Yang Li , Feifang Hu

Influence functions (IF) have been seen as a technique for explaining model predictions through the lens of the training data. Their utility is assumed to be in identifying training examples "responsible" for a prediction so that, for…

Machine Learning · Computer Science 2023-05-29 Andrea Schioppa , Katja Filippova , Ivan Titov , Polina Zablotskaia

We consider identification and inference about mean functionals of observed covariates and an outcome variable subject to nonignorable missingness. By leveraging a shadow variable, we establish a necessary and sufficient condition for…

Statistics Theory · Mathematics 2022-04-07 Wei Li , Wang Miao , Eric Tchetgen Tchetgen

We study the semiparametric efficient estimation of a class of linear functionals in settings where a complete multivariate dataset is supplemented by additional datasets recording subsets of the variables of interest. These datasets are…

Statistics Theory · Mathematics 2025-06-19 Thomas B. Berrett

When a parameter of interest is defined to be a nondifferentiable transform of a regular parameter, the parameter does not have an influence function, rendering the existing theory of semiparametric efficient estimation inapplicable.…

Statistics Theory · Mathematics 2022-01-06 Kyungchul Song

We present a general principle for estimating a regression function nonparametrically, allowing for a wide variety of data filtering, for example, repeated left truncation and right censoring. Both the mean and the median regression cases…

Statistics Theory · Mathematics 2011-02-10 Oliver Linton , Enno Mammen , Jens Perch Nielsen , Ingrid Van Keilegom

We consider a time series model involving a fractional stochastic component, whose integration order can lie in the stationary/invertible or nonstationary regions and be unknown, and an additive deterministic component consisting of a…

Statistics Theory · Mathematics 2007-06-13 P. M. Robinson

Belief functions are a powerful and popular framework for the mathematical characterisation of uncertainty, in particular in situations in which lack of data renders learning a probability distribution for the problem impractical. The first…

Statistics Theory · Mathematics 2026-05-11 Fabio Cuzzolin