English
Related papers

Related papers: Claim Reserving via Inverse Probability Weighting:…

200 papers

When estimating a regression model, we might have data where some labels are missing, or our data might be biased by a selection mechanism. When the response or selection mechanism is ignorable (i.e., independent of the response variable…

Statistics Theory · Mathematics 2023-08-22 Philip Boeken , Noud de Kroon , Mathijs de Jong , Joris M. Mooij , Onno Zoeter

In this paper, I try to tame "Basu's elephants" (data with extreme selection on observables). I propose new practical large-sample and finite-sample methods for estimating and inferring heterogeneous causal effects (under unconfoundedness)…

Econometrics · Economics 2023-01-20 Ganesh Karapakula

Traditional techniques for calculating outstanding claim liabilities such as the chain ladder are notoriously at risk of being distorted by outliers in past claims data. Unfortunately, the literature in robust methods of reserving is scant,…

Methodology · Statistics 2023-09-04 Benjamin Avanzi , Mark Lavender , Greg Taylor , Bernard Wong

In this work, we present a new random sampling method for data streams where the probability of an element's inclusion in the sample is proportional to a weight associated with that element. Our method is based on sampling with replacement,…

Data Structures and Algorithms · Computer Science 2026-03-18 Adriano Meligrana , Adriano Fazzone

We investigate the issue of parameter estimation with nonuniform negative sampling for imbalanced data. We first prove that, with imbalanced data, the available information about unknown parameters is only tied to the relatively small…

Machine Learning · Statistics 2021-10-26 HaiYing Wang , Aonan Zhang , Chong Wang

This paper develops an updatable inverse probability weighting (UIPW) estimation for the generalized linear models with response missing at random in streaming data sets. A two-step online updating algorithm is provided for the proposed…

Statistics Theory · Mathematics 2023-10-10 Xianhua Zhang , Lu lin , Qihua Wang

The trace of a matrix function f(A), most notably of the matrix inverse, can be estimated stochastically using samples< x,f(A)x> if the components of the random vectors x obey an appropriate probability distribution. However such a…

Numerical Analysis · Mathematics 2021-08-26 Andreas Frommer , Mostafa Nasr Khalil , Gustavo Ramirez-Hidalgo

Respondent-driven sampling (RDS) is an approach to sampling design and analysis which utilizes the networks of social relationships that connect members of the target population, using chain-referral methods to facilitate sampling. RDS…

Methodology · Statistics 2015-08-19 Yakir Berchenko , Jonathan Rosenblatt , Simon D. W. Frost

The paper describes a new class of capture-recapture models for closed populations when individual covariates are available. The novelty consists in combining a latent class model for the distribution of the capture history, where the class…

Methodology · Statistics 2021-11-08 Antonio Forcina , Francesco Bartolucci

Estimating consumer preferences is central to many problems in economics and marketing. This paper develops a flexible framework for learning individual preferences from partial ranking information by interpreting observed rankings as…

Machine Learning · Statistics 2026-02-19 Yu-Chang Chen , Chen Chian Fuh , Shang En Tsai

Eliciting preferences from human judgements is inherently imprecise, yet most decision analysis methods force a single priority vector from pairwise comparisons, discarding the information embedded in inconsistencies. We instead leverage…

General Economics · Economics 2026-02-27 Salvatore Greco , Sajid Siraj , Michele Lundy

Variational Autoencoders are powerful models for unsupervised learning. However deep models with several layers of dependent stochastic variables are difficult to train which limits the improvements obtained using these highly expressive…

Machine Learning · Statistics 2016-05-30 Casper Kaae Sønderby , Tapani Raiko , Lars Maaløe , Søren Kaae Sønderby , Ole Winther

Deep learning systems are prone to catastrophic forgetting when learning from a sequence of tasks, as old data from previous tasks is unavailable when learning a new task. To address this, some methods propose replaying data from previous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chenyang Wang , Junjun Jiang , Xingyu Hu , Xianming Liu , Xiangyang Ji

We consider a setting where an agent's uncertainty is represented by a set of probability measures, rather than a single measure. Measure-bymeasure updating of such a set of measures upon acquiring new information is well-known to suffer…

Computer Science and Game Theory · Computer Science 2013-02-26 Joseph Y. Halpern , Samantha Leung

Uncertainty quantification for full-waveform inversion provides a probabilistic characterization of the ill-conditioning of the problem, comprising the sensitivity of the solution with respect to the starting model and data noise. This…

Geophysics · Physics 2020-04-20 Gabrio Rizzuti , Ali Siahkoohi , Philipp A. Witte , Felix J. Herrmann

We consider a setting where an agent's uncertainty is represented by a set of probability measures, rather than a single measure. Measure-by-measure updating of such a set of measures upon acquiring new information is well-known to suffer…

Computer Science and Game Theory · Computer Science 2016-11-04 Joseph Y. Halpern , Samantha Leung

Weighting methods in causal inference have been widely used to achieve a desirable level of covariate balancing. However, the existing weighting methods have desirable theoretical properties only when a certain model, either the propensity…

Machine Learning · Statistics 2023-05-24 Insung Kong , Yuha Park , Joonhyuk Jung , Kwonsang Lee , Yongdai Kim

Inverse Probability Weighting (IPW) is widely used in empirical work in economics and other disciplines. As Gaussian approximations perform poorly in the presence of "small denominators," trimming is routinely employed as a regularization…

Econometrics · Economics 2019-05-28 Xinwei Ma , Jingshen Wang

Finite mixtures of regressions with fixed covariates are a commonly used model-based clustering methodology to deal with regression data. However, they assume assignment independence, i.e. the allocation of data points to the clusters is…

Methodology · Statistics 2021-04-27 Salvatore D. Tomarchio , Paul D. McNicholas , Antonio Punzo

We propose and experimentally demonstrate an innovative stock index prediction method using a weighted optical reservoir computing system. We construct fundamental market data combined with macroeconomic data and technical indicators to…

Machine Learning · Computer Science 2024-08-02 Fang Wang , Ting Bu , Yuping Huang