English
Related papers

Related papers: Quantile estimation with adaptive importance sampl…

200 papers

We introduce and test an algorithm that adaptively estimates large deviation functions characterizing the fluctuations of additive functionals of Markov processes in the long-time limit. These functions play an important role for predicting…

Statistical Mechanics · Physics 2023-03-30 Grégoire Ferré , Hugo Touchette

Adaptive Markov chains are an important class of Monte Carlo methods for sampling from probability distributions. The time evolution of adaptive algorithms depends on past samples, and thus these algorithms are non-Markovian. Although there…

Probability · Mathematics 2014-10-02 Natesh S. Pillai , Aaron Smith

Since survival data occur over time, often important covariates that we wish to consider also change over time. Such covariates are referred as time-dependent covariates. Quantile regression offers flexible modeling of survival data by…

Methodology · Statistics 2014-05-01 Malka Gorfine , Yair Goldberg , Yaacov Ritov

We study the existence, strong consistency and asymptotic normality of estimators obtained from estimating functions, that are p-dimensional martingale transforms. The problem is motivated by the analysis of evolutionary clustered data,…

Statistics Theory · Mathematics 2020-12-01 Laura Dumitrescu , Ioana Schiopu-Kratina

Probability density function estimation with weighted samples is the main foundation of all adaptive importance sampling algorithms. Classically, a target distribution is approximated either by a non-parametric model or within a parametric…

Machine Learning · Computer Science 2023-10-16 Julien Demange-Chryst , François Bachoc , Jérôme Morio , Timothé Krauth

Computation of extreme quantiles and tail-based risk measures using standard Monte Carlo simulation can be inefficient. A method to speed up computations is provided by importance sampling. We show that importance sampling algorithms,…

Probability · Mathematics 2009-09-21 Henrik Hult , Jens Svensson

This paper introduces a new Importance Sampling scheme, called Adaptive Twisted Importance Sampling, which is adequate for the improved estimation of rare event probabilities in he range of moderate deviations pertaining to the empirical…

Computation · Statistics 2009-10-13 Michel Broniatowski , Ya'Acov Ritov

In this paper, we derive the joint asymptotic distributions of functions of quantile estimators (the non-parametric sample quantile and the parametric location-scale quantile estimator) with functions of measure of dispersion estimators…

Statistics Theory · Mathematics 2019-04-29 Marcel Bräutigam , Marie Kratz

In parameter estimation problems one computes a posterior distribution over uncertain parameters defined jointly by a prior distribution, a model, and noisy data. Markov Chain Monte Carlo (MCMC) is often used for the numerical solution of…

Numerical Analysis · Mathematics 2017-11-15 Matthias Morzfeld , Marcus S. Day , Ray W. Grout , George Shu Heng Pau , Stefan A. Finsterle , John B. Bell

In this paper we propose the adaptive lasso for predictive quantile regression (ALQR). Reflecting empirical findings, we allow predictors to have various degrees of persistence and exhibit different signal strengths. The number of…

Econometrics · Economics 2024-06-05 Rui Fan , Ji Hyung Lee , Youngki Shin

We propose a new importance sampling framework for the estimation and analysis of Sobol' indices. We focus on the estimation of the conditional second-moment quantity underlying these indices, which is the most challenging term to estimate.…

Statistics Theory · Mathematics 2026-03-03 Haythem Boucharif , Jérôme Morio , Paul Rochet

Consider the task of generating samples from a tilted distribution of a random vector whose underlying distribution is unknown, but samples from it are available. This finds applications in fields such as finance and climate science, and in…

Regression quantiles have asymptotic variances that depend on the conditional densities of the response variable given regressors. This paper develops a new estimate of the asymptotic variance of regression quantiles that leads any…

Econometrics · Economics 2019-09-27 Juan Carlos Escanciano , Chuan Goh

Quantile regression is a powerful tool for detecting exposure-outcome associations given covariates across different parts of the outcome's distribution, but has two major limitations when the aim is to infer the effect of an exposure.…

Time to event outcomes are often evaluated on the hazard scale, but interpreting hazards may be difficult. Recently, there has been concern in the causal inference literature that hazards actually have a built in selection-effect that…

Methodology · Statistics 2020-02-07 Pål Christie Ryalen , Mats Julius Stensrud , Kjetil Røysland

In a classical regression model, it is usually assumed that the explanatory variables are independent of each other and error terms are normally distributed. But when these assumptions are not met, situations like the error terms are not…

Statistics Theory · Mathematics 2017-09-08 Bahadır Yüzbaşı , Yasin Asar , Ahmet Demiralp , M. Şamil Şık

In many stochastic problems, the output of interest depends on an input random vector mainly through a single random variable (or index) via an appropriate univariate transformation of the input. We exploit this feature by proposing an…

Computation · Statistics 2021-11-16 Erik Hintz , Marius Hofert , Christiane Lemieux , Yoshihiro Taniguchi

The weak convergence of the quantile processes, which are constructed based on different estimators of the finite population quantiles, is shown under various well-known sampling designs based on a superpopulation model. The results related…

Statistics Theory · Mathematics 2024-12-02 Anurag Dey , Probal Chaudhuri

Importance sampling has been known as a powerful tool to reduce the variance of Monte Carlo estimator for rare event simulation. Based on the criterion of minimizing the variance of Monte Carlo estimator within a parametric family, we…

Methodology · Statistics 2013-02-11 Cheng-Der Fuh , Huei-Wen Teng , Ren-Her Wang

Sampling is a fundamental problem in computer science and statistics. However, for a given task and stream, it is often not possible to choose good sampling probabilities in advance. We derive a general framework for adaptively changing the…

Machine Learning · Statistics 2022-06-16 Daniel Ting