English
Related papers

Related papers: Smoothed Quantile Estimation: A Unified Framework …

200 papers

We consider the approximation of expectations with respect to the distribution of a latent Markov process given noisy measurements. This is known as the smoothing problem and is often approached with particle and Markov chain Monte Carlo…

Computation · Statistics 2019-02-06 Lawrence Middleton , George Deligiannidis , Arnaud Doucet , Pierre E. Jacob

In the present paper we propose a new estimator of entropy based on smooth estimators of quantile density. The consistency and asymptotic distribution of the proposed estimates are obtained. As a consequence, a new test of normality is…

Statistics Theory · Mathematics 2019-03-06 Salim Bouzebda , Issam Elhattab , Amor Keziou , Tewfik Lounis

When reporting the results of clinical studies, some researchers may choose the five-number summary (including the sample median, the first and third quartiles, and the minimum and maximum values) rather than the sample mean and standard…

Methodology · Statistics 2020-06-18 Jiandong Shi , Dehui Luo , Hong Weng , Xian-Tao Zeng , Lu Lin , Haitao Chu , Tiejun Tong

Some classical uncertainty quantification problems require the estimation of multiple expectations. Estimating all of them accurately is crucial and can have a major impact on the analysis to perform, and standard existing Monte Carlo…

Methodology · Statistics 2022-12-02 Julien Demange-Chryst , François Bachoc , Jérôme Morio

We propose a unified framework for establishing existence of nonparametric M-estimators, computing the corresponding estimates, and proving their strong consistency when the class of functions is exceptionally rich. In particular, the…

Statistics Theory · Mathematics 2019-09-11 Johannes O. Royset , Roger J-B Wets

Stochastic estimators are fundamental to large-scale optimization, where population quantities must be inferred from noisy oracle observations. Although influential methods such as momentum, SPIDER, STORM, and PAGE have been highly…

Machine Learning · Computer Science 2026-05-18 Zhankun Luo , Antesh Upadhyay , M. Berk Sahin , Sang Bin Moon , Anuran Makur , Abolfazl Hashemi

Sparse Mixture of Experts (SMoEs) models scale the capacity of models while maintaining constant computational overhead. Early designs typically relied on a fixed value of $k$, where $k$ represents either the number of experts selected per…

Computation and Language · Computer Science 2025-10-28 Giang Do , Hung Le , Truyen Tran

Quantile regression is a powerful tool for learning the relationship between a response variable and a multivariate predictor while exploring heterogeneous effects. In this paper, we consider statistical inference for quantile regression…

Statistics Theory · Mathematics 2021-05-19 Xuming He , Xiaoou Pan , Kean Ming Tan , Wen-Xin Zhou

Model performance evaluation is a critical and expensive task in machine learning and computer vision. Without clear guidelines, practitioners often estimate model accuracy using a one-time completely random selection of the data. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Riccardo Fogliato , Pratik Patil , Mathew Monfort , Pietro Perona

Statistical inference, a central tool of science, revolves around the study and the usage of statistical estimators: functions that map finite samples to predictions about unknown distribution parameters. In the frequentist framework,…

Machine Learning · Computer Science 2025-12-15 Maxime Peyrard , Kyunghyun Cho

Additive smooth models, such as Generalized additive models (GAMs) of location, scale, and shape (GAMLSS), are a popular choice for modeling experimental data. However, software available to fit such models is usually not tailored…

Methodology · Statistics 2025-06-17 Joshua Krause , Jelmer P. Borst , Jacolien van Rij

M-type smoothing splines are a broad class of spline estimators that include the popular least-squares smoothing spline but also spline estimators that are less susceptible to outlying observations and model-misspecification. However,…

Statistics Theory · Mathematics 2025-03-06 Ioannis Kalogridis

Model smoothing is of central importance for obtaining a reliable teacher model in the student-teacher framework, where the teacher generates surrogate supervision signals to train the student. A popular model smoothing method is the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Tengteng Huang , Yifan Sun , Xun Wang , Haotian Yao , Chi Zhang

Ordinary differential equations (ODEs) are commonly used to model dynamic behavior of a system. Because many parameters are unknown and have to be estimated from the observed data, there is growing interest in statistics to develop…

Statistics Theory · Mathematics 2010-01-13 Xin Qi , Hongyu Zhao

We consider estimation of a multivariate normal mean vector under sum of squared error loss. We propose a new class of smooth estimators parameterized by \alpha dominating the James-Stein estimator. The estimator for \alpha=1 corresponds to…

Statistics Theory · Mathematics 2010-09-14 Yuzo Maruyama

We develop constrained Bayesian estimation methods for small area problems: those requiring smoothness with respect to similarity across areas, such as geographic proximity or clustering by covariates; and benchmarking constraints,…

Methodology · Statistics 2014-10-28 Rebecca C. Steorts

This paper introduces smoothed pseudo-population bootstrap methods for the purposes of variance estimation and the construction of confidence intervals for finite population quantiles. In an i.i.d. context, it has been shown that resampling…

Methodology · Statistics 2025-09-30 Vanessa McNealis , Christian Léger

This article develops a unified framework to study the asymptotic properties of all periodic spline-based estimators, that is, of regression, penalized and smoothing splines. The explicit form of the periodic Demmler-Reinsch basis in terms…

Statistics Theory · Mathematics 2016-02-23 Katsiaryna Schwarz , Tatyana Krivobokova

Latent variable models have been playing a central role in psychometrics and related fields. In many modern applications, the inference based on latent variable models involves one or several of the following features: (1) the presence of…

Methodology · Statistics 2025-01-08 Siliang Zhang , Yunxiao Chen

In this paper, we consider a generic scheme that allows building weighted versions of various quantile estimators, such as traditional quantile estimators based on linear interpolation of two order statistics, the Harrell-Davis quantile…

Methodology · Statistics 2023-04-17 Andrey Akinshin