English
Related papers

Related papers: Local quasi-likelihood with a parametric guide

200 papers

Many applications of classification methods not only require high accuracy but also reliable estimation of predictive uncertainty. However, while many current classification frameworks, in particular deep neural networks, achieve high…

Machine Learning · Computer Science 2020-02-28 Jonathan Wenger , Hedvig Kjellström , Rudolph Triebel

Bayesian methods are a popular choice for statistical inference in small-data regimes due to the regularization effect induced by the prior. In the context of density estimation, the standard nonparametric Bayesian approach is to target the…

Machine Learning · Statistics 2023-02-21 Sahra Ghalebikesabi , Chris Holmes , Edwin Fong , Brieuc Lehmann

We consider heteroscedastic nonparametric regression models, when both the mean function and variance function are unknown and to be estimated with nonparametric approaches. We derive convergence rates of posterior distributions for this…

Statistics Theory · Mathematics 2010-10-07 Yuao Hu

A collection of quantile curves provides a complete picture of conditional distributions. Properly centered and scaled versions of estimated curves at various quantile levels give rise to the so-called quantile regression process (QRP). In…

Statistics Theory · Mathematics 2017-07-25 Shih-Kang Chao , Stanislav Volgushev , Guang Cheng

We study the problem of learning local metrics for nearest neighbor classification. Most previous works on local metric learning learn a number of local unrelated metrics. While this "independence" approach delivers an increased flexibility…

Machine Learning · Computer Science 2012-09-17 Jun Wang , Adam Woznica , Alexandros Kalousis

This paper considers the problem of estimation in the generalized semiparametric model for longitudinal data when the number of parameters diverges with the sample size. A penalization type of generalized estimating equation method is…

Methodology · Statistics 2020-06-09 M. Taavoni , M. Arashi

We propose an iterative estimating equations procedure for analysis of longitudinal data. We show that, under very mild conditions, the probability that the procedure converges at an exponential rate tends to one as the sample size…

Statistics Theory · Mathematics 2007-12-18 Jiming Jiang , Yihui Luan , You-Gan Wang

We consider a resampling scheme for parameters estimates in nonlinear regression models. We provide an estimation procedure which recycles, via random weighting, the relevant parameters estimates to construct consistent estimates of the…

Methodology · Statistics 2018-12-18 Ben Boukai , Yue Zhang

Many pre-trained models (PTMs) are available in modern applications. Because different PTMs are often trained on different datasets, their performances can vary substantially for different new tasks, and the ranking of the candidates may…

Methodology · Statistics 2026-05-14 Ziwen Gao , Baihua He , Yuhong Yang

The likelihood function plays a pivotal role in statistical inference; it is adaptable to a wide range of models and the resultant estimators are known to have good properties. However, these results hinge on correct specification of the…

Statistics Theory · Mathematics 2017-12-15 Adam Jaeger , Nicole Lazar

We consider linear regression model estimation where the covariate of interest is randomly censored. Under a non-informative censoring mechanism, one may obtain valid estimates by deleting censored observations. However, this comes at a…

Applications · Statistics 2017-10-24 Folefac Atem , Roland A. Matsouaka

This paper considers a semiparametric approach within the general Bayesian linear model where the innovations consist of a stationary, mean zero Gaussian time series. While a parametric prior is specified for the linear model coefficients,…

Statistics Theory · Mathematics 2024-09-25 Claudia Kirch , Alexander Meier , Renate Meyer , Yifu Tang

In this paper, we built a new nonparametric regression estimator with the local linear method by using the mean squared relative error as a loss function when the data are subject to random right censoring. We establish the uniform almost…

Statistics Theory · Mathematics 2020-04-07 Feriel Bouhadjera , Elias Saïd

We study non-parametric regression estimates for random fields. The data satisfies certain strong mixing conditions and is defined on the regular $N$-dimensional lattice structure. We show consistency and obtain rates of convergence. The…

Statistics Theory · Mathematics 2018-07-06 Johannes T. N. Krebs

Linear mixed-effects models are widely used in analyzing clustered or repeated measures data. We propose a quasi-likelihood approach for estimation and inference of the unknown parameters in linear mixed-effects models with high-dimensional…

Methodology · Statistics 2021-03-10 Sai Li , Tony T. Cai , Hongzhe Li

We explore the estimation of generalized additive models using basis expansion in conjunction with Bayesian model selection. Although Bayesian model selection is useful for regression splines, it has traditionally been applied mainly to…

Methodology · Statistics 2024-09-02 Gyeonghun Kang , Seonghyun Jeong

In a wide range of applications, the stochastic properties of the observed time series change over time. The changes often occur gradually rather than abruptly: the properties are (approximately) constant for some time and then slowly start…

Methodology · Statistics 2015-04-03 Michael Vogt , Holger Dette

We investigate and compare the fundamental performance of several distributed learning methods that have been proposed recently. We do this in the context of a distributed version of the classical signal-in-Gaussian-white-noise model, which…

Statistics Theory · Mathematics 2017-11-10 Botond Szabo , Harry van Zanten

A modified gamma kernel should not be automatically preferred to the standard gamma kernel, especially for univariate convex densities with a pole at the origin. In the multivariate case, multiple combined gamma kernels, defined as a…

Statistics Theory · Mathematics 2024-04-12 Sobom M. Somé , Célestin C. Kokonendji , Smail Adjabi , Naushad A. Mamode Khan , Said Beddek

Latent variable models have been playing a central role in psychometrics and related fields. In many modern applications, the inference based on latent variable models involves one or several of the following features: (1) the presence of…

Methodology · Statistics 2025-01-08 Siliang Zhang , Yunxiao Chen