English
Related papers

Related papers: Uniform minimum risk equivariant estimates for mom…

200 papers

Weighted empirical risk minimization is a common approach to prediction under distribution drift. This article studies its out-of-sample prediction error under nonstationarity. We provide a general decomposition of the excess risk into a…

Machine Learning · Statistics 2026-05-19 Tobias Brock , Thomas Nagler

We provide a criterion for establishing lower bounds on the rate of convergence in $f$-variation of a continuous-time ergodic Markov process to its invariant measure. The criterion consists of novel super- and submartingale conditions for…

Probability · Mathematics 2024-04-16 Miha Brešar , Aleksandar Mijatović

Birnbaum-Saunders models have been widely used to model positively skewed data. In this paper, we introduce a bivariate Birnbaum-Saunders distribution which has the means as parameters. We present some properties of the univariate and…

Methodology · Statistics 2018-05-01 Helton Saulo , Jeremias Leão , Roberto Vila , Victor Leiva , Vera Tomazella

Graphical models trained using maximum likelihood are a common tool for probabilistic inference of marginal distributions. However, this approach suffers difficulties when either the inference process or the model is approximate. In this…

Machine Learning · Computer Science 2012-06-18 Justin Domke

Bayesian inference typically relies on specifying a parametric model that approximates the data-generating process. However, misspecified models can yield poor convergence rates and unreliable posterior calibration. Bayesian empirical…

Methodology · Statistics 2025-10-27 Kenyon Ng , Weichang Yu , Howard D. Bondell

In this work we study the semi-supervised framework of confidence set classification with controlled expected size in minimax settings. We obtain semi-supervised minimax rates of convergence under the margin assumption and a H{\"o}lder…

Statistics Theory · Mathematics 2019-04-30 Evgenii Chzhen , Christophe Denis , Mohamed Hebiri

We define a moment-based estimator that maximizes the empirical saddlepoint (ESP) approximation of the distribution of solutions to empirical moment conditions. We call it the ESP estimator. We prove its existence, consistency and…

Statistics Theory · Mathematics 2019-05-20 Benjamin Holcblat , Fallaw Sowell

In the regression framework, the empirical measure based on the responses resulting from the nearest neighbors, among the covariates, to a given point $x$ is introduced and studied as a central statistical quantity. First, the associated…

Statistics Theory · Mathematics 2024-04-11 François Portier

The purpose of this paper is to investigate the deviation inequalities and the moderate deviation principle of the least squares estimators of the unknown parameters of general $p$th-order bifurcating autoregressive processes, under…

Probability · Mathematics 2012-04-12 Hacène Djellout , Valère Bitseki Penda

Let $X:=(X_t)_{t\geq 0}$ be an ergodic Markov process on $\real^d$, and $p>0$. We derive upper bounds of the $p$-Wasserstein distance between the invariant measure and the empirical measures of the Markov process $X$. For this we assume,…

Probability · Mathematics 2025-12-30 René L. Schilling , Jian Wang , Bingyao Wu , Jie-Xiang Zhu

Random-effects models are frequently used to synthesise information from different studies in meta-analysis. While likelihood-based inference is attractive both in terms of limiting properties and of implementation, its application in…

Methodology · Statistics 2018-02-16 Ioannis Kosmidis , Annamaria Guolo , Cristiano Varin

The bootstrap variance estimate is widely used in semiparametric inferences. However, its theoretical validity is a well known open problem. In this paper, we provide a {\em first} theoretical study on the bootstrap moment estimates in…

Statistics Theory · Mathematics 2014-09-23 Guang Cheng

This article discusses estimation of a multivariate normal mean based on heteroscedastic observations. Under heteroscedasticity, estimators shrinking more on the coordinates with larger variances, seem desirable. Although they are not…

Statistics Theory · Mathematics 2022-06-23 Yuzo Maruyama , Lawrence D. Brown , Edward I. George

In this work, we study the weighted empirical risk minimization (weighted ERM) schema, in which an additional data-dependent weight function is incorporated when the empirical risk function is being minimized. We show that under a general…

Machine Learning · Computer Science 2025-01-07 Yikai Zhang , Jiahe Lin , Fengpei Li , Songzhu Zheng , Anant Raj , Anderson Schneider , Yuriy Nevmyvaka

We propose new parametric frameworks of regression analysis with the conditional mode of a bounded response as the focal point of interest. Covariate effects estimation and prediction based on the maximum likelihood method under two new…

Methodology · Statistics 2020-06-22 Haiming Zhou , Xianzheng Huang

In this paper we consider the problem of detecting a change in the parameters of an autoregressive process, where the moments of the innovation process do not necessarily exist. An empirical likelihood ratio test for the existence of a…

Statistics Theory · Mathematics 2016-12-07 Fumiya Akashi , Holger Dette , Yan Liu

Motivated by questions originating from the study of a class of shallow student-teacher neural networks, methods are developed for the analysis of spurious minima in classes of gradient equivariant dynamics related to neural nets. In the…

Machine Learning · Computer Science 2022-06-22 Yossi Arjevani , Michael Field

This paper presents a novel estimation approach for cumulative link models, based on median bias reduction as developed in Kenne Pagui et al. (2017). The median bias reduced estimator is obtained as solution of an estimating equation based…

Methodology · Statistics 2020-09-16 Vincenzo Gioia , Euloge Clovis Kenne Pagui , Alessandra Salvan

Empirical risk minimization (ERM) stability is usually studied via single-valued outputs, while convex non-strict losses yield set-valued minimizers. We identify Painlev\'e-Kuratowski upper semicontinuity (PK-u.s.c.) as the intrinsic…

Machine Learning · Computer Science 2026-01-27 Karim Bounja , Lahcen Laayouni , Abdeljalil Sakat

This paper is concerned with the development of rigorous approximations to various expectations associated with Markov chains and processes having non-stationary transition probabilities. Such non-stationary models arise naturally in…

Probability · Mathematics 2018-05-07 Zeyu Zheng , Harsha Honnappa , Peter W. Glynn