English
Related papers

Related papers: Nonparametric iterated-logarithm extensions of the…

200 papers

This paper develops an asymptotic likelihood theory for triangular arrays of stationary Gaussian time series depending on a multidimensional unknown parameter. We give sufficient conditions for the associated sequence of statistical models…

Statistics Theory · Mathematics 2025-11-14 Carsten H. Chong , Fabian Mies

In this paper, we introduce a flexible and widely applicable nonparametric entropy-based testing procedure that can be used to assess the validity of simple hypotheses about a specific parametric population distribution. The testing…

Econometrics · Economics 2022-01-19 Ron Mittelhammer , George Judge , Miguel Henry

Let $ \nu $ be a probability distribution over the linear semi-group $ \mathrm{End}(E) $ for $ E $ a finite dimensional vector space over a locally compact field. We assume that $ \nu $ is proximal, strongly irreducible and that $…

Probability · Mathematics 2025-02-14 Axel Péneau

We investigate two closely related nonparametric hypothesis testing problems. In the first problem (i.e., the existence problem), we test whether a testing data stream is generated by one of a set of composite distributions. In the second…

Signal Processing · Electrical Eng. & Systems 2018-12-05 Yixian Liu , Yingbin Liang , Shuguang Cui

We establish higher-order nonasymptotic expansions for a difference between probability distributions of sums of i.i.d. random vectors in a Euclidean space. The derived bounds are uniform over two classes of sets: the set of all Euclidean…

Statistics Theory · Mathematics 2022-11-30 Mayya Zhilova

This paper introduces a likelihood ratio (LR)-type test that possesses the robustness properties of \(C(\alpha)\)-type procedures in an extremum estimation setting. The test statistic is constructed by applying separate adjustments to the…

Econometrics · Economics 2025-10-21 Jean-Marie Dufour , Purevdorj Tuvaandorj

To address the computational issue in empirical likelihood methods with massive data, this paper proposes a grouped empirical likelihood (GEL) method. It divides $N$ observations into $n$ groups, and assigns the same probability weight to…

Methodology · Statistics 2025-12-10 Yongda Wang , Shifeng Xiong

Stochastic iterative algorithms, including stochastic gradient descent (SGD) and stochastic gradient Langevin dynamics (SGLD), are widely utilized for optimization and sampling in large-scale and high-dimensional problems in machine…

Machine Learning · Statistics 2025-01-22 Xiaoyu Wang , Mikolaj J. Kasprzak , Jeffrey Negrea , Solesne Bourguin , Jonathan H. Huggins

We study the Unadjusted Langevin Algorithm (ULA) for sampling from a probability distribution $\nu = e^{-f}$ on $\mathbb{R}^n$. We prove a convergence guarantee in Kullback-Leibler (KL) divergence assuming $\nu$ satisfies a log-Sobolev…

Data Structures and Algorithms · Computer Science 2022-03-04 Santosh S. Vempala , Andre Wibisono

We investigate a generalized empirical likelihood approach in a two-group setting where the constraints on parameters have a form of U-statistics. In this situation, the summands that consist of the constraints for the empirical likelihood…

Methodology · Statistics 2015-05-04 Jihnhee Yu , Luge Yang , Albert Vexler , Alan D. Hutson

For the universal hypothesis testing problem, where the goal is to decide between the known null hypothesis distribution and some other unknown distribution, Hoeffding proposed a universal test in the nineteen sixties. Hoeffding's universal…

Information Theory · Computer Science 2016-11-15 Jayakrishnan Unnikrishnan , Dayu Huang , Sean Meyn , Amit Surana , Venugopal Veeravalli

Nonparametric generalized likelihood ratio test is popularly used for model checking for regressions. However, there are two issues that may be the barriers for its powerfulness. First, the bias term in its liming null distribution causes…

Methodology · Statistics 2015-07-23 Cuizhen Niu , Xu Guo , Lixing Zhu

This paper develops a theory of distribution- and time-uniform asymptotics, culminating in the first large-sample anytime-valid inference procedures that are shown to be uniformly valid in a rich class of distributions. Historically,…

Statistics Theory · Mathematics 2026-01-16 Ian Waudby-Smith , Edward H. Kennedy , Aaditya Ramdas

The generalised linear model (GLM) is a very important tool for analysing real data in biology, sociology, agriculture, engineering and many other application domain where the relationship between the response and explanatory variables may…

Methodology · Statistics 2016-07-04 Abhik Ghosh , Ayanendranath Basu

We study a high-dimensional generalized linear model and penalized empirical risk minimization with $\ell_1$ penalty. Our aim is to provide a non-trivial illustration that non-asymptotic bounds for the estimator can be obtained without…

Statistics Theory · Mathematics 2007-09-12 Sara A. van de Geer

Distributional reinforcement learning (DRL) has achieved empirical success in various domains. One core task in DRL is distributional policy evaluation, which involves estimating the return distribution $\eta^\pi$ for a given policy $\pi$.…

Machine Learning · Statistics 2025-01-17 Yang Peng , Liangyu Zhang , Zhihua Zhang

We develop a non-negative polynomial minimum-norm likelihood ratio (PLR) of two distributions of which only moments are known. The sample PLR converges to the unknown population PLR under mild conditions. The methodology allows for…

Optimization and Control · Mathematics 2023-09-06 Caio Almeida , Ricardo Masini , Paul Schneider

Estimation of generalized linear mixed models (GLMMs) with non-nested random effects structures requires approximation of high-dimensional integrals. Many existing methods are tailored to the low-dimensional integrals produced by nested…

Computation · Statistics 2014-04-01 Andrew T. Karl , Yan Yang , Sharon L. Lohr

In this note we give a new effective proof method for the equivalence of the notions of testability and nondeterministic testability for uniform hypergraph parameters. We provide the first effective upper bound on the sample complexity of…

Data Structures and Algorithms · Computer Science 2015-09-11 Marek Karpinski , Roland Markó

This paper considers the maximum generalized empirical likelihood (GEL) estimation and inference on parameters identified by high dimensional moment restrictions with weakly dependent data when the dimensions of the moment restrictions and…

Statistics Theory · Mathematics 2015-01-28 Jinyuan Chang , Song Xi Chen , Xiaohong Chen