English
Related papers

Related papers: Asymptotic Accuracy of Distribution-Based Estimati…

200 papers

We consider high-dimensional estimation problems where the number of parameters diverges with the sample size. General conditions are established for consistency, uniqueness, and asymptotic normality in both unpenalized and penalized…

Statistics Theory · Mathematics 2025-04-08 Jana Gauss , Thomas Nagler

This article investigates the asymptotic distribution of penalized estimators with non-differentiable penalties designed to recover low-dimensional pattern structures. Patterns play a central role in estimation, as they reveal the…

Statistics Theory · Mathematics 2025-11-18 Ivan Hejný , Jonas Wallin , Małgorzata Bogdan

Sequential data collection has emerged as a widely adopted technique for enhancing the efficiency of data gathering processes. Despite its advantages, such data collection mechanism often introduces complexities to the statistical inference…

Statistics Theory · Mathematics 2023-11-09 Mufang Ying , Koulik Khamaru , Cun-Hui Zhang

We study the existence, strong consistency and asymptotic normality of estimators obtained from estimating functions, that are p-dimensional martingale transforms. The problem is motivated by the analysis of evolutionary clustered data,…

Statistics Theory · Mathematics 2020-12-01 Laura Dumitrescu , Ioana Schiopu-Kratina

Ising models describe the joint probability distribution of a vector of binary feature variables. Typically, not all the variables interact with each other and one is interested in learning the presumably sparse network structure of the…

Machine Learning · Computer Science 2019-07-09 Frank Nussbaum , Joachim Giesen

Logistic regression is a well-known statistical model which is commonly used in the situation where the output is a binary random variable. It has a wide range of applications including machine learning, public health, social sciences,…

Statistics Theory · Mathematics 2019-04-18 Bernard Bercu , Antoine Godichon-Baggioni , Bruno Portier

Extracting time-varying latent variables from computational cognitive models is a key step in model-based neural analysis, which aims to understand the neural correlates of cognitive processes. However, existing methods only allow…

Machine Learning · Computer Science 2025-09-01 Ti-Fen Pan , Jing-Jing Li , Bill Thompson , Anne Collins

Variational Autoencoders are powerful models for unsupervised learning. However deep models with several layers of dependent stochastic variables are difficult to train which limits the improvements obtained using these highly expressive…

Machine Learning · Statistics 2016-05-30 Casper Kaae Sønderby , Tapani Raiko , Lars Maaløe , Søren Kaae Sønderby , Ole Winther

In this paper we propose a wavelet-based methodology for estimation and variable selection in partially linear models. The inference is conducted in the wavelet domain, which provides a sparse and localized decomposition appropriate for…

Methodology · Statistics 2016-09-26 Norbert Remenyi

This paper develops a new statistical inference theory for the precision matrix of high-frequency data in a high-dimensional setting. The focus is not only on point estimation but also on interval estimation and hypothesis testing for…

Statistics Theory · Mathematics 2020-05-20 Yuta Koike

A Bayesian non-parametric framework for studying time-to-event data is proposed, where the prior distribution is allowed to depend on an additional random source, and may update with the sample size. Such scenarios are natural, for…

Methodology · Statistics 2025-05-06 Martin Bladt , Jorge González Cázares

Datasets from the fields of bioinformatics, chemometrics, and face recognition are typically characterized by small samples of high-dimensional data. Among the many variants of linear discriminant analysis that have been proposed in order…

Machine Learning · Statistics 2020-04-20 Lama B. Niyazi , Abla Kammoun , Hayssam Dahrouj , Mohamed-Slim Alouini , Tareq Y. Al-Naffouri

Statistical inference for discrete time observations of an affine stochastic delay differential equation is considered. The main focus is on maximum pseudo-likelihood estimators, which are easy to calculate in practice. A more general class…

Statistics Theory · Mathematics 2013-03-21 Uwe Küchler , Michael Sørensen

One of the main problem in prediction theory of discrete-time second-order stationary processes $X(t)$ is to describe the asymptotic behavior of the best linear mean squared prediction error in predicting $X(0)$ given $ X(t),$ $-n\le…

Statistics Theory · Mathematics 2022-10-14 Nikolay M. Babayan , Mamikon S. Ginovyan

Mutual information is widely used in artificial intelligence, in a descriptive way, to measure the stochastic dependence of discrete random variables. In order to address questions such as the reliability of the empirical value, one must…

Artificial Intelligence · Computer Science 2008-06-26 Marco Zaffalon , Marcus Hutter

Mutual information is widely used in artificial intelligence, in a descriptive way, to measure the stochastic dependence of discrete random variables. In order to address questions such as the reliability of the empirical value, one must…

Artificial Intelligence · Computer Science 2014-08-08 Marco Zaffalon , Marcus Hutter

We consider a situation where the distribution of a random variable is being estimated by the empirical distribution of noisy measurements of that variable. This is common practice in, for example, teacher value-added models and other…

Econometrics · Economics 2021-12-08 Koen Jochmans , Martin Weidner

The analysis of diffusion processes in real-world propagation scenarios often involves estimating variables that are not directly observed. These hidden variables include parental relationships, the strengths of connections between nodes,…

Social and Information Networks · Computer Science 2016-05-12 Shohreh Shaghaghian , Mark Coates

We consider a stochastic process model with time trend and measurement error. We establish consistency and derive the limiting distributions of the maximum likelihood (ML) estimators of the covariance function parameters under a general…

Statistics Theory · Mathematics 2016-09-29 Chih-Hao Chang , Hsin-Cheng Huang , Ching-Kang Ing

This paper considers the problem of estimating linear dynamic system models when the observations are corrupted by random disturbances with nonstandard distributions. The paper is particularly motivated by applications where sensor…

Methodology · Statistics 2018-07-09 Johan Dahlin , Adrian Wills , Brett Ninness