English
Related papers

Related papers: Developments in Maximum Likelihood Unit Root Tests

200 papers

In order to learn the complex features of large spatio-temporal data, models with large parameter sets are often required. However, estimating a large number of parameters is often infeasible due to the computational and memory costs of…

Computation · Statistics 2018-07-02 Matthew Edwards , Stefano Castruccio , Dorit Hammerling

Restricted maximum likelihood (REML) estimation is a widely accepted and frequently used method for fitting linear mixed models, with its principal advantage being that it produces less biased estimates of the variance components. However,…

Methodology · Statistics 2025-05-15 Luca Maestrini , Francis K. C. Hui , Alan H. Welsh

In this work, we explore the theoretical properties of conditional deep generative models under the statistical framework of distribution regression where the response variable lies in a high-dimensional ambient space but concentrates…

Statistics Theory · Mathematics 2026-02-02 Shivam Kumar , Yun Yang , Lizhen Lin

Identifying important features linked to a response variable is a fundamental task in various scientific domains. This article explores statistical inference for simulated Markov random fields in high-dimensional settings. We introduce a…

Machine Learning · Statistics 2024-01-23 Haoyu Wei , Xiaoyu Lei , Yixin Han , Huiming Zhang

Histogram-based empirical Bayes methods developed for analyzing data for large numbers of genes, SNPs, or other biological features tend to have large biases when applied to data with a smaller number of features such as genes with…

Methodology · Statistics 2013-10-10 Marta Padilla , David R. Bickel

Good robust estimators can be tuned to combine a high breakdown point and a specified asymptotic efficiency at a central model. This happens in regression with MM- and tau-estimators among others. However, the finite-sample efficiency of…

Statistics Theory · Mathematics 2013-11-21 Ricardo Maronna , Víctor Yohai

It is important for official statistics production to apply ML with statistical rigor, as it presents both opportunities and challenges. Although machine learning has enjoyed rapid technological advances in recent years, its application…

Machine Learning · Statistics 2024-09-09 Marco Puts , David Salgado , Piet Daas

This paper addresses maximum likelihood (ML) estimation based model fitting in the context of extrasolar planet detection. This problem is featured by the following properties: 1) the candidate models under consideration are highly…

Methodology · Statistics 2017-07-24 Bin Liu , Ke-Jia Chen

This paper studies the high-dimensional mixed linear regression (MLR) where the output variable comes from one of the two linear regression models with an unknown mixing proportion and an unknown covariance structure of the random…

Methodology · Statistics 2020-11-10 Linjun Zhang , Rong Ma , T. Tony Cai , Hongzhe Li

We consider a one-dimensional recurrent random walk in random environment (RWRE) when the environment is i.i.d. with a parametric, finitely supported distribution. Based on a single observation of the path, we provide a maximum likelihood…

Probability · Mathematics 2014-04-10 Francis Comets , Mikael Falconnet , Oleg Loukianov , Dasha Loukianova

Score matching is an alternative to maximum likelihood (ML) for estimating a probability distribution parametrized up to a constant of proportionality. By fitting the ''score'' of the distribution, it sidesteps the need to compute this…

Machine Learning · Computer Science 2023-06-06 Chirag Pabbaraju , Dhruv Rohatgi , Anish Sevekari , Holden Lee , Ankur Moitra , Andrej Risteski

This paper introduces a unified framework for the detection of a source with a sensor array in the context where the noise variance and the channel between the source and the sensors are unknown at the receiver. The Generalized Maximum…

Probability · Mathematics 2010-06-16 Pascal Bianchi , Merouane Debbah , Mylène Maïda , Jamal Najim

Mixture of Experts (MoE) are successful models for modeling heterogeneous data in many statistical learning problems including regression, clustering and classification. Generally fitted by maximum likelihood estimation via the well-known…

Machine Learning · Statistics 2018-10-30 Faicel Chamroukhi , Bao-Tuyen Huynh

The L1-regularized Gaussian maximum likelihood estimator (MLE) has been shown to have strong statistical guarantees in recovering a sparse inverse covariance matrix, or alternatively the underlying graph structure of a Gaussian Markov…

Machine Learning · Computer Science 2013-06-14 Cho-Jui Hsieh , Matyas A. Sustik , Inderjit S. Dhillon , Pradeep Ravikumar

The asymptotic theory of various estimators based on Gaussian likelihood has been developed for the unit root and near unit root cases of a first-order moving average model. Previous studies of the MA(1) unit root problem rely on the…

Statistics Theory · Mathematics 2012-03-13 Richard A. Davis , Li Song

In this paper, we study sample size thresholds for maximum likelihood estimation for tensor normal models. Given the model parameters and the number of samples, we determine whether, almost surely, (1) the likelihood function is bounded…

Statistics Theory · Mathematics 2023-02-09 Harm Derksen , Visu Makam , Michael Walter

Approximate Bayesian Computation (ABC) can be viewed as an analytic approximation of an intractable likelihood coupled with an elementary simulation step. Such a view, combined with a suitable instrumental prior distribution permits…

Methodology · Statistics 2013-01-04 F. J. Rubio , Adam M. Johansen

We give a general unified method that can be used for $L_1$ {\em closeness testing} of a wide range of univariate structured distribution families. More specifically, we design a sample optimal and computationally efficient algorithm for…

Data Structures and Algorithms · Computer Science 2015-08-25 Ilias Diakonikolas , Daniel M. Kane , Vladimir Nikishkin

We consider 1-dimensional location estimation, where we estimate a parameter $\lambda$ from $n$ samples $\lambda + \eta_i$, with each $\eta_i$ drawn i.i.d. from a known distribution $f$. For fixed $f$ the maximum-likelihood estimate (MLE)…

Statistics Theory · Mathematics 2022-07-20 Shivam Gupta , Jasper C. H. Lee , Eric Price , Paul Valiant

We consider distributed statistical optimization in one-shot setting, where there are $m$ machines each observing $n$ i.i.d. samples. Based on its observed samples, each machine sends a $B$-bit-long message to a server. The server then…

Machine Learning · Computer Science 2020-01-01 Saber Salehkaleybar , Arsalan Sharifnassab , S. Jamaloddin Golestani