English
Related papers

Related papers: Consistency and Computation of Regularized MLEs fo…

200 papers

Strong consistency of the maximum likelihood estimator (MLE) for parametric Gibbs point process models is established. The setting is very general. It includes pairwise pair potentials, finite and infinite multibody interactions and…

Statistics Theory · Mathematics 2016-01-27 David Dereudre , Frédéric Lavancier

Due to its low computational cost, Lasso is an attractive regularization method for high-dimensional statistical settings. In this paper, we consider multivariate counting processes depending on an unknown function parameter to be estimated…

Statistics Theory · Mathematics 2015-04-08 Niels Richard Hansen , Patricia Reynaud-Bouret , Vincent Rivoirard

The robust improper maximum likelihood estimator (RIMLE) is a new method for robust multivariate clustering finding approximately Gaussian clusters. It maximizes a pseudo-likelihood defined by adding a component with improper constant…

Methodology · Statistics 2018-02-14 Pietro Coretto , Christian Hennig

In this paper, we mainly focus on the penalized maximum likelihood estimation (MLE) of the high-dimensional approximate factor model. Since the current estimation procedure can not guarantee the positive definiteness of the error covariance…

Computation · Statistics 2019-01-18 Shaoxin Wang , Hu Yang , Chaoli Yao

Multivariate Hawkes processes (MHPs) are versatile probabilistic tools used to model various real-life phenomena: earthquakes, operations on stock markets, neuronal activity, virus propagation and many others. In this paper, we focus on…

Machine Learning · Computer Science 2024-04-12 Katerina Hlavackova-Schindler , Anna Melnykova , Irene Tubikanec

The Laplace approximation (LA) has been proposed as a method for approximating the marginal likelihood of statistical models with latent variables. However, the approximate maximum likelihood estimators (MLEs) based on the LA are often…

Methodology · Statistics 2022-07-21 Jeongseop Han , Youngjo Lee

Enhancing generalization and uncertainty quantification in pre-trained language models (PLMs) is crucial for their effectiveness and reliability. Building on machine learning research that established the importance of robustness for…

Computation and Language · Computer Science 2024-04-02 Josip Jukić , Jan Šnajder

In this paper, we propose a sample-based moving horizon estimation (MHE) scheme for general nonlinear systems to estimate the current system state using irregularly and/or infrequently available measurements. The cost function of the MHE…

Systems and Control · Electrical Eng. & Systems 2026-03-24 Isabelle Krauss , Victor G. Lopez , Matthias A. Müller

In this paper we study the computation of the nonparametric maximum likelihood estimator (NPMLE) in multivariate mixture models. Our first approach discretizes this infinite dimensional convex optimization problem by fixing the support…

Methodology · Statistics 2024-02-20 Yangjing Zhang , Ying Cui , Bodhisattva Sen , Kim-Chuan Toh

Machine learning (ML) is increasingly becoming a helpful tool in the search for novel functional compounds. Here we use classification via random forests to predict the stability of half-Heusler (HH) compounds, using only experimentally…

Materials Science · Physics 2017-06-02 Fleur Legrain , Jesús Carrete , Ambroise van Roekeghem , Georg K. H. Madsen , Natalio Mingo

Hawkes Processes are a type of point process for modeling self-excitation, i.e., when the occurrence of an event makes future events more likely to occur. The corresponding self-triggering function of this type of process may be inferred…

Applications · Statistics 2018-06-01 Rafael Lima , Jaesik Choi

We propose an efficient algorithm for approximate computation of the profile maximum likelihood (PML), a variant of maximum likelihood maximizing the probability of observing a sufficient statistic rather than the empirical sample. The PML…

Machine Learning · Computer Science 2017-12-21 Dmitri S. Pavlichin , Jiantao Jiao , Tsachy Weissman

We introduce the Meta Highly-Adaptive-Lasso Minimum Loss Estimator (M-HAL-MLE), a novel ensemble approach for estimating functional parameters of realistically modeled data distribution from independent and identically distributed…

Methodology · Statistics 2025-07-28 Zeyi Wang , Wenxin Zhang , Brian S Caffo , Martin Lindquist , Mark van der Laan

A Maximum Likelihood recursive state estimator is derived for non-linear and non-Gaussian state-space models. The estimator combines a particle filter to generate the conditional density and the Expectation Maximization algorithm to compute…

Methodology · Statistics 2021-03-22 Mohammad S. Ramadan , Robert R. Bitmead

In this article we focus on Maximum Likelihood estimation (MLE) for the static parameters of hidden Markov models (HMMs). We will consider the case where one cannot or does not want to compute the conditional likelihood density of the…

Computation · Statistics 2012-10-18 Elena Ehrlich , Ajay Jasra , Nikolas Kantas

The advent of data science has spurred interest in estimating properties of distributions over large alphabets. Fundamental symmetric properties such as support size, support coverage, entropy, and proximity to uniformity, received most…

Information Theory · Computer Science 2016-11-29 Jayadev Acharya , Hirakendu Das , Alon Orlitsky , Ananda Theertha Suresh

Theoretical guarantees are established for a standard estimator in a semi-parametric finite mixture model, where each component density is modeled as a product of univariate densities under a conditional independence assumption. The focus…

Statistics Theory · Mathematics 2025-11-07 Marie Du Roy de Chaumaray , Michael Levine , Matthieu Marbac

Ensemble randomized maximum likelihood (EnRML) is an iterative (stochastic) ensemble smoother, used for large and nonlinear inverse problems, such as history matching and data assimilation. Its current formulation is overly complicated and…

Data Analysis, Statistics and Probability · Physics 2019-09-12 Patrick N. Raanes , Geir Evensen , Andreas S. Stordal

As Large Language Models (LLMs) and other AI systems evolve, robustly estimating their capabilities from inherently stochastic outputs while systematically quantifying uncertainty in these estimates becomes increasingly important. Further,…

Artificial Intelligence · Computer Science 2025-07-15 Lennart Luettgau , Harry Coppock , Magda Dubois , Christopher Summerfield , Cozmin Ududec

This paper introduces a novel decision-making framework that promotes consistency among decisions made by diverse models while utilizing external knowledge. Leveraging the Integer Linear Programming (ILP) framework, we map predictions from…

Artificial Intelligence · Computer Science 2024-02-07 Hossein Rajaby Faghihi , Parisa Kordjamshidi