English
Related papers

Related papers: Approximate Maximum Likelihood for Complex Structu…

200 papers

Empirical likelihood method has been applied to short-memory time series models by Monti (1997) through the Whittle's estimation method. Yau (2012) extended this idea to long-memory time series models. Asymptotic distributions of the…

Methodology · Statistics 2016-04-22 Ramadha D. Piyadi Gamage , Wei Ning , Arjun K. Gupta

Model approximations are common practice when estimating structural or quasi-structural models. The paper considers the econometric properties of estimators that utilize projections to reimpose information about the exact model in the form…

Econometrics · Economics 2024-03-05 Andreas Tryphonides

With modern high-dimensional data, complex statistical models are necessary, requiring computationally feasible inference schemes. We introduce Max-and-Smooth, an approximate Bayesian inference scheme for a flexible class of latent Gaussian…

Models defined by moment conditions are at the center of structural econometric estimation, but economic theory is mostly agnostic about moment selection. While a large pool of valid moments can potentially improve estimation efficiency, in…

Econometrics · Economics 2023-11-15 Jinyuan Chang , Zhentao Shi , Jia Zhang

We study the estimation of a high dimensional approximate factor model in the presence of both cross sectional dependence and heteroskedasticity. The classical method of principal components analysis (PCA) does not efficiently estimate the…

Methodology · Statistics 2012-10-01 Jushan Bai , Yuan Liao

With a view to statistical inference for discretely observed diffusion models, we propose simple methods of simulating diffusion bridges, approximately and exactly. Diffusion bridge simulation plays a fundamental role in likelihood and…

Statistics Theory · Mathematics 2014-03-10 Mogens Bladt , Michael Sørensen

The observations in many applications consist of counts of discrete events, such as photons hitting a dector, which cannot be effectively modeled using an additive bounded or Gaussian noise model, and instead require a Poisson noise model.…

Optimization and Control · Mathematics 2016-11-17 Zachary T. Harmany , Roummel F. Marcia , Rebecca M. Willett

Simulation models of complex dynamics in the natural and social sciences commonly lack a tractable likelihood function, rendering traditional likelihood-based statistical inference impossible. Recent advances in machine learning have…

Machine Learning · Statistics 2022-02-24 Joel Dyer , Patrick Cannon , Sebastian M Schmon

Recent likelihood theory produces $p$-values that have remarkable accuracy and wide applicability. The calculations use familiar tools such as maximum likelihood values (MLEs), observed information and parameter rescaling. The usual…

Methodology · Statistics 2008-02-08 M. Bédard , D. A. S. Fraser , A. Wong

A crucial step in fitting a regression model to data is determining the model's structure, i.e., the subset of explanatory variables to be included. However, the uncertainty in this step is often overlooked due to a lack of satisfactory…

Methodology · Statistics 2025-11-13 Ryan Martin , Naomi Singer , Jonathan Williams

Modelling highly multi-modal data is a challenging problem in machine learning. Most algorithms are based on maximizing the likelihood, which corresponds to the M(oment)-projection of the data distribution to the model distribution. The…

Machine Learning · Computer Science 2020-01-24 Philipp Becker , Oleg Arenz , Gerhard Neumann

Approximate Bayesian inference on the basis of summary statistics is well-suited to complex problems for which the likelihood is either mathematically or computationally intractable. However the methods that use rejection suffer from the…

Computation · Statistics 2010-05-04 M. G. B. Blum , O. Francois

Parsimony, including sparsity and low rank, has been shown to successfully model data in numerous machine learning and signal processing tasks. Traditionally, such modeling approaches rely on an iterative algorithm that minimizes an…

Machine Learning · Computer Science 2012-12-18 Pablo Sprechmann , Alex M. Bronstein , Guillermo Sapiro

Considering the increasing size of available data, the need for statistical methods that control the finite sample bias is growing. This is mainly due to the frequent settings where the number of variables is large and allowed to increase…

Statistics Theory · Mathematics 2018-10-12 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

In-context learning (ICL) allows Transformers to adapt to novel tasks without weight updates, yet the underlying algorithms remain poorly understood. We adopt a statistical decision-theoretic perspective by investigating simple binary…

Machine Learning · Computer Science 2026-03-13 Faris Chaudhry , Siddhant Gadkari

Generalized empirical likelihood and generalized method of moments are well spread methods of resolution of inverse problems in econometrics. Each method defines a specific semiparametric model for which it is possible to calculate…

Statistics Theory · Mathematics 2010-11-24 Paul Rochet

Recent advances in Markov chain Monte Carlo (MCMC) extend the scope of Bayesian inference to models for which the likelihood function is intractable. Although these developments allow us to estimate model parameters, other basic problems…

Computation · Statistics 2019-12-12 Minh-Ngoc Tran , Marcel Scharth , David Gunawan , Robert Kohn , Scott D. Brown , Guy E. Hawkins

Bayesian inference for Continuous-Time Markov Chains (CTMCs) on countably infinite spaces is notoriously difficult because evaluating the likelihood exactly is intractable. One way to address this challenge is to first build a non-negative…

Computation · Statistics 2021-05-31 Miguel Biron-Lattes , Alexandre Bouchard-Côté , Trevor Campbell

Use of machine learning to estimate nuisance functions (e.g. outcomes models, propensity score models) in estimators used in causal inference is increasingly common, as it can mitigate bias due to model misspecification. However, it can be…

Methodology · Statistics 2025-07-17 Rachael K. Ross , Lina M. Montoya , Dana E. Goin , Ivan Diaz , Audrey Renson

Simulators often provide the best description of real-world phenomena. However, they also lead to challenging inverse problems because the density they implicitly define is often intractable. We present a new suite of simulation-based…

Machine Learning · Statistics 2020-02-25 Johann Brehmer , Gilles Louppe , Juan Pavez , Kyle Cranmer