English
Related papers

Related papers: Likelihood Inference for Possibly Non-Stationary P…

200 papers

This paper proposes maximum (quasi)likelihood estimation for high dimensional factor models with regime switching in the loadings. The model parameters are estimated jointly by the EM (expectation maximization) algorithm, which in the…

Econometrics · Economics 2023-04-11 Giovanni Urga , Fa Wang

Likelihood-based inference for multivariate extreme-value models is often unreliable or infeasible when likelihoods are intractable or supports are discrete. This challenge is particularly acute for multivariate discrete generalized Pareto…

Applications · Statistics 2026-05-28 Samira Aka , Marie Kratz , Philippe Naveau

Fast Incremental Expectation Maximization (FIEM) is a version of the EM framework for large datasets. In this paper, we first recast FIEM and other incremental EM type algorithms in the {\em Stochastic Approximation within EM} framework.…

Machine Learning · Computer Science 2021-01-01 Gersende Fort , P. Gach , E. Moulines

This paper introduces the first theoretical framework for quantifying the efficiency and performance gain opportunity size of adaptive inference algorithms. We provide new approximate and exact bounds for the achievable efficiency and…

Machine Learning · Computer Science 2024-02-08 Soheil Hor , Ying Qian , Mert Pilanci , Amin Arbabian

Whether stochastic or parametric, the Pareto/NBD model can only be utilized for an in-sample prediction rather than an out-of-sample prediction. This research thus provides a neural network based extension of the Pareto/NBD model to…

Applications · Statistics 2019-11-06 Shao-Ming Xie

Random graph mixture models are now very popular for modeling real data networks. In these setups, parameter estimation procedures usually rely on variational approximations, either combined with the expectation-maximisation (\textsc{em})…

Statistics Theory · Mathematics 2010-12-09 Christophe Ambroise , Catherine Matias

Deep learning algorithms have recently shown to be a successful tool in estimating parameters of statistical models for which simulation is easy, but likelihood computation is challenging. But the success of these approaches depends on…

Machine Learning · Statistics 2024-02-20 Amanda Lenzi , Haavard Rue

Likelihood-free methods perform parameter inference in stochastic simulator models where evaluating the likelihood is intractable but sampling synthetic data is possible. One class of methods for this likelihood-free problem uses a…

Machine Learning · Statistics 2020-12-21 Conor Durkan , Iain Murray , George Papamakarios

Obtaining initial conditions and parameterizations leading to a model consistent with available measurements or safety specifications is important for many applications. Examples include model (in-)validation, prediction, fault diagnosis,…

Optimization and Control · Mathematics 2013-03-20 Stefan Streif , Philipp Rumschinski , Didier Henrion , Rolf Findeisen

An adaptive inference method for crossbar (AIDX) is presented based on an optimization scheme for adjusting the duration and amplitude of input voltage pulses. AIDX minimizes the long-term effects of memristance drift on artificial neural…

Emerging Technologies · Computer Science 2020-09-02 Tony Liu , Amirali Amirsoleimani , Fabien Alibart , Serge Ecoffey , Dominique Drouin , Roman Genov

We consider the non-parametric Poisson regression problem where the integer valued response $Y$ is the realization of a Poisson random variable with parameter $\lambda(X)$. The aim is to estimate the functional parameter $\lambda$ from…

Statistics Theory · Mathematics 2018-05-14 Martin Kroll

In this paper we present a robust estimator for the parameters of a continuous-time ARMA(p,q) (CARMA(p,q)) process sampled equidistantly which is not necessarily Gaussian. Therefore, an indirect estimation procedure is used. It is an…

Statistics Theory · Mathematics 2019-11-11 Vicky Fasen-Hartmann , Sebastian Kimmig

Statistical models are often structurally unidentifiable, because different sets of parameters can lead to equal model outcomes. To be useful for prediction and parameter inference from data, stochastic population models need to be…

Populations and Evolution · Quantitative Biology 2025-03-19 Jose A. Capitan , David Alonso

Uncertainty propagation in high-dimensional nonlinear dynamic structural systems is pivotal in state-of-the-art performance-based design and risk assessment, where uncertainties from both excitations and structures, i.e., the aleatoric…

Machine Learning · Computer Science 2026-04-03 Manisha Sapkota , Min Li , Bowei Li

Ordinary differential equation models have become a standard tool for the mechanistic description of biochemical processes. If parameters are inferred from experimental data, such mechanistic models can provide accurate predictions about…

Quantitative Methods · Quantitative Biology 2018-10-12 Fabian Fröhlich , Carolin Loos , Jan Hasenauer

We study the use of Temporal-Difference learning for estimating the structural parameters in dynamic discrete choice models. Our algorithms are based on the conditional choice probability approach but use functional approximations to…

Econometrics · Economics 2022-12-23 Karun Adusumilli , Dita Eckardt

Fitting autoregressive moving average (ARMA) time series models requires model identification before parameter estimation. Model identification involves determining the order of the autoregressive and moving average components which is…

Computation · Statistics 2024-04-09 Yin Liu , Sam Davanloo Tajbakhsh

Let us assume that $f$ is a continuous function defined on the unit ball of $\mathbb R^d$, of the form $f(x) = g (A x)$, where $A$ is a $k \times d$ matrix and $g$ is a function of $k$ variables for $k \ll d$. We are given a budget $m \in…

Numerical Analysis · Mathematics 2012-01-18 Massimo Fornasier , Karin Schnass , Jan Vybiral

We present a hybrid scheme for the parameter and state estimation of nonlinear continuous-time systems, which is inspired by the supervisory setup used for control. State observers are synthesized for some nominal parameter values and a…

Optimization and Control · Mathematics 2016-11-18 Michelle S. Chong , Dragan Nešić , Romain Postoyan , Levin Kuhlmann

Adapting large language models (LLMs) to downstream tasks via full fine-tuning is increasingly impractical due to its computational and memory demands. Parameter-efficient fine-tuning (PEFT) approaches such as Low-Rank Adaptation (LoRA)…

Machine Learning · Computer Science 2026-05-19 Jing Gao , Zhong-Yi Lu , Pan Zhang , Ze-Feng Gao