English
Related papers

Related papers: Parameter-Covariance Maximum Likelihood Estimation

200 papers

Multivariable parametric models are critical for designing, controlling, and optimizing the performance of engineered systems. The main aim of this paper is to develop a parametric identification strategy that delivers accurate and…

Signal Processing · Electrical Eng. & Systems 2025-07-01 Maarten van der Hulst , Rodrigo González , Koen Classens , Nic Dirkx , Jeroen van de Wijdeven , Tom Oomen

We propose convenient inferential methods for potentially nonstationary multivariate unobserved components models with fractional integration and cointegration. Based on finite-order ARMA approximations in the state space representation,…

Econometrics · Economics 2020-11-10 Tobias Hartl , Roland Weigand

An emerging number of modern applications involve forecasting time series data that exhibit both short-time dynamics and long-time seasonality. Specifically, time series with multiple seasonality is a difficult task with comparatively fewer…

Machine Learning · Computer Science 2020-08-31 Tianyang Xie , Jie Ding

In contrast to the popular Cox model which presents a multiplicative covariate effect specification on the time to event hazards, the semiparametric additive risks model (ARM) offers an attractive additive specification, allowing for direct…

Methodology · Statistics 2022-03-21 Tong Wang , Dipankar Bandyopadhyay , Samiran Sinha

We develop a family of accelerated stochastic algorithms that minimize sums of convex functions. Our algorithms improve upon the fastest running time for empirical risk minimization (ERM), and in particular linear least-squares regression,…

Machine Learning · Statistics 2015-06-25 Roy Frostig , Rong Ge , Sham M. Kakade , Aaron Sidford

Model instability and poor prediction of long-term behavior are common problems when modeling dynamical systems using nonlinear "black-box" techniques. Direct optimization of the long-term predictions, often called simulation error…

Systems and Control · Computer Science 2017-01-25 Mark M. Tobenkin , Ian R. Manchester , Alexandre Megretski

We study semiparametric time series models with innovations following a log-concave distribution. We propose a general maximum likelihood framework which allows us to estimate simultaneously the parameters of the model and the density of…

Methodology · Statistics 2018-01-30 Yining Chen

Graph-based techniques emerged as a choice to deal with the dimensionality issues in modeling multivariate time series. However, there is yet no complete understanding of how the underlying structure could be exploited to ease this task.…

Signal Processing · Electrical Eng. & Systems 2019-10-02 Elvin Isufi , Andreas Loukas , Nathanael Perraudin , Geert Leus

The modeling of time-varying graph signals as stationary time-vertex stochastic processes permits the inference of missing signal values by efficiently employing the correlation patterns of the process across different graph nodes and time…

Machine Learning · Statistics 2023-10-16 Eylem Tugce Guneyi , Berkay Yaldiz , Abdullah Canbolat , Elif Vural

In this paper we derive the asymptotic properties of the least squares estimator (LSE) of autoregressive moving-average (ARMA) models with regime changes under the assumption that the errors are uncorrelated but not necessarily independent.…

Statistics Theory · Mathematics 2019-07-11 Yacouba Boubacar Maïnassara , Landy Rabehasaina

This paper presents a new parameter estimation algorithm for the adaptive control of a class of time-varying plants. The main feature of this algorithm is a matrix of time-varying learning rates, which enables parameter estimation error…

Optimization and Control · Mathematics 2021-11-18 Joseph E. Gaudio , Anuradha M. Annaswamy , Eugene Lavretsky , Michael A. Bolender

Estimating hidden processes from non-linear noisy observations is particularly difficult when the parameters of these processes are not known. This paper adopts a machine learning approach to devise variational Bayesian inference for such…

Machine Learning · Computer Science 2019-11-05 Komlan Atitey , Pavel Loskot , Lyudmila Mihaylova

This work is devoted to functional ARMA$(p, q)$ processes and approximating vector models based on functional PCA in the context of prediction. After deriving sufficient conditions for the existence of a stationary solution to both the…

Methodology · Statistics 2023-12-12 J. Klepsch , C. Klüppelberg , T. Wei

Max-autogressive moving average (Max-ARMA) processes are powerful tools for modelling time series data with heavy-tailed behaviour; these are a non-linear version of the popular autoregressive moving average models. River flow data…

Methodology · Statistics 2024-03-26 Eleanor D'Arcy , Jonathan A Tawn

The paper considers the problem to estimate a graphical model corresponding to an autoregressive moving-average (ARMA) Gaussian stochastic process. We propose a new maximum entropy covariance and cepstral extension problem and we show that…

Optimization and Control · Mathematics 2023-08-29 Mattia Zorzi

Stationary processes have been extensively studied in the literature. Their applications include modeling and forecasting numerous real life phenomena such as natural disasters, sales and market movements. When stationary processes are…

Statistics Theory · Mathematics 2018-01-10 Marko Voutilainen , Lauri Viitasaari , Pauliina Ilmonen

In this paper we propose a new optimization model for maximum likelihood estimation of causal and invertible ARMA models. Through a set of numerical experiments we show how our proposed model outperforms, both in terms of quality of the…

Optimization and Control · Mathematics 2022-01-27 Leonardo Di Gangi , Matteo Lapucci , Fabio Schoen , Alessio Sortino

A recently proposed convex formulation of the phase retrieval problem estimates the unknown signal by solving a simple linear program. This new scheme, known as PhaseMax, is computationally efficient compared to standard convex relaxation…

Information Theory · Computer Science 2017-10-17 Oussama Dhifallah , Christos Thrampoulidis , Yue M. Lu

In the past four decades, research on count time series has made significant progress, but research on $\mathbb{Z}$-valued time series is relatively rare. Existing $\mathbb{Z}$-valued models are mainly of autoregressive structure, where the…

Methodology · Statistics 2024-02-27 Christian H. Weiß , Fukang Zhu

Accurately modeling and verifying the correct operation of systems interacting in dynamic environments is challenging. By leveraging parametric uncertainty within the model description, one can relax the requirement to describe exactly the…

Optimization and Control · Mathematics 2016-04-05 Patrick Holmes , Shreyas Kousik , Shankar Mohan , Ram Vasudevan