English
Related papers

Related papers: Parameter-Covariance Maximum Likelihood Estimation

200 papers

We develop a new efficient sequential approximate leverage score algorithm, SALSA, using methods from randomized numerical linear algebra (RandNLA) for large matrices. We demonstrate that, with high probability, the accuracy of SALSA's…

Machine Learning · Statistics 2024-01-02 Ali Eshragh , Luke Yerbury , Asef Nazari , Fred Roosta , Michael W. Mahoney

In this paper, the parameter estimation of ARMA(p,q) model is given by approximate Bayesian computation algorithm. In order to improve the sampling efficiency of the algorithm, approximate Bayesian computation should select as many…

Computation · Statistics 2019-05-01 Linghui Li , Anshui Li , Huizeng Zhang

Statistically simulated time series of wave parameters are required for many coastal and offshore engineering applications, often at the resolution of approximately one hour. Various studies have relied on autoregressive moving-average…

Applications · Statistics 2018-10-31 Wiebke S. Jäger , Thomas Nagler , Claudia Czado , Robert T. McCall

In this paper, we consider the problem of estimating parameters of a linear regression model. Using a hybrid systems framework, a hybrid algorithm is proposed allowing the estimate to converge to the exact value of the unknown parameters in…

Systems and Control · Electrical Eng. & Systems 2026-03-04 Adnane Saoud , Ryan S. Johnson , Ricardo G. Sanfelice

Multi-objective test-time alignment aims to adapt large language models (LLMs) to diverse multi-dimensional user preferences during inference while keeping LLMs frozen. Recently, GenARM (Xu et al., 2025) first independently trains…

Machine Learning · Computer Science 2025-05-13 Baijiong Lin , Weisen Jiang , Yuancheng Xu , Hao Chen , Ying-Cong Chen

This paper presents a comprehensive framework for time series prediction using a hybrid model that combines ARIMA and LSTM. The model incorporates feature engineering techniques, including embedding and PCA, to transform raw data into a…

Machine Learning · Computer Science 2025-02-12 Chang Liu , Chengcheng Ma , XuanQi Zhou

This paper addresses the problem of recursive set-membership identification for linear time varying (LTV) systems when both input and output measurements are affected by bounded additive noise. First we formulate the problem of online…

Optimization and Control · Mathematics 2021-07-06 Sophie M. Fosson , Diego Regruto , Talal Abdalla , Abdul Salam

This article considers a nonparametric method for detecting change points in non-stationary time series. The proposed method will divide the time series into several segments so that between two adjacent segments, the normalized spectral…

Statistics Theory · Mathematics 2020-11-05 Zixiang Guan , Gemai Chen

We consider optimal regimes for algorithm-assisted human decision-making. Such regimes are decision functions of measured pre-treatment variables and, by leveraging natural treatment values, enjoy a "superoptimality" property whereby they…

Methodology · Statistics 2024-02-23 Mats J. Stensrud , Julien Laurendeau , Aaron L. Sarvet

The paper introduces the first formulation of convex Q-learning for Markov decision processes with function approximation. The algorithms and theory rest on a relaxation of a dual of Manne's celebrated linear programming characterization of…

Optimization and Control · Mathematics 2023-09-12 Fan Lu , Sean Meyn

We develop a framework for convexifying a fairly general class of optimization problems. Under additional assumptions, we analyze the suboptimality of the solution to the convexified problem relative to the original nonconvex problem and…

Systems and Control · Computer Science 2014-06-04 Krishnamurthy Dvijotham , Maryam Fazel , Emanuel Todorov

We propose an automaton model which is a combination of symbolic and register automata, i.e., we enrich symbolic automata with memory. We call such automata Register Match Automata (RMA). RMA extend the expressive power of symbolic…

Formal Languages and Automata Theory · Computer Science 2018-06-12 Elias Alevizos , Alexander Artikis , Georgios Paliouras

We present novel analysis and algorithms for solving sparse phase retrieval and sparse principal component analysis (PCA) with convex lifted matrix formulations. The key innovation is a new mixed atomic matrix norm that, when used as…

Statistics Theory · Mathematics 2024-04-22 Andrew D. McRae , Justin Romberg , Mark A. Davenport

We study adaptive approximation algorithms for general multivariate linear problems where the sets of input functions are non-convex cones. While it is known that adaptive algorithms perform essentially no better than non-adaptive…

Numerical Analysis · Mathematics 2019-03-27 Yuhan Ding , Fred J. Hickernell , Peter Kritzer , Simon Mak

We propose a new method to design adaptation algorithms that guarantee a certain prescribed level of performance and are applicable to systems with nonconvex parameterization. The main idea behind the method is, given the desired…

Optimization and Control · Mathematics 2007-05-23 I. Y. Tyukin , D. V. Prokhorov , Cees van Leeuwen

In this paper, a systematic approach is developed to embed the dynamical description of a nonlinear system into a linear parameter-varying (LPV) system representation. Initially, the nonlinear functions in the model representation are…

Systems and Control · Electrical Eng. & Systems 2020-11-09 Arash Sadeghzadeh , Roland Toth

We study the problem of estimating multiple predictive functions from a dictionary of basis functions in the nonparametric regression setting. Our estimation scheme assumes that each predictive function can be estimated in the form of a…

Machine Learning · Computer Science 2012-06-05 Jianhui Chen , Jieping Ye

We propose an algorithm to actively estimate the parameters of a linear dynamical system. Given complete control over the system's input, our algorithm adaptively chooses the inputs to accelerate estimation. We show a finite time bound…

Machine Learning · Computer Science 2020-06-23 Andrew Wagenmaker , Kevin Jamieson

The spatio-temporal autoregressive moving average (STARMA) model is frequently used in several studies of multivariate time series data, where the assumption of stationarity is important, but it is not always guaranteed in practice. One way…

Methodology · Statistics 2023-04-14 Yangyang Chen , Pedro Alberto Morettin , Chang Chiann

This paper presents a discrete-time nonlinear system identification method while satisfying the stability and safety properties of the system with high probability. An Extreme Learning Machine (ELM) is used with a Gaussian assumption on the…

Systems and Control · Electrical Eng. & Systems 2022-10-04 Iman Salehi , Tyler Taplin , Ashwin P. Dani