English
Related papers

Related papers: Stochastic parameterization with VARX processes

200 papers

We revisit a model for time-varying linear regression that assumes the unknown parameters evolve according to a linear dynamical system. Counterintuitively, we show that when the underlying dynamics are stable the parameters of this model…

Statistics Theory · Mathematics 2022-01-03 Ali Jadbabaie , Horia Mania , Devavrat Shah , Suvrit Sra

A semi-parametric, non-linear regression model in the presence of latent variables is introduced. These latent variables can correspond to unmodeled phenomena or unmeasured agents in a complex networked system. This new formulation allows…

Machine Learning · Statistics 2018-06-29 Jonathan Mei , José M. F. Moura

Given a set of response observations for a parametrized dynamical system, we seek a parametrized dynamical model that will yield uniformly small response error over a range of parameter values yet has low order. Frequently, access to…

Numerical Analysis · Mathematics 2018-08-20 Alexander Grimm , Christopher Beattie , Zlatko Drmač , Serkan Gugercin

In this paper we propose a framework to analyze iterative first-order optimization algorithms for time-varying convex optimization. We assume that the temporal variability is caused by a time-varying parameter entering the objective, which…

Optimization and Control · Mathematics 2026-03-05 Fabian Jakob , Andrea Iannelli

In this paper, we consider the learning of a Reduced-Order Linear Parameter-Varying Model (ROLPVM) of a nonlinear dynamical system based on data. This is achieved by a two-step procedure. In the first step, we learn a projection to a lower…

Systems and Control · Electrical Eng. & Systems 2024-05-21 Patrick J. W. Koelewijn , Rajiv Sing , Peter Seiler , Roland Tóth

Jointly modeling and forecasting economic and financial variables across a large set of countries has long been a significant challenge. Two primary approaches have been utilized to address this issue: the vector autoregressive model with…

Machine Learning · Statistics 2025-03-12 Sanyou Wu , Dan Yang , Yan Xu , Long Feng

We study low-rank matrix regression in settings where matrix-valued predictors and scalar responses are observed across multiple individuals. Rather than assuming a fully homogeneous coefficient matrices across individuals, we accommodate…

Methodology · Statistics 2025-10-28 Di Wang , Xiaoyu Zhang , Guodong Li , Wenyang Zhang

Motivated by the desire to understand stochastic algorithms for nonconvex optimization that are robust to their hyperparameter choices, we analyze a mini-batched prox-linear iterative algorithm for the problem of recovering an unknown…

Optimization and Control · Mathematics 2024-02-05 Mengqi Lou , Kabir Aladin Verchand , Ashwin Pananjady

We present a new theoretical framework for designing linear parameter varying controllers in the polynomial chaos framework. We assume the scheduling variable to be random and apply polynomial chaos approach to synthesize the controller for…

Optimization and Control · Mathematics 2017-11-13 Shao-Chen Hsu , Raktim Bhattacharya

In this paper we study variational inequalities (VI) defined by the conditional value-at-risk (CVaR) of uncertain functions. We introduce stochastic approximation schemes that employ an empirical estimate of the CVaR at each iteration to…

Optimization and Control · Mathematics 2020-08-28 Jasper Verbree , Ashish Cherukuri

Modern data sets, such as those in healthcare and e-commerce, are often derived from many individuals or systems but have insufficient data from each source alone to separately estimate individual, often high-dimensional, model parameters.…

Machine Learning · Computer Science 2024-11-14 Maryann Rui , Thibaut Horel , Munther Dahleh

We present a Bayesian non-parametric way of inferring stochastic differential equations for both regression tasks and continuous-time dynamical modelling. The work has high emphasis on the stochastic part of the differential equation, also…

Machine Learning · Statistics 2020-06-29 Martin Jørgensen , Marc Peter Deisenroth , Hugh Salimbeni

We consider the problem of fitting variational posterior approximations using stochastic optimization methods. The performance of these approximations depends on (1) how well the variational family matches the true posterior…

There has been considerable recent interest in Bayesian modeling of high-dimensional networks via latent space approaches. When the number of nodes increases, estimation based on Markov Chain Monte Carlo can be extremely slow and show poor…

Computation · Statistics 2022-05-30 Emanuele Aliverti , Massimiliano Russo

Linear parameter-varying (LPV) systems with uncertainty in time-varying delays are subject to performance degradation and instability. In this line, we investigate the stability of such systems invoking an input-output stability approach.…

Systems and Control · Electrical Eng. & Systems 2020-04-10 Shahin Tasoujian , Saeed Salavati , Karolos Grigoriadis , Matthew Franchek

This paper considers the problem of matrix-variate logistic regression. It derives the fundamental error threshold on estimating low-rank coefficient matrices in the logistic regression problem by obtaining a lower bound on the minimax…

Machine Learning · Computer Science 2022-05-10 Batoul Taki , Mohsen Ghassemi , Anand D. Sarwate , Waheed U. Bajwa

High-dimensional vector autoregressive (VAR) models have numerous applications in fields such as econometrics, biology, climatology, among others. While prior research has mainly focused on linear VAR models, these approaches can be…

Statistics Theory · Mathematics 2025-11-25 Yuefeng Han , Likai Chen , Wei Biao Wu

We study the performance of sparse regression methods and propose new techniques to distill the governing equations of dynamical systems from data. We first look at the generic methodology of learning interpretable equation forms from data,…

Machine Learning · Computer Science 2019-03-25 Chinmay S. Kulkarni

In this paper an identification method for state-space LPV models is presented. The method is based on a particular parameterization that can be written in linear regression form and enables model estimation to be handled using…

Optimization and Control · Mathematics 2018-03-28 R. A. Romano , P. Lopes dos Santos , Felipe Pait , T-P Perdicoúlis , José A. Ramos

The objective of the present paper is to develop a minimax theory for the varying coefficient model in a non-asymptotic setting. We consider a high-dimensional sparse varying coefficient model where only few of the covariates are present…

Statistics Theory · Mathematics 2014-05-16 Olga Klopp , Marianna Pensky