English
Related papers

Related papers: Inference and Learning of Nonlinear LFR State-Spac…

200 papers

In this paper, we study the estimation of partially linear models for spatial data distributed over complex domains. We use bivariate splines over triangulations to represent the nonparametric component on an irregular two-dimensional…

Statistics Theory · Mathematics 2021-06-03 Li Wang , Guannan Wang , Min-Jun Lai , Lei Gao

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

Machine Learning · Statistics 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

We propose an algorithm for designing optimal inputs for on-line Bayesian identification of stochastic non-linear state-space models. The proposed method relies on minimization of the posterior Cram\'er Rao lower bound derived for the model…

Applications · Statistics 2013-07-25 Aditya Tulsyan , Swanand R. Khare , Biao Huang , R. Bhushan Gopaluni , J. Fraser Forbes

The short-time Fourier transform (STFT) is widely used for analyzing non-stationary signals. However, its performance is highly sensitive to its parameters, and manual or heuristic tuning often yields suboptimal results. To overcome this…

Sound · Computer Science 2025-06-27 Maxime Leiber , Yosra Marnissi , Axel Barrau , Sylvain Meignen , Laurent Massoulié

Complex computer simulations are commonly required for accurate data modelling in many scientific disciplines, making statistical inference challenging due to the intractability of the likelihood evaluation for the observed data.…

Machine Learning · Statistics 2019-10-02 Pablo de Castro , Tommaso Dorigo

When classical particle filtering algorithms are used for maximum likelihood parameter estimation in nonlinear state-space models, a key challenge is that estimates of the likelihood function and its derivatives are inherently noisy. The…

Computation · Statistics 2017-11-30 Andreas Svensson , Fredrik Lindsten , Thomas B. Schön

Linear regression with normally distributed errors - including particular cases such as ANOVA, Student's t-test or location-scale inference - is a widely used statistical procedure. In this case the ordinary least squares estimator…

Methodology · Statistics 2019-09-18 Alain Desgagné

Intelligent real-world systems critically depend on expressive information about their system state and changing operation conditions, e.g., due to variation in temperature, location, wear, or aging. To provide this information, online…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Jan-Hendrik Ewering , Björn Volkmann , Simon F. G. Ehlers , Thomas Seel , Michael Meindl

Many real-world time series exhibit strong periodic structures arising from physical laws, human routines, or seasonal cycles. However, modern deep forecasting models often fail to capture these recurring patterns due to spectral bias and a…

Machine Learning · Computer Science 2025-08-05 Menglin Kong , Vincent Zhihao Zheng , Lijun Sun

We propose a framework for modeling and estimating the state of controlled dynamical systems, where an agent can affect the system through actions and receives partial observations. Based on this framework, we propose the Predictive State…

Machine Learning · Statistics 2018-03-02 Ahmed Hefny , Carlton Downey , Geoffrey J. Gordon

Differential graphical models are designed to represent the difference between the conditional dependence structures of two groups, thus are of particular interest for scientific investigation. Motivated by modern applications, this…

Statistics Theory · Mathematics 2021-02-03 Sen Na , Mladen Kolar , Oluwasanmi Koyejo

We propose a unified framework for estimating low-rank matrices through nonconvex optimization based on gradient descent algorithm. Our framework is quite general and can be applied to both noisy and noiseless observations. In the general…

Machine Learning · Statistics 2016-10-18 Lingxiao Wang , Xiao Zhang , Quanquan Gu

We perform approximate inference in state-space models with nonlinear state transitions. Without parameterizing a generative model, we apply Bayesian update formulas using a local linearity approximation parameterized by neural networks.…

Machine Learning · Computer Science 2022-01-26 David Ruhe , Patrick Forré

We propose convenient inferential methods for potentially nonstationary multivariate unobserved components models with fractional integration and cointegration. Based on finite-order ARMA approximations in the state space representation,…

Econometrics · Economics 2020-11-10 Tobias Hartl , Roland Weigand

Previous results pertaining to algebraic state and parameter estimation of linear systems based on a special construction of a forward-backward kernel representation of linear differential invariants are extended to handle large noise in…

Systems and Control · Electrical Eng. & Systems 2021-02-02 Debarshi Patanjali Ghoshal , Hannah Michalska

We study parameter estimation in Nonlinear Factor Analysis (NFA) where the generative model is parameterized by a deep neural network. Recent work has focused on learning such models using inference (or recognition) networks; we identify a…

Machine Learning · Statistics 2017-10-18 Rahul G. Krishnan , Dawen Liang , Matthew Hoffman

In functional linear regression, the parameters estimation involves solving a non necessarily well-posed problem and it has points of contact with a range of methodologies, including statistical smoothing, deconvolution and projection on…

Statistics Theory · Mathematics 2018-01-04 Andrea Ghiglietti , Francesca Ieva , Anna Maria Paganoni , Giacomo Aletti

In this paper, a systematic approach is developed to embed the dynamical description of a nonlinear system into a linear parameter-varying (LPV) system representation. Initially, the nonlinear functions in the model representation are…

Systems and Control · Electrical Eng. & Systems 2020-11-09 Arash Sadeghzadeh , Roland Toth

On-line estimation plays an important role in process control and monitoring. Obtaining a theoretical solution to the simultaneous state-parameter estimation problem for non-linear stochastic systems involves solving complex…

Computation · Statistics 2013-07-15 Aditya Tulsyan , Biao Huang , R. Bhushan Gopaluni , J. Fraser Forbes

This paper develops a sequential-linearization feedback optimization framework for driving nonlinear dynamical systems to an optimal steady state. A fundamental challenge in feedback optimization is the requirement of accurate first-order…

Optimization and Control · Mathematics 2025-07-22 Shijie Huang , Sergio Grammatico