English
Related papers

Related papers: Modeling of Missing Dynamical Systems: Deriving Pa…

200 papers

In this paper, we study nonparametric models allowing for locally stationary regressors and a regression function that changes smoothly over time. These models are a natural extension of time series models with time-varying coefficients. We…

Statistics Theory · Mathematics 2013-02-19 Michael Vogt

Under the reproducing kernel Hilbert spaces (RKHS), we consider the penalized least-squares of the partially functional linear models (PFLM), whose predictor contains both functional and traditional multivariate parts, and the multivariate…

Statistics Theory · Mathematics 2022-10-03 Huiming Zhang , Xiaoyu Lei

This work presents the concept of kernel mean embedding and kernel probabilistic programming in the context of stochastic systems. We propose formulations to represent, compare, and propagate uncertainties for fairly general stochastic…

Machine Learning · Statistics 2020-05-05 Jia-Jie Zhu , Krikamol Muandet , Moritz Diehl , Bernhard Schölkopf

Model inference for dynamical systems aims to estimate the future behaviour of a system from observations. Purely model-free statistical methods, such as Artificial Neural Networks, tend to perform poorly for such tasks. They are therefore…

Machine Learning · Computer Science 2019-08-07 David K. E. Green , Filip Rindler

In a general context of positive definite kernels $k$, we develop tools and algorithms for sampling in reproducing kernel Hilbert space $\mathscr{H}$ (RKHS). With reference to these RKHSs, our results allow inference from samples; more…

Functional Analysis · Mathematics 2016-01-28 Palle Jorgensen , Feng Tian

Hidden Markov Models (HMMs) comprise a powerful generative approach for modeling sequential data and time-series in general. However, the commonly employed assumption of the dependence of the current time frame to a single or multiple…

Machine Learning · Computer Science 2021-09-13 Konstantinos P. Panousis , Sotirios Chatzis , Sergios Theodoridis

Consider a multi-variate time series $(X_t)_{t=0}^{T}$ where $X_t \in \mathbb{R}^d$ which may represent spike train responses for multiple neurons in a brain, crime event data across multiple regions, and many others. An important challenge…

Machine Learning · Statistics 2018-01-26 Hao Henry Zhou , Garvesh Raskutti

Motivated by the surge of interest in Koopman operator theory, we propose a machine-learning alternative based on a functional Bayesian perspective for operator-theoretic modeling of unknown, data-driven, nonlinear dynamical systems. This…

Machine Learning · Computer Science 2024-11-04 Kan Li , José C. Príncipe

Accurate models are essential for design, performance prediction, control, and diagnostics in complex engineering systems. Physics-based models excel during the design phase but often become outdated during system deployment due to changing…

Machine Learning · Computer Science 2025-01-22 Zihan Liu , Prashant N. Kambali , C. Nataraj

We merge computational mechanics' definition of causal states (predictively-equivalent histories) with reproducing-kernel Hilbert space (RKHS) representation inference. The result is a widely-applicable method that infers causal structure…

Machine Learning · Computer Science 2024-06-19 Nicolas Brodu , James P. Crutchfield

This work introduces a method for learning low-dimensional models from data of high-dimensional black-box dynamical systems. The novelty is that the learned models are exactly the reduced models that are traditionally constructed with model…

Numerical Analysis · Mathematics 2019-08-30 Benjamin Peherstorfer

Existing spatio-temporal Hawkes process models typically rely on either parametric or semiparametric assumptions, limiting the model's ability to capture complex endogenous and exogenous event dynamics. We propose a fully Bayesian…

Methodology · Statistics 2026-03-31 Wenqing Liu , Xenia Miscouridou , Déborah Sulem

There is much interest in the Hierarchical Dirichlet Process Hidden Markov Model (HDP-HMM) as a natural Bayesian nonparametric extension of the ubiquitous Hidden Markov Model for learning from sequential and time-series data. However, in…

Methodology · Statistics 2012-09-11 Matthew J. Johnson , Alan S. Willsky

We present a projection-based, stability-preserving methodology for computing time correlation functions in open quantum systems governed by generalized quantum master equations with non-Markovian effects. Building upon the memory kernel…

Quantum Physics · Physics 2026-02-12 Wei Liu , Rui-Hao Bi , Yu Su , Limin Xu , Zhennan Zhou , Yao Wang , Wenjie Dou

The Koopman operator provides a powerful framework for representing the dynamics of general nonlinear dynamical systems. Data-driven techniques to learn the Koopman operator typically assume that the chosen function space is closed under…

Machine Learning · Statistics 2025-02-06 Boya Hou , Sina Sanjari , Nathan Dahlin , Alec Koppel , Subhonmesh Bose

We illustrate a class of conditional models for the analysis of longitudinal data suffering attrition in random effects models framework, where the subject-specific random effects are assumed to be discrete and to follow a time-dependent…

Methodology · Statistics 2014-04-28 Antonello Maruotti

Kernel mean embeddings, a widely used technique in machine learning, map probability distributions to elements of a reproducing kernel Hilbert space (RKHS). For supervised learning problems, where input-output pairs are observed, the…

Machine Learning · Statistics 2024-10-24 Ambrus Tamás , Balázs Csanád Csáji

A precise understanding of the influence of a quantum system's environment on its dynamics, which is at the heart of the theory of open quantum systems, is crucial for further progress in the development of controllable large-scale quantum…

Quantum Physics · Physics 2022-10-10 I. A. Luchnikov , E. O. Kiktenko , M. A. Gavreev , H. Ouerdane , S. N. Filippov , A. K. Fedorov

In this work, we propose a novel deep bootstrap framework for nonparametric regression based on conditional diffusion models. Specifically, we construct a conditional diffusion model to learn the distribution of the response variable given…

Machine Learning · Statistics 2026-02-12 Jinyuan Chang , Yuling Jiao , Lican Kang , Junjie Shi

We propose a novel adaptive learning algorithm based on iterative orthogonal projections in the Cartesian product of multiple reproducing kernel Hilbert spaces (RKHSs). The task is estimating/tracking nonlinear functions which are supposed…

Machine Learning · Computer Science 2015-10-28 Masahiro Yukawa