English
Related papers

Related papers: Nonlinear system identification with regularized T…

200 papers

In this document, some general results in approximation theory and matrix analysis with applications to sparse identification of time series models and nonlinear discrete-time dynamical systems are presented. The aforementioned theoretical…

Numerical Analysis · Mathematics 2021-08-04 Fredy Vides

A main theoretical interest in biology and physics is to identify the nonlinear dynamical system (DS) that generated observed time series. Recurrent Neural Networks (RNNs) are, in principle, powerful enough to approximate any underlying DS,…

Machine Learning · Computer Science 2021-03-15 Dominik Schmidt , Georgia Koppe , Zahra Monfared , Max Beutelspacher , Daniel Durstewitz

Tensor-network Born machines (TNBMs) are quantum-inspired generative models for learning data distributions. Using tensor-network contraction and optimization techniques, the model learns an efficient representation of the target…

Machine Learning · Computer Science 2025-05-07 Matan Ben-Dov , Jing Chen

We propose a convex optimization procedure for black-box identification of nonlinear state-space models for systems that exhibit stable limit cycles (unforced periodic solutions). It extends the "robust identification error" framework in…

Optimization and Control · Mathematics 2013-03-21 Ian R. Manchester , Mark M. Tobenkin , Jennifer Wang

This paper proposes a novel method for learning highly nonlinear, multivariate functions from examples. Our method takes advantage of the property that continuous functions can be approximated by polynomials, which in turn are representable…

Machine Learning · Computer Science 2020-05-05 Sandor Szedmak , Anna Cichonska , Heli Julkunen , Tapio Pahikkala , Juho Rousu

Accurately evaluating configurational integrals for dense solids remains a central and difficult challenge in the statistical mechanics of condensed systems. Here, we present a novel tensor network approach that reformulates the…

In this paper, we introduce a type of tensor neural network based machine learning method to solve elliptic multiscale problems. Based on the special structure, we can do the direct and highly accurate high dimensional integrations for the…

Numerical Analysis · Mathematics 2024-03-26 Zhongshuo Lin , Haochen Liu , Hehu Xie

We propose a new method for blind system identification. Resorting to a Gaussian regression framework, we model the impulse response of the unknown linear system as a realization of a Gaussian process. The structure of the covariance matrix…

Systems and Control · Computer Science 2016-05-20 Giulio Bottegal , Riccardo S. Risuleo , Håkan Hjalmarsson

Block-oriented nonlinear models are popular in nonlinear system identification because of their advantages of being simple to understand and easy to use. Many different identification approaches were developed over the years to estimate the…

Systems and Control · Computer Science 2018-01-10 Maarten Schoukens , Koen Tiels

Tensor networks provide a powerful framework for compressing multi-dimensional data. The optimal tensor network structure for a given data tensor depends on both data characteristics and specific optimality criteria, making tensor network…

Computational Engineering, Finance, and Science · Computer Science 2026-03-23 Zheng Guo , Aditya Deshpande , Brian Kiedrowski , Xinyu Wang , Alex Gorodetsky

Network regularization is an effective tool for incorporating structural prior knowledge to learn coherent models over networks, and has yielded provably accurate estimates in applications ranging from spatial economics to neuroimaging…

Machine Learning · Computer Science 2020-06-02 Hongyuan You , Furkan Kocayusufoglu , Ambuj K. Singh

We introduce and compare new compression approaches to obtain regularized solutions of large linear systems which are commonly encountered in large scale inverse problems. We first describe how to approximate matrix vector operations with a…

Numerical Analysis · Mathematics 2016-08-12 Sergey Voronin , Dylan Mikesell , Guust Nolet

To support mechanism online learning and facilitate digital twin development for biomanufacturing processes, this paper develops an efficient Bayesian inference approach for partially observed enzymatic stochastic reaction network (SRN), a…

Machine Learning · Statistics 2024-07-02 Wandi Xu , Wei Xie

The state-of-the-art tensor network Kalman filter lifts the curse of dimensionality for high-dimensional recursive estimation problems. However, the required rounding operation can cause filter divergence due to the loss of positive…

Machine Learning · Computer Science 2024-09-06 Clara Menzen , Manon Kok , Kim Batselier

We propose two efficient approximations to standard convolutional neural networks: Binary-Weight-Networks and XNOR-Networks. In Binary-Weight-Networks, the filters are approximated with binary values resulting in 32x memory saving. In…

Computer Vision and Pattern Recognition · Computer Science 2016-08-04 Mohammad Rastegari , Vicente Ordonez , Joseph Redmon , Ali Farhadi

This paper proposes a method for constructing one-step prediction tubes for nonlinear systems using reproducing kernel Hilbert spaces. We approximate a bounded reproducing kernel Hilbert space (RKHS) hypothesis set by a finite-dimensional…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Jannis Lübsen , Annika Eichler

We introduce an algorithmic framework based on tensor networks for computing fluid flows around immersed objects in curvilinear coordinates. We show that the tensor network simulations can be carried out solely using highly compressed…

In recent years, tensor network renormalization (TNR) has emerged as an efficient and accurate method for studying (1+1)D quantum systems or 2D classical systems using real-space renormalization group (RG) techniques. One notable…

Strongly Correlated Electrons · Physics 2023-12-01 Ying-Jie Wei , Zheng-Cheng Gu

Recurrent stochastic configuration networks (RSCNs) have shown great potential in modelling nonlinear dynamic systems with uncertainties. This paper presents an RSCN with hybrid regularization to enhance both the learning capacity and…

Machine Learning · Computer Science 2024-12-03 Gang Dang , Dianhui Wang

A noise-reduction algorithm for time-series of non-linear systems is presented. The algorithm smoothes the attractors in phase space using B-splines, allowing a more accurate measure of their dynamics. The algorithm is tested on numerical…

chao-dyn · Physics 2008-02-03 Junheng Luo , Dominique Thiebaut