English
Related papers

Related papers: Nonlinear System Identification via Tensor Complet…

200 papers

Tensor completion is an extension of matrix completion aimed at recovering a multiway data tensor by leveraging a given subset of its entries (observations) and the pattern of observation. The low-rank assumption is key in establishing a…

Numerical Analysis · Mathematics 2026-03-12 Shakir Showkat Sofi , Lieven De Lathauwer

Recent efforts to unravel the mystery of implicit regularization in deep learning have led to a theoretical focus on matrix factorization -- matrix completion via linear neural network. As a step further towards practical deep learning, we…

Machine Learning · Computer Science 2021-06-10 Noam Razin , Asaf Maman , Nadav Cohen

While linear systems have been useful in solving problems across different fields, the need for improved performance and efficiency has prompted them to operate in nonlinear modes. As a result, nonlinear models are now essential for the…

Machine Learning · Computer Science 2025-03-07 Abdolvahhab Rostamijavanani , Shanwu Li , Yongchao Yang

Projection-based model reduction has become a popular approach to reduce the cost associated with integrating large-scale dynamical systems so they can be used in many-query settings such as optimization and uncertainty quantification. For…

Numerical Analysis · Mathematics 2020-08-26 Han Gao , Jian-Xun Wang , Matthew J. Zahr

The paper investigates nonlinear system identification using system output data at various linearized operating points. A feed-forward multi-layer Artificial Neural Network (ANN) based approach is used for this purpose and tested for two…

Systems and Control · Computer Science 2016-11-17 Sayan Saha , Saptarshi Das , Anish Acharya , Abhishek Kumar , Sumit Mukherjee , Indranil Pan , Amitava Gupta

We are interested in approximation of a multivariate function $f(x_1,\dots,x_d)$ by linear combinations of products $u^1(x_1)\cdots u^d(x_d)$ of univariate functions $u^i(x_i)$, $i=1,\dots,d$. In the case $d=2$ it is a classical problem of…

Machine Learning · Statistics 2014-09-05 D. Bazarkhanov , V. Temlyakov

Given a function dictionary $\cal D$ and an approximation budget $N\in\mathbb{N}^+$, nonlinear approximation seeks the linear combination of the best $N$ terms $\{T_n\}_{1\le n\le N}\subseteq{\cal D}$ to approximate a given function $f$…

Machine Learning · Computer Science 2020-11-06 Zuowei Shen , Haizhao Yang , Shijun Zhang

Block-oriented nonlinear models are popular in nonlinear system identification because of their advantages of being simple to understand and easy to use. Many different identification approaches were developed over the years to estimate the…

Systems and Control · Computer Science 2018-01-10 Maarten Schoukens , Koen Tiels

We consider the problem of deriving from experimental data an approximation of an unknown function, whose derivatives also approximate the unknown function derivatives. Solving this problem is useful, for instance, in the context of…

Systems and Control · Electrical Eng. & Systems 2019-11-11 Carlo Novara , Angelo Nicolì , Giuseppe C. Calafiore

Accurately estimating parameters in complex nonlinear systems is crucial across scientific and engineering fields. We present a novel approach for parameter estimation using a neural network with the Huber loss function. This method taps…

Machine Learning · Computer Science 2023-08-25 Kaushal Kumar

In the context of data-driven control of nonlinear systems, many approaches lack of rigorous guarantees, call for nonconvex optimization, or require knowledge of a function basis containing the system dynamics. To tackle these drawbacks, we…

Systems and Control · Electrical Eng. & Systems 2023-10-05 Tim Martin , Frank Allgöwer

The identification of a nonlinear dynamic model is an open topic in control theory, especially from sparse input-output measurements. A fundamental challenge of this problem is that very few to zero prior knowledge is available on both the…

Systems and Control · Electrical Eng. & Systems 2022-06-13 Steeven Janny , Quentin Possamai , Laurent Bako , Madiha Nadri , Christian Wolf

We study the problem of learning similarity by using nonlinear embedding models (e.g., neural networks) from all possible pairs. This problem is well-known for its difficulty of training with the extreme number of pairs. For the special…

Machine Learning · Statistics 2021-06-16 Bowen Yuan , Yu-Sheng Li , Pengrui Quan , Chih-Jen Lin

This work presents a control-oriented identification scheme for efficient control design and stability analysis of nonlinear systems. Neural networks are used to identify a discrete-time nonlinear state-space model to approximate…

Systems and Control · Electrical Eng. & Systems 2024-10-04 Maxime Thieffry , Alexandre Hache , Mohamed Yagoubi , Philippe Chevrel

Based on tensor neural network, we propose an interpolation method for high dimensional non-tensor-product-type functions. This interpolation scheme is designed by using the tensor neural network based machine learning method. This means…

Numerical Analysis · Mathematics 2024-04-12 Yongxin Li , Zhongshuo Lin , Yifan Wang , Hehu Xie

The goal of a recommendation system is to predict the interest of a user in a given item by exploiting the existing set of ratings as well as certain user/item features. A standard approach to modeling this problem is Inductive Matrix…

Machine Learning · Computer Science 2018-05-29 Kai Zhong , Zhao Song , Prateek Jain , Inderjit S. Dhillon

A deep neural network model is a powerful framework for learning representations. Usually, it is used to learn the relation $x \to y$ by exploiting the regularities in the input $x$. In structured output prediction problems, $y$ is…

Machine Learning · Computer Science 2017-10-31 Soufiane Belharbi , Romain Hérault , Clément Chatelain , Sébastien Adam

Nonlinear hyperspectral unmixing has recently received considerable attention, as linear mixture models do not lead to an acceptable resolution in some problems. In fact, most nonlinear unmixing methods are designed by assuming specific…

Image and Video Processing · Electrical Eng. & Systems 2024-02-07 Saeid Mehrdad , Seyed AmirHossein Janani

We developed a Nonlinear Level-set Learning (NLL) method for dimensionality reduction in high-dimensional function approximation with small data. This work is motivated by a variety of design tasks in real-world engineering applications,…

Functional Analysis · Mathematics 2019-06-20 Guannan Zhang , Jiaxin Zhang , Jacob Hinkle

Nonlinear function estimation is core to modern machine learning applications. In this paper, to perform nonlinear function estimation, we reduce a nonlinear inverse problem to a linear one using a polynomial kernel expansion. These kernels…

Information Theory · Computer Science 2019-10-02 Hangjin Liu , You , Zhou , Ahmad Beirami , Dror Baron