English
Related papers

Related papers: NARX Identification using Derivative-Based Regular…

200 papers

Different techniques have emerged in the deep learning scenario, such as Convolutional Neural Networks, Deep Belief Networks, and Long Short-Term Memory Networks, to cite a few. In lockstep, regularization methods, which aim to prevent…

Machine Learning · Computer Science 2020-07-28 Claudio Filipi Goncalves do Santos , Danilo Colombo , Mateus Roder , João Paulo Papa

This work presents a novel technique that integrates the methodologies of machine learning and system identification to solve multiclass problems. Such an approach allows to extract and select sets of representative features with reduced…

Machine Learning · Computer Science 2021-06-09 P. H. O. Silva , A. S. Cerqueira , E. G. Nepomuceno

We propose an automatic approach for manifold nonlinear autoregressive with exogenous inputs (mNARX) modeling that leverages the feature-based structure of functional-NARX (F-NARX) modeling. This novel approach, termed mNARX+, preserves the…

Computation · Statistics 2026-04-08 S. Schär , S. Marelli , B. Sudret

This paper explores the use of Control Affine Neural Nonlinear AutoRegressive eXogenous (CA-NNARX) models for nonlinear system identification and model-based control design. The idea behind this architecture is to match the known…

Systems and Control · Electrical Eng. & Systems 2025-01-24 Jing Xie , Fabio Bonassi , Riccardo Scattolini

Temperature control is a complex task due to its often unknown dynamics and disturbances. This paper explores the use of Neural Nonlinear AutoRegressive eXogenous (NNARX) models for nonlinear system identification and model predictive…

Systems and Control · Electrical Eng. & Systems 2024-02-09 Jing Xie , Léo Simpson , Jonas Asprion , Riccardo Scattolini

This paper explores the role of regularization in data-driven predictive control (DDPC) through the lens of convex relaxation. Using a bi-level optimization framework, we model system identification as an inner problem and predictive…

Optimization and Control · Mathematics 2026-04-17 Xu Shang , Yang Zheng

This paper addresses the problem of inferring a hybrid automaton from a set of input-output traces of a hybrid system exhibiting discrete mode switching between continuously evolving dynamics. Existing approaches mainly adopt a…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Hengzhi Yu , Bohan Ma , Mingshuai Chen , Huangying Dong , Jie An , Bin Gu , Naijun Zhan , Jianwei Yin

This work presents a control-oriented identification scheme for efficient control design and stability analysis of nonlinear systems. Neural networks are used to identify a discrete-time nonlinear state-space model to approximate…

Systems and Control · Electrical Eng. & Systems 2024-10-04 Maxime Thieffry , Alexandre Hache , Mohamed Yagoubi , Philippe Chevrel

Regularization plays a vital role in the context of deep learning by preventing deep neural networks from the danger of overfitting. This paper proposes a novel deep learning regularization method named as DL-Reg, which carefully reduces…

Machine Learning · Computer Science 2020-11-05 Maryam Dialameh , Ali Hamzeh , Hossein Rahmani

Over-parameterization is one of the inherent characteristics of modern deep neural networks, which can often be overcome by leveraging regularization methods, such as Dropout. Usually, these methods are applied globally and all the input…

Neural and Evolutionary Computing · Computer Science 2022-04-05 Li Ding , Lee Spector

This paper presents a regularized recursive identification algorithm with simultaneous on-line estimation of both the model parameters and the algorithms hyperparameters. A new kernel is proposed to facilitate the algorithm development. The…

Methodology · Statistics 2024-05-14 Bernard Vau , Tudor-Bogdan Airimitoaie

We develop a new method for regularising neural networks. We learn a probability distribution over the activations of all layers of the model and then insert imputed values into the network during training. We obtain a posterior for an…

Machine Learning · Computer Science 2019-10-14 Matthew Willetts , Alexander Camuto , Stephen Roberts , Chris Holmes

This review provides an introduction to - and overview of - the current state of the art in neural-network based regularization methods for inverse problems in imaging. It aims to introduce readers with a solid knowledge in applied…

Optimization and Control · Mathematics 2023-12-25 Andreas Habring , Martin Holler

Modern deep neural network (DNN) trainings utilize various training techniques, e.g., nonlinear activation functions, batch normalization, skip-connections, etc. Despite their effectiveness, it is still mysterious how they help accelerate…

Machine Learning · Computer Science 2024-03-05 Cheng Chen , Junjie Yang , Yi Zhou

This work targets the identification of a class of models for hybrid dynamical systems characterized by nonlinear autoregressive exogenous (NARX) components, with finite-dimensional polynomial expansions, and by a Markovian switching…

Machine Learning · Computer Science 2020-09-30 Alessandro Brusaferri , Matteo Matteucci , Stefano Spinelli

In this work, we describe a new approach that uses deep neural networks (DNN) to obtain regularization parameters for solving inverse problems. We consider a supervised learning approach, where a network is trained to approximate the…

Numerical Analysis · Mathematics 2021-04-15 Babak Maboudi Afkham , Julianne Chung , Matthias Chung

Recent advancements in artificial intelligence, particularly deep neural networks, have pushed the boundaries of what is achievable in complex tasks. Traditional methods for training neural networks in classification problems often rely on…

Machine Learning · Computer Science 2024-09-10 Jaouad Dabounou

A simulation is useful when the phenomenon of interest is either expensive to regenerate or irreproducible with the same context. Recently, Bayesian inference on the distribution of the simulation input parameter has been implemented…

Machine Learning · Computer Science 2022-11-07 Dongjun Kim , Kyungwoo Song , Seungjae Shin , Wanmo Kang , Il-Chul Moon , Weonyoung Joo

This paper is directed towards the problem of learning nonlinear ARX models based on system input--output data. In particular, our interest is in learning a conditional distribution of the current output based on a finite window of past…

Machine Learning · Computer Science 2020-12-09 Johannes N. Hendriks , Fredrik K. Gustafsson , Antônio H. Ribeiro , Adrian G. Wills , Thomas B. Schön

In this paper, we consider the problem of online identification of Switched AutoRegressive eXogenous (SARX) systems, where the goal is to estimate the parameters of each subsystem and identify the switching sequence as data are obtained in…

Systems and Control · Computer Science 2018-05-04 Zhe Du , Necmiye Ozay , Laura Balzano