English
Related papers

Related papers: Learning neural state-space models: do we need a s…

200 papers

Preparation of a target quantum many-body state on quantum simulators is one of the significant steps in quantum science and technology. With a small number of qubits, a few quantum states, such as the Greenberger-Horne-Zeilinger state,…

Quantum Physics · Physics 2023-07-28 Donggyu Kim , Eun-Gook Moon

State machines are popular models to model and visualize discrete systems such as software systems, and to represent regular grammars. Most algorithms that passively learn state machines from data assume all the data to be available from…

Formal Languages and Automata Theory · Computer Science 2022-07-05 Robert Baumgartner , Sicco Verwer

Pattern recognition is a central topic in Learning Theory with numerous applications such as voice and text recognition, image analysis, computer diagnosis. The statistical set-up in classification is the following: we are given an i.i.d.…

Quantum Physics · Physics 2011-06-23 Madalin Guta , Wojciech Kotlowski

An estimated state-space model can possibly be improved by further iterations with estimation data. This contribution specifically studies if models obtained by subspace estimation can be improved by subsequent re-estimation of the B, C,…

Systems and Control · Electrical Eng. & Systems 2020-03-16 Suat Gumussoy , Ahmet Arda Ozdemir , Tomas McKelvey , Lennart Ljung , Mladen Gibanica , Rajiv Singh

State estimation and sensor selection problems for nonlinear networks and systems are ubiquitous problems that are important for the control, monitoring, analysis, and prediction of a large number of engineered and physical systems. Sensor…

Systems and Control · Electrical Eng. & Systems 2021-03-23 Aleksandar Haber

MATLAB(R) releases over the last 3 years have witnessed a continuing growth in the dynamic modeling capabilities offered by the System Identification Toolbox(TM). The emphasis has been on integrating deep learning architectures and training…

Machine Learning · Computer Science 2024-09-13 Tianyu Dai , Khaled Aljanaideh , Rong Chen , Rajiv Singh , Alec Stothert , Lennart Ljung

Model checking has been proposed as a formal verification approach for analyzing computer-based and cyber-physical systems. The state space explosion problem is the main obstacle for applying this approach for sophisticated systems.…

Performance · Computer Science 2023-07-18 Mohammadsadegh Mohagheghi , Khayyam Salehi

Autonomous robots require high degrees of cognitive and motoric intelligence to come into our everyday life. In non-structured environments and in the presence of uncertainties, such degrees of intelligence are not easy to obtain.…

To adapt to real-world data streams, continual learning (CL) systems must rapidly learn new concepts while preserving and utilizing prior knowledge. When it comes to adding new information to continually-trained deep neural networks (DNNs),…

Machine Learning · Computer Science 2025-07-02 Md Yousuf Harun , Christopher Kanan

Effective quantification of uncertainty is an essential and still missing step towards a greater adoption of deep-learning approaches in different applications, including mission-critical ones. In particular, investigations on the…

Machine Learning · Computer Science 2023-04-14 Marco Forgione , Dario Piga

In the following paper we present a new type of optimization algorithms adapted for neural network training. These algorithms are based upon sequential operator splitting technique for some associated dynamical systems. Furthermore, we…

Machine Learning · Computer Science 2020-03-24 Cristian Daniel Alecsa , Titus Pinta , Imre Boros

Inferring behavior model of a running software system is quite useful for several automated software engineering tasks, such as program comprehension, anomaly detection, and testing. Most existing dynamic model inference techniques are…

Machine Learning · Computer Science 2020-08-31 Mohammad Jafar Mashhadi , Hadi Hemmati

State-space models are used in a wide range of time series analysis formulations. Kalman filtering and smoothing are work-horse algorithms in these settings. While classic algorithms assume Gaussian errors to simplify estimation, recent…

Optimization and Control · Mathematics 2018-07-02 Jonathan Jonker , Aleksandr Y. Aravkin , James V. Burke , Gianluigi Pillonetto , Sarah Webster

A new framework for nonlinear system identification is presented in terms of optimal fitting of stable nonlinear state space equations to input/output/state data, with a performance objective defined as a measure of robustness of the…

Optimization and Control · Mathematics 2016-11-17 Mark M. Tobenkin , Ian R. Manchester , Jennifer Wang , Alexandre Megretski , Russ Tedrake

We design specific neural networks (NNs) for the identification of switching nonlinear systems in the state-space form, which explicitly model the switching behavior and address the inherent coupling between system parameters and switching…

Systems and Control · Electrical Eng. & Systems 2025-03-14 Yanxin Zhang , Chengpu Yu , Filippo Fabiani

In this work, we propose a multi-stage training strategy for the development of deep learning algorithms applied to problems with multiscale features. Each stage of the pro-posed strategy shares an (almost) identical network structure and…

Numerical Analysis · Mathematics 2020-09-25 Eric Chung , Wing Tat Leung , Sai-Mang Pun , Zecheng Zhang

Reliable state estimation is essential for autonomous systems operating in complex, noisy environments. Classical filtering approaches, such as the Kalman filter, can struggle when facing nonlinear dynamics or non-Gaussian noise, and even…

Machine Learning · Computer Science 2025-04-11 Wonjin Song , Feng Bao

The importance of proper data normalization for deep neural networks is well known. However, in continuous-time state-space model estimation, it has been observed that improper normalization of either the hidden state or hidden state…

Systems and Control · Electrical Eng. & Systems 2024-05-15 Jonas Weigand , Gerben I. Beintema , Jonas Ulmen , Daniel Görges , Roland Tóth , Maarten Schoukens , Martin Ruskowski

Nonlinear system identification (NL-SI) has proven to be effective in obtaining accurate models for highly complex systems. Recent encoder-based methods for artificial neural network state-space (ANN-SS) models have shown state-of-the-art…

Systems and Control · Electrical Eng. & Systems 2026-02-16 J. H. Hoekstra , B. Györök , R. Töth , M. Schoukens

Assembly state recognition facilitates the execution of assembly procedures, offering feedback to enhance efficiency and minimize errors. However, recognizing assembly states poses challenges in scalability, since parts are frequently…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Tim J. Schoonbeek , Goutham Balachandran , Hans Onvlee , Tim Houben , Shao-Hsuan Hung , Jacek Kustra , Peter H. N. de With , Fons van der Sommen