English
Related papers

Related papers: Unsupervised learning of observation functions in …

200 papers

The theory of Kazantzis-Kravaris/Luenberger (KKL) observer design introduces a methodology that uses a nonlinear transformation map and its left inverse to estimate the state of a nonlinear system through the introduction of a linear…

Systems and Control · Electrical Eng. & Systems 2023-10-31 Lukas Trommer , Halil Yigit Oksuz

Machine learning (ML) and deep learning models are extensively used for parameter optimization and regression problems. However, not all inverse problems in ML are ``identifiable,'' indicating that model parameters may not be uniquely…

Machine Learning · Computer Science 2023-07-24 Reza Sameni

In this work, a novel approach for the construction and training of time series models is presented that deals with the problem of learning on large time series with non-equispaced observations, which at the same time may possess features…

Machine Learning · Computer Science 2020-11-25 Charilaos Mylonas , Eleni Chatzi

Designing Luenberger observers for nonlinear systems involves the challenging task of transforming the state to an alternate coordinate system, possibly of higher dimensions, where the system is asymptotically stable and linear up to output…

Optimization and Control · Mathematics 2023-04-06 Muhammad Umar B. Niazi , John Cao , Xudong Sun , Amritam Das , Karl Henrik Johansson

In a nonparametric instrumental regression model, we strengthen the conventional moment independence assumption towards full statistical independence between instrument and error term. This allows us to prove identification results and…

Econometrics · Economics 2019-06-13 Isaac Loh

This paper outlines a new nonparametric estimation procedure for unobserved phi-mixing processes. It is assumed that the only information on the stationary hidden states (Xk) is given by the process (Yk), where Yk is a noisy observation of…

Statistics Theory · Mathematics 2015-08-27 Thierry Dumont , Sylvain Le Corff

This paper reports a novel method for supervised machine learning based on the mathematical formalism that supports quantum mechanics. The method uses projective quantum measurement as a way of building a prediction function. Specifically,…

Quantum Physics · Physics 2022-08-30 Fabio A. González , Vladimir Vargas-Calderón , Herbert Vinck-Posada

In recent years, manifold methods have moved into focus as tools for dimension reduction. Assuming that the high-dimensional data actually lie on or close to a low-dimensional nonlinear manifold, these methods have shown convincing results…

Machine Learning · Statistics 2020-12-23 Moritz Herrmann , Fabian Scheipl

We propose a general self-supervised learning approach for spatial perception tasks, such as estimating the pose of an object relative to the robot, from onboard sensor readings. The model is learned from training episodes, by relying on: a…

Robotics · Computer Science 2021-07-20 Mirko Nava , Antonio Paolillo , Jérôme Guzzi , Luca Maria Gambardella , Alessandro Giusti

We generalise Spatial Transformer Networks (STN) by replacing the parametric transformation of a fixed, regular sampling grid with a deformable, statistical shape model which is itself learnt. We call this a Statistical Transformer Network…

Computer Vision and Pattern Recognition · Computer Science 2018-04-20 Anil Bas , William A. P. Smith

Uniform and smooth data collection is often infeasible in real-world scenarios. In this paper, we propose an identification framework to effectively handle the so-called non-uniform observations, i.e., data scenarios that include missing…

Systems and Control · Electrical Eng. & Systems 2025-06-09 Cesare Donati , Martina Mammarella , Fabrizio Dabbene , Carlo Novara , Constantino Lagoa

Distributional reinforcement learning improves performance by capturing environmental stochasticity, but a comprehensive theoretical understanding of its effectiveness remains elusive. In addition, the intractable element of the infinite…

Machine Learning · Computer Science 2025-05-14 Taehyun Cho , Seungyub Han , Seokhun Ju , Dohyeong Kim , Kyungjae Lee , Jungwoo Lee

We propose a methodology to analyze data arising from a curve that, over its domain, switches among J states. We consider a sequence of response variables, where each response y depends on a covariate x according to an unobserved state z.…

Methodology · Statistics 2013-05-23 Camila P. E. de Souza , Nancy E. Heckman

Solving an ill-posed linear inverse problem requires knowledge about the underlying signal model. In many applications, this model is a priori unknown and has to be learned from data. However, it is impossible to learn the model using…

Machine Learning · Statistics 2024-10-22 Julián Tachella , Dongdong Chen , Mike Davies

The identification of a nonlinear dynamic model is an open topic in control theory, especially from sparse input-output measurements. A fundamental challenge of this problem is that very few to zero prior knowledge is available on both the…

Systems and Control · Electrical Eng. & Systems 2022-06-13 Steeven Janny , Quentin Possamai , Laurent Bako , Madiha Nadri , Christian Wolf

The paper proposes an adaptive observer of the state vector of a nonlinear time varying system based on measurements of the output variable. The problem is solved under the assumption that the control matrix (vector) and the nonlinear…

Systems and Control · Electrical Eng. & Systems 2023-05-26 Olga Kozachek , Alexey Bobtsov , Nikolay Nikolaev

We establish a time-stepping learning algorithm and apply it to predict the solution of the partial differential equation of motion in micromagnetism as a dynamical system depending on the external field as parameter. The data-driven…

Computational Physics · Physics 2021-02-02 Lukas Exl , Norbert J. Mauser , Thomas Schrefl , Dieter Suess

State-space models have been successfully used for more than fifty years in different areas of science and engineering. We present a procedure for efficient variational Bayesian learning of nonlinear state-space models based on sparse…

Machine Learning · Computer Science 2014-11-04 Roger Frigola , Yutian Chen , Carl E. Rasmussen

We investigate methods for penalized regression in the presence of missing observations. This paper introduces a method for estimating the parameters which compensates for the missing observations. We first, derive an unbiased estimator of…

Applications · Statistics 2013-10-09 Yunjin Choi , Robert Tibshirani

Estimating function inference is indispensable for many common point process models where the joint intensities are tractable while the likelihood function is not. In this paper we establish asymptotic normality of estimating function…

Statistics Theory · Mathematics 2019-11-18 Frédéric Lavancier , Arnaud Poinas , Rasmus Waagepetersen