English
Related papers

Related papers: Denoising Particle Filters: Learning State Estimat…

200 papers

Learning dynamics governing physical and spatiotemporal processes is a challenging problem, especially in scenarios where states are partially measured. In this work, we tackle the problem of learning dynamics governing these systems when…

Machine Learning · Computer Science 2024-12-13 Paul Ghanem , Ahmet Demirkaya , Tales Imbiriba , Alireza Ramezani , Zachary Danziger , Deniz Erdogmus

Reinforcement Learning has been able to solve many complicated robotics tasks without any need for feature engineering in an end-to-end fashion. However, learning the optimal policy directly from the sensory inputs, i.e the observations,…

We propose a machine learning framework for parameter estimation of single mode Gaussian quantum states. Under a Bayesian framework, our approach estimates parameters of suitable prior distributions from measured data. For phase-space…

Quantum Physics · Physics 2021-08-16 Neel Kanth Kundu , Matthew R. McKay , Ranjan K. Mallik

This paper introduces a novel proprioceptive state estimator for legged robots that combines model-based filters and deep neural networks. Recent studies have shown that neural networks such as multi-layer perceptron or recurrent neural…

Robotics · Computer Science 2024-10-28 Donghoon Youm , Hyunsik Oh , Suyoung Choi , Hyeongjun Kim , Jemin Hwangbo

In many practical scenarios, the dynamical system is not available and standard data assimilation methods are not applicable. Our objective is to construct a data-driven model for state estimation without the underlying dynamics. Instead of…

Dynamical Systems · Mathematics 2024-08-19 Ziyi Wang , Lijian Jiang

Recovering a low-rank signal matrix from its noisy observation, commonly known as matrix denoising, is a fundamental inverse problem in statistical signal processing. Matrix denoising methods are generally based on shrinkage or thresholding…

Methodology · Statistics 2017-01-23 Santosh Kumar Yadav , Rohit Sinha , Prabin Kumar Bora

A novel approach to the problem of partial state estimation of nonlinear systems is proposed. The main idea is to translate the state estimation problem into one of estimation of constant, unknown parameters related to the systems initial…

Systems and Control · Computer Science 2016-04-08 Ortega Romeo , Bobtsov Alexey , Pyrkin Anton , Aranovskiy Stanislav

This work introduces a non-intrusive model reduction approach for learning reduced models from partially observed state trajectories of high-dimensional dynamical systems. The proposed approach compensates for the loss of information due to…

Machine Learning · Computer Science 2021-03-29 Wayne Isaac Tan Uy , Benjamin Peherstorfer

This paper presents a novel algorithm for efficient online estimation of the filter derivatives in general hidden Markov models. The algorithm, which has a linear computational complexity and very limited memory requirements, is furnished…

Computation · Statistics 2019-01-10 Jimmy Olsson , Johan Westerborn Alenlöv

Modeling unknown systems from data is a precursor of system optimization and sequential decision making. In this paper, we focus on learning a Markov model from a single trajectory of states. Suppose that the transition model has a small…

Methodology · Statistics 2020-11-30 Ziwei Zhu , Xudong Li , Mengdi Wang , Anru Zhang

A common strategy in modern learning systems is to learn a representation that is useful for many tasks, a.k.a. representation learning. We study this strategy in the imitation learning setting for Markov decision processes (MDPs) where…

Machine Learning · Computer Science 2020-02-26 Sanjeev Arora , Simon S. Du , Sham Kakade , Yuping Luo , Nikunj Saunshi

In imitation learning, an agent learns how to behave in an environment with an unknown cost function by mimicking expert demonstrations. Existing imitation learning algorithms typically involve solving a sequence of planning or…

Machine Learning · Computer Science 2016-06-17 Jonathan Ho , Jayesh K. Gupta , Stefano Ermon

Event-based sampling has been proposed as a general technique for lowering the average communication rate in remote state estimation, which can be important in scenarios with constraints on resources such as network bandwidth or sensor…

Systems and Control · Electrical Eng. & Systems 2022-09-29 Johan Ruuskanen , Anton Cervin

This paper introduces a new method for safety-aware robot learning, focusing on repairing policies using predictive models. Our method combines behavioral cloning with neural network repair in a two-step supervised learning framework. It…

Robotics · Computer Science 2024-11-08 Keyvan Majd , Geoffrey Clark , Georgios Fainekos , Heni Ben Amor

In the last years decision-focused learning framework, also known as predict-and-optimize, have received increasing attention. In this setting, the predictions of a machine learning model are used as estimated cost coefficients in the…

Machine Learning · Computer Science 2022-06-20 Jayanta Mandi , Víctor Bucarey , Maxime Mulamba , Tias Guns

We propose the use of Bayesian networks, which provide both a mean value and an uncertainty estimate as output, to enhance the safety of learned control policies under circumstances in which a test-time input differs significantly from the…

Machine Learning · Computer Science 2019-02-18 Keuntaek Lee , Kamil Saigol , Evangelos A. Theodorou

In many data analysis applications the following scenario is commonplace: we are given a point set that is supposed to sample a hidden ground truth $K$ in a metric space, but it got corrupted with noise so that some of the data points lie…

Computational Geometry · Computer Science 2017-03-28 Mickaël Buchet , Tamal K. Dey , Jiayuan Wang , Yusu Wang

We consider the problem of learning a policy for a Markov decision process consistent with data captured on the state-actions pairs followed by the policy. We assume that the policy belongs to a class of parameterized policies which are…

Optimization and Control · Mathematics 2017-01-24 Manjesh K. Hanawal , Hao Liu , Henghui Zhu , Ioannis Ch. Paschalidis

Stochastic nonlinear dynamical systems are ubiquitous in modern, real-world applications. Yet, estimating the unknown parameters of stochastic, nonlinear dynamical models remains a challenging problem. The majority of existing methods…

Machine Learning · Statistics 2022-05-06 Anubhab Ghosh , Mohamed Abdalmoaty , Saikat Chatterjee , Håkan Hjalmarsson

Bayesian filtering is a well-known problem that aims to estimate plausible states of a dynamical system from observations. Among existing approaches to solve this problem, particle filters are theoretically exact for non-linear dynamics and…

Machine Learning · Computer Science 2026-05-20 Thomas Savary , François Rozet , Gilles Louppe