English
Related papers

Related papers: Expert-Guided POMDP Learning for Data-Efficient Mo…

200 papers

Our aim of this paper is to develop new map matching algorithms and to improve upon previous work. We address two key approaches: Analytic Hierarchy Process (AHP) map matching and fuzzy logic map matching. AHP is a decision-making method…

Computational Geometry · Computer Science 2024-02-20 Jeremy J. Lin , Tomoro Mochida , Riley C. W. O'Neill , Atsuro Yoshida , Masashi Yamazaki , Akinobu Sasada

This paper proposes a novel fuzzy action selection method to leverage human knowledge in reinforcement learning problems. Based on the estimates of the most current action-state values, the proposed fuzzy nonlinear mapping as-signs each…

Artificial Intelligence · Computer Science 2021-06-15 Mohsen Annabestani , Ali Abedi , Mohammad Reza Nematollahi , Mohammad Bagher Naghibi Sis-tani

We consider a class of sequential decision-making problems under uncertainty that can encompass various types of supervised learning concepts. These problems have a completely observed state process and a partially observed modulation…

Optimization and Control · Mathematics 2021-08-24 R. Reid Bishop , Chelsea C. White

Finite mixture models are powerful tools for modelling and analyzing heterogeneous data. Parameter estimation is typically carried out using maximum likelihood estimation via the Expectation-Maximization (EM) algorithm. Recently, the…

Computation · Statistics 2020-05-15 Sharon X. Lee , Geoffrey J. McLachlan , Kaleb L. Leemaqz

Decision-making under uncertainty is a crucial ability for autonomous systems. In its most general form, this problem can be formulated as a Partially Observable Markov Decision Process (POMDP). The solution policy of a POMDP can be…

Robotics · Computer Science 2019-04-09 Sung-Kyun Kim , Rohan Thakker , Ali-akbar Agha-mohammadi

Fuzzy Cognitive Maps (FCMs) are soft computing technique that follows an approach similar to human reasoning and human decision-making process, making them a valuable modeling and simulation methodology. Medical Decision Systems are complex…

Artificial Intelligence · Computer Science 2021-08-10 Anand M. Shukla , Pooja D. Pandit , Vasudev M. Purandare , Anuradha Srinivasaraghavan

Partially observable Markov decision processes (POMDPs) provide a flexible representation for real-world decision and control problems. However, POMDPs are notoriously difficult to solve, especially when the state and observation spaces are…

Artificial Intelligence · Computer Science 2023-10-20 Michael H. Lim , Tyler J. Becker , Mykel J. Kochenderfer , Claire J. Tomlin , Zachary N. Sunberg

In this work, we address the problem of estimating sparse communication channels in OFDM systems in the presence of carrier frequency offset (CFO) and unknown noise variance. To this end, we consider a convex optimization problem, including…

Information Theory · Computer Science 2013-11-15 Rodrigo Carvajal , Boris I. Godoy , Juan C. Agüero

The objective is to study an on-line Hidden Markov model (HMM) estimation-based Q-learning algorithm for partially observable Markov decision process (POMDP) on finite state and action sets. When the full state observation is available,…

Machine Learning · Computer Science 2018-09-25 Hyung-Jin Yoon , Donghwan Lee , Naira Hovakimyan

We consider finite model approximations of discrete-time partially observed Markov decision processes (POMDPs) under the discounted cost criterion. After converting the original partially observed stochastic control problem to a fully…

Systems and Control · Computer Science 2017-10-20 Naci Saldi , Serdar Yüksel , Tamás Linder

Trajectory optimization is a fundamental stochastic optimal control problem. This paper deals with a trajectory optimization approach for dynamical systems subject to measurement noise that can be fitted into linear time-varying stochastic…

Systems and Control · Electrical Eng. & Systems 2021-08-24 Prakash Mallick , Zhiyong Chen

In this paper, we consider the maximum a posteriori (MAP) estimation for the multiple measurement vectors (MMV) problem with application to direction-of-arrival (DOA) estimation, which is classically formulated as a regularized…

Signal Processing · Electrical Eng. & Systems 2024-10-21 Tianyi Liu , Frederic Matter , Alexander Sorg , Marc E. Pfetsch , Martin Haardt , Marius Pesavento

In recent years several learning approaches to point goal navigation in previously unseen environments have been proposed. They vary in the representations of the environments, problem decomposition, and experimental evaluation. In this…

Robotics · Computer Science 2022-12-20 Yimeng Li , Arnab Debnath , Gregory J. Stein , Jana Kosecka

We study planning problems where autonomous agents operate inside environments that are subject to uncertainties and not fully observable. Partially observable Markov decision processes (POMDPs) are a natural formal model to capture such…

Artificial Intelligence · Computer Science 2018-02-28 Steven Carr , Nils Jansen , Ralf Wimmer , Jie Fu , Ufuk Topcu

We present a computational technique for modeling the evolution of dynamical systems in a reduced basis, with a focus on the challenging problem of modeling partially-observed partial differential equations (PDEs) on high-dimensional…

Machine Learning · Statistics 2024-12-25 Victor Churchill

The purpose of this paper is to point to the usefulness of applying a linear mathematical formulation of fuzzy multiple criteria objective decision methods in organising business activities. In this respect fuzzy parameters of linear…

Artificial Intelligence · Computer Science 2007-05-23 Sonja Petrovic-Lazarevic , Ajith Abraham

Pel-recursive motion estimation isa well-established approach. However, in the presence of noise, it becomes an ill-posed problem that requires regularization. In this paper, motion vectors are estimated in an iterative fashion by means of…

Computer Vision and Pattern Recognition · Computer Science 2014-03-31 Vania Vieira Estrela , Marcos Henrique da Silva Bassani

Bayesian analysis enables combining prior knowledge with measurement data to learn model parameters. Commonly, one resorts to computing the maximum a posteriori (MAP) estimate, when only a point estimate of the parameters is of interest. We…

Machine Learning · Statistics 2024-08-08 Felix Schneider , Iason Papaioannou , Bruno Sudret , Gerhard Müller

This study leverages the data representation capability of fuzzy based membership-mappings for practical secure distributed deep learning using fully homomorphic encryption. The impracticality issue of secure machine (deep) learning with…

Machine Learning · Computer Science 2022-04-13 Mohit Kumar , Weiping Zhang , Lukas Fischer , Bernhard Freudenthaler

We study the problem of controlling a partially observed Markov decision process (POMDP) to either aid or hinder the estimation of its state trajectory. We encode the estimation objectives via the smoother entropy, which is the conditional…

Systems and Control · Electrical Eng. & Systems 2023-05-10 Timothy L. Molloy , Girish N. Nair