English
Related papers

Related papers: Deceptive Kernel Function on Observations of Discr…

200 papers

This work introduces a novel deep learning-based architecture, termed the Deep Belief Markov Model (DBMM), which provides efficient, model-formulation agnostic inference in Partially Observable Markov Decision Process (POMDP) problems. The…

Machine Learning · Computer Science 2025-03-18 Giacomo Arcieri , Konstantinos G. Papakonstantinou , Daniel Straub , Eleni Chatzi

Many medical decision-making tasks can be framed as partially observed Markov decision processes (POMDPs). However, prevailing two-stage approaches that first learn a POMDP and then solve it often fail because the model that best fits the…

Machine Learning · Statistics 2020-04-01 Joseph Futoma , Michael C. Hughes , Finale Doshi-Velez

The use of kernels for nonlinear prediction is widespread in machine learning. They have been popularized in support vector machines and used in kernel ridge regression, amongst others. Kernel methods share three aspects. First, instead of…

Machine Learning · Statistics 2025-08-25 Patrick J. F. Groenen , Michael Greenacre

The ability to identify useful features or representations of the input data based on training data that achieves low prediction error on test data across multiple prediction tasks is considered the key to multitask learning success. In…

Machine Learning · Statistics 2025-02-12 Soumya Mukherjee , Bharath K. Sriperumbudur

In real-world multi-agent systems (MASs), observation delays are ubiquitous, preventing agents from making decisions based on the environment's true state. An individual agent's local observation typically comprises multiple components from…

Multiagent Systems · Computer Science 2025-11-13 Songchen Fu , Siang Chen , Shaojing Zhao , Letian Bai , Ta Li , Yonghong Yan

In this article we propose a qualitative (ordinal) counterpart for the Partially Observable Markov Decision Processes model (POMDP) in which the uncertainty, as well as the preferences of the agent, are modeled by possibility distributions.…

Artificial Intelligence · Computer Science 2013-01-30 Regis Sabbadin

We study reinforcement learning with linear function approximation and finite-memory approximations for partially observed Markov decision processes (POMDPs). We first present an algorithm for the value evaluation of finite-memory feedback…

Optimization and Control · Mathematics 2025-05-22 Ali Devran Kara

Matrices resulting from the discretization of a kernel function, e.g., in the context of integral equations or sampling probability distributions, can frequently be approximated by interpolation. In order to improve the efficiency, a…

Numerical Analysis · Mathematics 2021-12-10 Steffen Börm

Real-world decision-making problems are often partially observable, and many can be formulated as a Partially Observable Markov Decision Process (POMDP). When we apply reinforcement learning (RL) algorithms to the POMDP, reasonable…

Artificial Intelligence · Computer Science 2023-04-20 Soichiro Nishimori , Sotetsu Koyamada , Shin Ishii

In many engineering systems, proper predictive maintenance and operational control are essential to increase efficiency and reliability while reducing maintenance costs. However, one of the major challenges is that many sensors are used for…

Applications · Statistics 2025-12-09 Boyang Xu , Yunyi Kang , Xinyu Zhao , Hao Yan , Feng Ju

Recent reinforcement learning (RL) methods have achieved success in various domains. However, multi-agent RL (MARL) remains a challenge in terms of decentralization, partial observability and scalability to many agents. Meanwhile,…

Machine Learning · Computer Science 2024-02-26 Kai Cui , Sascha Hauck , Christian Fabian , Heinz Koeppl

In computational reinforcement learning, a growing body of work seeks to express an agent's model of the world through predictions about future sensations. In this manuscript we focus on predictions expressed as General Value Functions:…

Machine Learning · Computer Science 2021-11-23 Alex Kearney , Anna Koop , Johannes Günther , Patrick M. Pilarski

Many real-world decision problems involve the interaction of multiple self-interested agents with limited sensing ability. The partially observable stochastic game (POSG) provides a mathematical framework for modeling these problems,…

Computer Science and Game Theory · Computer Science 2024-10-30 Tyler Becker , Zachary Sunberg

Partially observable Markov decision processes (POMDPs) are a principled planning model for sequential decision-making under uncertainty. Yet, real-world problems with high-dimensional observations, such as camera images, remain intractable…

Machine Learning · Computer Science 2026-02-06 Miriam Schäfers , Merlijn Krale , Thiago D. Simão , Nils Jansen , Maximilian Weininger

Autonomous systems that rely on learned perception can make unsafe decisions when sensor readings are misclassified. We study shielding for this setting: given a proposed action, a shield blocks actions that could violate safety. We…

Artificial Intelligence · Computer Science 2026-04-23 William Scarbro , Ravi Mangal

Decision-making under uncertainty is a crucial ability for autonomous systems. In its most general form, this problem can be formulated as a Partially Observable Markov Decision Process (POMDP). The solution policy of a POMDP can be…

Robotics · Computer Science 2019-04-09 Sung-Kyun Kim , Rohan Thakker , Ali-akbar Agha-mohammadi

Solving partially observable Markov decision processes (POMDPs) with high dimensional and continuous observations, such as camera images, is required for many real life robotics and planning problems. Recent researches suggested machine…

Artificial Intelligence · Computer Science 2025-05-27 Idan Lev-Yehudi , Moran Barenboim , Vadim Indelman

Partially observable Markov decision processes (POMDPs) are a natural model for planning problems where effects of actions are nondeterministic and the state of the world is not completely observable. It is difficult to solve POMDPs…

Artificial Intelligence · Computer Science 2009-09-25 N. L. Zhang , W. Liu

We consider a class of partially observable Markov decision processes (POMDPs) with uncertain transition and/or observation probabilities. The uncertainty takes the form of probability intervals. Such uncertain POMDPs can be used, for…

Systems and Control · Computer Science 2018-07-12 Mohamadreza Ahmadi , Murat Cubuktepe , Nils Jansen , Ufuk Topcu

Partially observable Markov decision processes (POMDPs) are a general mathematical model for sequential decision-making in stochastic environments under state uncertainty. POMDPs are often solved \textit{online}, which enables the algorithm…

Artificial Intelligence · Computer Science 2025-03-26 Yunuo Zhang , Baiting Luo , Ayan Mukhopadhyay , Abhishek Dubey
‹ Prev 1 3 4 5 6 7 10 Next ›