English
Related papers

Related papers: Factorized Machine Self-Confidence for Decision-Ma…

200 papers

We provide a framework for speeding up algorithms for time-bounded reachability analysis of continuous-time Markov decision processes. The principle is to find a small, but almost equivalent subsystem of the original system and only analyse…

Systems and Control · Computer Science 2018-07-26 Pranav Ashok , Yuliya Butkova , Holger Hermanns , Jan Křetínský

In this study I proposed a filtering beliefs method for improving performance of Partially Observable Markov Decision Processes(POMDPs), which is a method wildly used in autonomous robot and many other domains concerning control policy. My…

Artificial Intelligence · Computer Science 2021-01-07 Oscar LiJen Hsu

Machine learning models are often personalized with information that is protected, sensitive, self-reported, or costly to acquire. These models use information about people but do not facilitate nor inform their consent. Individuals cannot…

Machine Learning · Computer Science 2023-10-13 Hailey Joren , Chirag Nagpal , Katherine Heller , Berk Ustun

We present a new model-based reinforcement learning algorithm, Cooperative Prioritized Sweeping, for efficient learning in multi-agent Markov decision processes. The algorithm allows for sample-efficient learning on large problems by…

Machine Learning · Computer Science 2020-01-22 Eugenio Bargiacchi , Timothy Verstraeten , Diederik M. Roijers , Ann Nowé

We consider the problem of steering a system with unknown, stochastic dynamics to satisfy a rich, temporally layered task given as a signal temporal logic formula. We represent the system as a Markov decision process in which the states are…

Systems and Control · Computer Science 2015-10-23 Austin Jones , Derya Aksaray , Zhaodan Kong , Mac Schwager , Calin Belta

This literature review focuses on three important aspects of an autonomous car system: tracking (assessing the identity of the actors such as cars, pedestrians or obstacles in a sequence of observations), prediction (predicting the future…

Machine Learning · Computer Science 2023-08-30 Florin Leon , Marius Gavrilescu

Although Reinforcement Learning (RL) algorithms have found tremendous success in simulated domains, they often cannot directly be applied to physical systems, especially in cases where there are hard constraints to satisfy (e.g. on safety…

Machine Learning · Computer Science 2020-08-28 Harsh Satija , Philip Amortila , Joelle Pineau

This paper studies algorithmic decision-making under human's strategic behavior, where a decision maker uses an algorithm to make decisions about human agents, and the latter with information about the algorithm may exert effort…

Computer Science and Game Theory · Computer Science 2024-09-16 Tian Xie , Xuwei Tan , Xueru Zhang

We introduce a framework for calibrating machine learning models so that their predictions satisfy explicit, finite-sample statistical guarantees. Our calibration algorithms work with any underlying model and (unknown) data-generating…

Machine Learning · Computer Science 2022-10-03 Anastasios N. Angelopoulos , Stephen Bates , Emmanuel J. Candès , Michael I. Jordan , Lihua Lei

Ensuring that autonomous space robot control software behaves as it should is crucial, particularly as software failure in space often equates to mission failure and could potentially endanger nearby astronauts and costly equipment. To…

As we increasingly delegate decision-making to algorithms, whether directly or indirectly, important questions emerge in circumstances where those decisions have direct consequences for individual rights and personal opportunities, as well…

Computers and Society · Computer Science 2019-05-01 Teresa Scantamburlo , Andrew Charlesworth , Nello Cristianini

Constructing an accurate system model for formal model verification can be both resource demanding and time-consuming. To alleviate this shortcoming, algorithms have been proposed for automatically learning system models based on observed…

Machine Learning · Computer Science 2012-12-18 Hua Mao , Yingke Chen , Manfred Jaeger , Thomas D. Nielsen , Kim G. Larsen , Brian Nielsen

Knowledge tracing is a sequence prediction problem where the goal is to predict the outcomes of students over questions as they are interacting with a learning platform. By tracking the evolution of the knowledge of some student, one can…

Information Retrieval · Computer Science 2018-11-16 Jill-Jênn Vie , Hisashi Kashima

Sensing and Perception (S&P) is a crucial component of an autonomous system (such as a robot), especially when deployed in highly dynamic environments where it is required to react to unexpected situations. This is particularly true in case…

Artificial Intelligence · Computer Science 2021-09-06 Andrea Piazzoni , Jim Cherian , Martin Slavik , Justin Dauwels

In this paper, we present an online reinforcement learning algorithm for constrained Markov decision processes with a safety constraint. Despite the necessary attention of the scientific community, considering stochastic stopping time, the…

Machine Learning · Computer Science 2024-03-26 Abhijit Mazumdar , Rafal Wisniewski , Manuela L. Bujorianu

Robust Markov decision processes (r-MDPs) extend MDPs by explicitly modelling epistemic uncertainty about transition dynamics. Learning r-MDPs from interactions with an unknown environment enables the synthesis of robust policies with…

Machine Learning · Computer Science 2025-11-21 Yannik Schnitzer , Alessandro Abate , David Parker

The number and importance of AI-based systems in all domains is growing. With the pervasive use and the dependence on AI-based systems, the quality of these systems becomes essential for their practical usage. However, quality assurance for…

Software Engineering · Computer Science 2023-08-02 Michael Felderer , Rudolf Ramler

We explore trust in a relatively new area of data science: Automated Machine Learning (AutoML). In AutoML, AI methods are used to generate and optimize machine learning models by automatically engineering features, selecting models, and…

Machine Learning · Computer Science 2020-01-22 Jaimie Drozdal , Justin Weisz , Dakuo Wang , Gaurav Dass , Bingsheng Yao , Changruo Zhao , Michael Muller , Lin Ju , Hui Su

Time-series models typically assume untainted and legitimate streams of data. However, a self-interested adversary may have incentive to corrupt this data, thereby altering a decision maker's inference. Within the broader field of…

Cryptography and Security · Computer Science 2024-02-22 William N. Caballero , Jose Manuel Camacho , Tahir Ekin , Roi Naveiro

Automated vehicles are deemed to be the key element for the intelligent transportation system in the future. Many studies have been made to improve the Automated vehicles' ability of environment recognition and vehicle control, while the…

Artificial Intelligence · Computer Science 2018-04-18 Yingjun Ye , Xiaohui Zhang , Jian Sun