English
Related papers

Related papers: Computing Quantiles in Markov Reward Models

200 papers

Quantification is well known to be a major obstacle in the construction of a probabilistic network, especially when relying on human experts for this purpose. The construction of a qualitative probabilistic network has been proposed as an…

Artificial Intelligence · Computer Science 2013-01-07 Silja Renooij , Linda C. van der Gaag

The goal of a traditional Markov decision process (MDP) is to maximize expected cumulative reward over a defined horizon (possibly infinite). In many applications, however, a decision maker may be interested in optimizing a specific…

Artificial Intelligence · Computer Science 2025-10-16 Xiaocheng Li , Huaiyang Zhong , Margaret L. Brandeau

Verification of infinite-state Markov chains is still a challenge despite several fruitful numerical or statistical approaches. For decisive Markov chains, there is a simple numerical algorithm that frames the reachability probability as…

Logic in Computer Science · Computer Science 2024-09-30 Benoît Barbot , Patricia Bouyer , Serge Haddad

Parametric Markov chains (pMC) are used to model probabilistic systems with unknown or partially known probabilities. Although (universal) pMC verification for reachability properties is known to be coETR-complete, there have been efforts…

Logic in Computer Science · Computer Science 2025-04-29 Kasper Engelen , Guillermo A. Pérez , Shrisha Rao

Computing reachability probabilities is at the heart of probabilistic model checking. All model checkers compute these probabilities in an iterative fashion using value iteration. This technique approximates a fixed point from below by…

Logic in Computer Science · Computer Science 2018-04-16 Tim Quatmann , Joost-Pieter Katoen

Quantiles are very important statistics information used to describe the distribution of datasets. Given the quantiles of a dataset, we can easily know the distribution of the dataset, which is a fundamental problem in data analysis.…

Databases · Computer Science 2015-08-25 Zixuan Zhuang

We consider quantile estimation using Markov chain Monte Carlo and establish conditions under which the sampling distribution of the Monte Carlo error is approximately Normal. Further, we investigate techniques to estimate the associated…

Statistics Theory · Mathematics 2018-04-20 Charles Doss , James M. Flegal , Galin L. Jones , Ronald C. Neath

We consider Markov decision processes where the state of the chain is only given at chosen observation times and of a cost. Optimal strategies involve the optimisation of observation times as well as the subsequent action values. We…

Optimization and Control · Mathematics 2025-03-27 Christoph Reisinger , Jonathan Tam

Incorporation of expert information in inference or decision settings is often important, especially in cases where data are unavailable, costly or unreliable. One approach is to elicit prior quantiles from an expert and then to fit these…

Statistics Theory · Mathematics 2016-11-04 Nicholas M. Kiefer

In the design of probabilistic timed systems, bounded requirements concerning behaviour that occurs within a given time, energy, or more generally cost budget are of central importance. Traditionally, such requirements have been…

Logic in Computer Science · Computer Science 2016-05-19 Ernst Moritz Hahn , Arnd Hartmanns

Rigorous guarantees about the performance of predictive algorithms are necessary in order to ensure their responsible use. Previous work has largely focused on bounding the expected loss of a predictor, but this is not sufficient in many…

Machine Learning · Computer Science 2022-12-29 Jake C. Snell , Thomas P. Zollo , Zhun Deng , Toniann Pitassi , Richard Zemel

Quantile is an important measure in finance and quality assessment in service industry. In this paper, we model the temporal and cross-sectional interactive effect of the quantiles of large-dimensional time series by a latent quantile…

Methodology · Statistics 2023-03-07 He Yong , Kong Xin-Bing , Yu Long , Zhao Peng

This paper investigates the identification of quantiles and quantile regression parameters when observations are set valued. We define the identification set of quantiles of random sets in a way that extends the definition of quantiles for…

Methodology · Statistics 2020-04-10 Arie Beresteanu , Yuya Sasaki

In spite of the recent surge of interest in quantile regression, joint estimation of linear quantile planes remains a great challenge in statistics and econometrics. We propose a novel parametrization that characterizes any collection of…

Methodology · Statistics 2015-07-14 Yun Yang , Surya Tokdar

Quantile regression models provide a wide picture of the conditional distributions of the response variable by capturing the effect of the covariates at different quantile levels. In most applications, the parametric form of those…

Methodology · Statistics 2017-11-03 T. Rodrigues , J. -L. Dortet-Bernadet , Y. Fan

This paper considers equity premium prediction, for which mean regression can be problematic due to heteroscedasticity and heavy-tails of the error. We show advantages of quantile predictions using a novel penalized quantile regression that…

Methodology · Statistics 2025-05-23 Shaobo Li , Ben Sherwood

We consider a two-node queue modeled as a two-dimensional random walk. In particular, we consider the case that one or both queues have finite buffers. We develop an approximation scheme based on the Markov reward approach to error bounds…

Probability · Mathematics 2020-10-28 Yanting Chen , Xinwei Bai , Richard J. Boucherie , Jasper Goseling

In this paper, we study the problem of model-checking quantum pushdown systems from a computational complexity point of view. We arrive at the following equally important, interesting new results: We first extend the notions of the {\it…

Logic in Computer Science · Computer Science 2026-05-11 Deren Lin , Tianrong Lin

Prediction of quantiles at extreme tails is of interest in numerous applications. Extreme value modelling provides various competing predictors for this point prediction problem. A common method of assessment of a set of competing…

Applications · Statistics 2021-06-30 Axel Gandy , Kaushik Jana , Almut E. D. Veraart

Despite the retrieval effectiveness of queries being mutually independent of one another, the evaluation of query performance prediction (QPP) systems has been carried out by measuring rank correlation over an entire set of queries. Such a…

Information Retrieval · Computer Science 2023-04-04 Suchana Datta , Debasis Ganguly , Derek Greene , Mandar Mitra