English
Related papers

Related papers: On Non-Markovian Performance Models

200 papers

The prediction of wind speed is one of the most important aspects when dealing with renewable energy. In this paper we show a new nonparametric model, based on semi-Markov chains, to predict wind speed. Particularly we use an indexed…

Data Analysis, Statistics and Probability · Physics 2015-06-15 Guglielmo D'Amico , Filippo Petroni , Flavio Prattico

We propose a method for learning Markov network structures for continuous data without invoking any assumptions about the distribution of the variables. The method makes use of previous work on a non-parametric estimator for mutual…

Machine Learning · Computer Science 2017-08-09 Janne Leppä-aho , Santeri Räisänen , Xiao Yang , Teemu Roos

Recent studies indicate that in many situations service times are affected by the experienced queueing delay of the particular customer. This effect has been detected in different areas, such as health care, call centers and…

Probability · Mathematics 2025-04-25 Bernardo D'Auria , Ivo J. B. F. Adan , René Bekker , Vidyadhar Kulkarni

Markov chain analysis is a key technique in formal verification. A practical obstacle is that all probabilities in Markov models need to be known. However, system quantities such as failure rates or packet loss ratios, etc. are often not --…

Logic in Computer Science · Computer Science 2023-11-08 Sebastian Junges , Erika Ábrahám , Christian Hensel , Nils Jansen , Joost-Pieter Katoen , Tim Quatmann , Matthias Volk

Queueing networks are notoriously difficult to analyze sans both Markovian and stationarity assumptions. Much of the theoretical contribution towards performance analysis of time-inhomogeneous single class queueing networks has focused on…

Probability · Mathematics 2017-08-22 Harsha Honnappa , Rahul Jain

Queueing networks are systems of theoretical interest that find widespread use in the performance evaluation of interconnected resources. In comparison to counterpart models in genetics or mathematical biology, the stochastic (jump)…

Methodology · Statistics 2019-06-28 Iker Perez , Giuliano Casale

There are multiple ways in which a stochastic system can be out of statistical equilibrium. It might be subject to time-varying forcing; or be in a transient phase on its way towards equilibrium; it might even be in equilibrium without us…

Dynamical Systems · Mathematics 2019-07-08 Péter Koltai , Hao Wu , Frank Noé , Christof Schütte

We provide a survey on relational models. Relational models describe complete networked {domains by taking into account global dependencies in the data}. Relational models can lead to more accurate predictions if compared to non-relational…

Artificial Intelligence · Computer Science 2016-09-13 Volker Tresp , Maximilian Nickel

We consider random processes that are history-dependent, in the sense that the distribution of the next step of the process at any time depends upon the entire past history of the process. In general, therefore, the Markov property cannot…

Probability · Mathematics 2019-11-19 Peter Clifford , David Stirzaker

We propose a Bayesian nonparametric mixture model for prediction- and information extraction tasks with an efficient inference scheme. It models categorical-valued time series that exhibit dynamics from multiple underlying patterns (e.g.…

Machine Learning · Statistics 2017-06-21 Jan Reubold , Thorsten Strufe , Ulf Brefeld

We construct a general measure for the degree of non-Markovian behavior in open quantum systems. This measure is based on the trace distance which quantifies the distinguishability of quantum states. It represents a functional of the…

Quantum Physics · Physics 2010-01-05 Heinz-Peter Breuer , Elsi-Mari Laine , Jyrki Piilo

This paper is concerned with the development of rigorous approximations to various expectations associated with Markov chains and processes having non-stationary transition probabilities. Such non-stationary models arise naturally in…

Probability · Mathematics 2018-05-07 Zeyu Zheng , Harsha Honnappa , Peter W. Glynn

Many empirical studies have revealed that the occurrences of contacts associated with human activities are non-Markovian temporal processes with a heavy tailed inter-event time distribution. Besides, there has been increasing empirical…

Physics and Society · Physics 2023-08-09 Lilei Han , Zhaohua Lin , Qingqing Yin , Ming Tang , Shuguang Guan , Marian Boguna

The identifiability analysis of a networked Markov chain model known as the influence model, as described in a recent contribution to Arxiv, is examined. Two errors in the identifiability analysis -- one related to the unidentifiability of…

Systems and Control · Computer Science 2018-11-07 Sandip Roy

Performative prediction is an emerging paradigm in machine learning that addresses scenarios where the model's prediction may induce a shift in the distribution of the data it aims to predict. Current works in this field often rely on…

Machine Learning · Computer Science 2025-09-03 Guangzheng Zhong , Yang Liu , Jiming Liu

Most reinforcement learning methods are based upon the key assumption that the transition dynamics and reward functions are fixed, that is, the underlying Markov decision process is stationary. However, in many real-world applications, this…

Machine Learning · Computer Science 2020-09-23 Yash Chandak , Georgios Theocharous , Shiv Shankar , Martha White , Sridhar Mahadevan , Philip S. Thomas

Beyond the conventional quantum regression theorem, a general formula for non-Markovian correlation functions of arbitrary system operators both in the time- and frequency-domain is given. We approach the problem by transforming the…

Quantum Physics · Physics 2016-09-21 Jinshuang Jin , Christian Karlewski , Michael Marthaler

Networks are models representing relationships between entities. Often these relationships are explicitly given, or we must learn a representation which generalizes and predicts observed behavior in underlying individual data (e.g.…

Social and Information Networks · Computer Science 2017-09-19 Ivan Brugere , Chris Kanich , Tanya Y. Berger-Wolf

We investigate nonlinear regression for nonstationary sequential data. In most real-life applications such as business domains including finance, retail, energy and economy, timeseries data exhibits nonstationarity due to the temporally…

Machine Learning · Computer Science 2020-06-19 Fatih Ilhan , Oguzhan Karaahmetoglu , Ismail Balaban , Suleyman Serdar Kozat

Discrimination between non-stationarity and long-range dependency is a difficult and long-standing issue in modelling financial time series. This paper uses an adaptive spectral technique which jointly models the non-stationarity and…

Statistical Finance · Quantitative Finance 2019-02-12 Nick James , Roman Marchant , Richard Gerlach , Sally Cripps