English
Related papers

Related papers: Sufficient Statistics for Markovian Feedback Proce…

200 papers

In many complex applications, data heterogeneity and homogeneity exist simultaneously. Ignoring either one will result in incorrect statistical inference. In addition, coping with complex data that are non-Euclidean becomes more common. To…

Methodology · Statistics 2021-05-28 Zixuan Han , Tao Li , Jinhong You

Inference of evolutionary trees and rates from biological sequences is commonly performed using continuous-time Markov models of character change. The Markov process evolves along an unknown tree while observations arise only from the tips…

Statistics Theory · Mathematics 2008-02-01 Elizabeth S. Allman , Cecile Ane , John A. Rhodes

Hidden Markov Models (HMMs) comprise a powerful generative approach for modeling sequential data and time-series in general. However, the commonly employed assumption of the dependence of the current time frame to a single or multiple…

Machine Learning · Computer Science 2021-09-13 Konstantinos P. Panousis , Sotirios Chatzis , Sergios Theodoridis

Can stated preferences inform counterfactual analyses of actual choice? This research proposes a novel approach to researchers who have access to both stated choices in hypothetical scenarios and actual choices, matched or unmatched. The…

Econometrics · Economics 2025-11-18 Romuald Meango , Marc Henry , Ismael Mourifie

Panel data, also known as longitudinal data, consist of a collection of time series. Each time series, which could itself be multivariate, comprises a sequence of measurements taken on a distinct unit. Mechanistic modeling involves writing…

Methodology · Statistics 2021-05-27 Carles Bretó , Edward L. Ionides , Aaron A. King

In the paper, we study a new rate of convergence estimate for homogeneous discrete-time nonlinear Markov chains based on the Markov-Dobrushin condition. This result generalizes the convergence estimates for any positive number of transition…

Probability · Mathematics 2021-10-22 Aleksandr A. Shchegolev

I study partial identification of distributional parameters in triangular systems. This model consists of a nonparametric outcome equation and a selection equation. This allows for general unobserved heterogeneity and selection on…

Methodology · Statistics 2014-11-11 Ju Hyun Kim

We study discrete-time, discrete-state multistate Markov models from the perspective of algebraic statistics. These models are widely studied in event history analysis, and are characterized by the state space, the initial distribution and…

In this paper, we establish sufficient conditions for identifying treatment effects on continuous outcomes in endogenous and multi-valued discrete treatment settings with unobserved heterogeneity. We employ the monotonicity assumption for…

Econometrics · Economics 2023-04-27 Koki Fusejima

In this paper, I characterize the network formation process as a static game of incomplete information, where the latent payoff of forming a link between two individuals depends on the structure of the network, as well as private…

Econometrics · Economics 2024-04-22 Shaomin Wu

This paper is concerned with a characterization of the observability for a continuous-time hidden Markov model where the state evolves as a general continuous-time Markov process and the observation process is modeled as nonlinear function…

Probability · Mathematics 2020-02-25 Jin W. Kim , Prashant G. Mehta

We consider a discrete time hidden Markov model where the signal is a stationary Markov chain. When conditioned on the observations, the signal is a Markov chain in a random environment under the conditional measure. It is shown that this…

Probability · Mathematics 2009-09-24 Ramon van Handel

Multi-type Markov point processes offer a flexible framework for modelling complex multi-type point patterns where it is pertinent to capture both interactions between points as well as large scale trends depending on observed covariates.…

Methodology · Statistics 2025-10-15 Ib Thorsgaard Jensen , Jean-François Coeurjolly , Rasmus Waagepetersen

Autonomous agents are often tasked with operating in an area where feedback is unavailable. Inspired by such applications, this paper develops a novel switched systems-based control method for uncertain nonlinear systems with temporary loss…

Systems and Control · Computer Science 2018-03-16 Hsi-Yuan Chen , Zachary I. Bell , Patryk Deptula , Warren E. Dixon

A random sequence having two segments being the homogeneous Markov processes is registered. Each segment has his own transition probability law and the length of the segment is unknown and random. The transition probabilities of each…

Statistics Theory · Mathematics 2020-11-17 A. Ochman-Gozdek , W. Sarnowski , K. J. Szajowski

We consider a dynamic Bayesian persuasion setting where a single long-lived sender persuades a stream of ``short-lived'' agents (receivers) by sharing information about a payoff-relevant state. The state transitions are Markovian and the…

Computer Science and Game Theory · Computer Science 2023-07-17 Krishnamurthy Iyer , Haifeng Xu , You Zu

A Hidden Markov Model for intraday momentum trading is presented which specifies a latent momentum state responsible for generating the observed securities' noisy returns. Existing momentum trading models suffer from time-lagging caused by…

Trading and Market Microstructure · Quantitative Finance 2020-06-22 Hugh Christensen , Simon Godsill , Richard E Turner

Reinforcement learning algorithms typically rely on the assumption that the environment dynamics and value function can be expressed in terms of a Markovian state representation. However, when state information is only partially observable,…

Misperceptions about extreme dependencies between different financial assets have been an im- portant element of the recent financial crisis. This paper studies inhomogeneity in dependence structures using Markov switching regular vine…

Methodology · Statistics 2012-02-10 Jakob Stoeber , Claudia Czado

We consider a discrete latent variable model for two-way data arrays, which allows one to simultaneously produce clusters along one of the data dimensions (e.g. exchangeable observational units or features) and contiguous groups, or…