English

A Latent Topic Model with Markovian Transition for Process Data

Methodology 2019-11-06 v1 Statistics Theory Applications Statistics Theory

Abstract

We propose a latent topic model with a Markovian transition for process data, which consist of time-stamped events recorded in a log file. Such data are becoming more widely available in computer-based educational assessment with complex problem solving items. The proposed model can be viewed as an extension of the hierarchical Bayesian topic model with a hidden Markov structure to accommodate the underlying evolution of an examinee's latent state. Using topic transition probabilities along with response times enables us to capture examinees' learning trajectories, making clustering/classification more efficient. A forward-backward variational expectation-maximization (FB-VEM) algorithm is developed to tackle the challenging computational problem. Useful theoretical properties are established under certain asymptotic regimes. The proposed method is applied to a complex problem solving item in 2012 Programme for International Student Assessment (PISA 2012).

Keywords

Cite

@article{arxiv.1911.01583,
  title  = {A Latent Topic Model with Markovian Transition for Process Data},
  author = {Haochen Xu and Guanhua Fang and Zhiliang Ying},
  journal= {arXiv preprint arXiv:1911.01583},
  year   = {2019}
}

Comments

42 pages

R2 v1 2026-06-23T12:04:50.727Z