English
Related papers

Related papers: Information Geometry Approach to Parameter Estimat…

200 papers

We propose a novel, tractable latent state inference scheme for Markov jump processes, for which exact inference is often intractable. Our approach is based on an entropic matching framework that can be embedded into the well-known…

Machine Learning · Computer Science 2026-02-27 Yannick Eich , Bastian Alt , Heinz Koeppl

Piecewise-deterministic Markov processes form a general class of non-diffusion stochastic models that involve both deterministic trajectories and random jumps at random times. In this paper, we state a new characterization of the jump rate…

Methodology · Statistics 2017-05-03 Romain Azaïs , Alexandre Genadot

Traditional partial differential equations with constant coefficients often struggle to capture abrupt changes in real-world phenomena, leading to the development of variable coefficient PDEs and Markovian switching models. Recently,…

Machine Learning · Statistics 2024-09-02 Yi Zhang , Zhikun Zhang , Xiangjun Wang

The Fisher information matrix is a quantity of fundamental importance for information geometry and asymptotic statistics. In practice, it is widely used to quickly estimate the expected information available in a data set and guide…

Methodology · Statistics 2023-06-06 William R. Coulton , Benjamin D. Wandelt

Information-theoretic quantities play a crucial role in understanding non-linear relationships between random variables and are widely used across scientific disciplines. However, estimating these quantities remains an open problem,…

Machine Learning · Computer Science 2025-02-28 Alberto Foresti , Giulio Franzese , Pietro Michiardi

We present a numerical method to compute expectations of functionals of a piecewise-deterministic Markov process. We discuss time dependent functionals as well as deterministic time horizon problems. Our approach is based on the…

Probability · Mathematics 2012-01-31 Adrien Brandejsky , Benoîte de Saporta , François Dufour

We establish an abstract, effective, exponential large deviations type estimate for Markov systems satisfying a weaker form of mixing. We employ this result to derive such estimates, as well as a central limit theorem, for the skew product…

Dynamical Systems · Mathematics 2025-07-17 Ao Cai , Pedro Duarte , Silvius Klein

Reversibility is a key concept in Markov models and Master-equation models of molecular kinetics. The analysis and interpretation of the transition matrix encoding the kinetic properties of the model relies heavily on the reversibility…

Chemical Physics · Physics 2015-09-23 Benjamin Trendelkamp-Schroer , Hao Wu , Fabian Paul , Frank Noé

In all but special circumstances, measurements of time-dependent processes reflect internal structures and correlations only indirectly. Building predictive models of such hidden information sources requires discovering, in some way, the…

Probability · Mathematics 2009-11-10 Nihat Ay , James P. Crutchfield

This paper addresses a key limitation in existing counterfactual inference methods for Markov Decision Processes (MDPs). Current approaches assume a specific causal model to make counterfactuals identifiable. However, there are usually many…

Artificial Intelligence · Computer Science 2026-05-25 Jessica Lally , Milad Kazemi , Nicola Paoletti

Branching processes are a class of continuous-time Markov chains (CTMCs) with ubiquitous applications. A general difficulty in statistical inference under partially observed CTMC models arises in computing transition probabilities when the…

Computation · Statistics 2015-03-10 Jason Xu , Vladimir N. Minin

Gaussian process emulators of computationally expensive computer codes provide fast statistical approximations to model physical processes. The training of these surrogates depends on the set of design points chosen to run the simulator.…

Computation · Statistics 2016-08-16 A. Garbuno-Inigo , F. A. DiazDelaO , K. M. Zuev

The model of partially observed linear system depending on some unknown parameters is considered. An approximation of the unobserved component is proposed. This approximation is realized in three steps. First an estimator of the method of…

Statistics Theory · Mathematics 2023-04-20 Yury A. Kutoyants

We propose a new approach for estimating the finite dimensional transition matrix of a Markov chain using a large number of independent sample paths observed at random times. The sample paths may be observed as few as two times, and the…

Methodology · Statistics 2025-05-20 Daphne Aurouet , Valentin Patilea

In this paper we consider parameter estimation for discretely observed diffusion processes. In particular, we focus on data that are observed at low frequency and methodology that can estimate parameters with uncertainty quantification.…

Computation · Statistics 2026-05-01 Jingning Yao , Ajay Jasra , Sheng Jiang

Hidden Markov models (HMMs) are one of the most widely used statistical methods for analyzing sequence data. However, the reporting of output from HMMs has largely been restricted to the presentation of the most-probable (MAP) hidden state…

Methodology · Statistics 2015-05-01 Michalis K. Titsias , Christopher Yau , Christopher C. Holmes

We present a new algorithm for identifying the transition and emission probabilities of a hidden Markov model (HMM) from the emitted data. Expectation-maximization becomes computationally prohibitive for long observation records, which are…

Computation and Language · Computer Science 2018-06-20 Kejun Huang , Xiao Fu , Nicholas D. Sidiropoulos

Complex systems may often be characterized by their hierarchical dynamics. In this paper do we present a method and an operational algorithm that automatically infer this property in a broad range of systems; discrete stochastic processes.…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 Olof Görnerup , Martin Nilsson Jacobi

We examine phase transition of the Husimi-Temperley model in terms of information geometry. For this purpose, we introduce the Fisher metric defined by the density matrix of the model. We find that the metric becomes hyperbolic at the…

Statistical Mechanics · Physics 2014-07-11 Yoichiro Hashizume , Hiroaki Matsueda

Implicit models, which allow for the generation of samples but not for point-wise evaluation of probabilities, are omnipresent in real-world problems tackled by machine learning and a hot topic of current research. Some examples include…

Machine Learning · Statistics 2018-04-27 Yingzhen Li , Richard E. Turner
‹ Prev 1 8 9 10 Next ›