English
Related papers

Related papers: A New Truncation Algorithm for Markov Chain Equili…

200 papers

We discuss balanced truncation model order reduction for large-scale quadratic-bilinear (QB) systems. Balanced truncation for linear systems mainly involves the computation of the Gramians of the system, namely reachability and…

Optimization and Control · Mathematics 2017-05-02 Peter Benner , Pawan Goyal

We investigate the parameter recovery of Markov-switching ordinary differential processes from discrete observations, where the differential equations are nonlinear additive models. This framework has been widely applied in biological…

Methodology · Statistics 2025-01-03 Katherine Tsai , Mladen Kolar , Sanmi Koyejo

In this work, we develop a framework aiming at designing quantum algorithms for combinatorial optimization problems while providing theoretical guarantees on their approximation ratios. The principal innovative aspect of our work is the…

Quantum Physics · Physics 2025-12-29 Shengminjie Chen , Ziyang Li , Hongyi Zhou , Jialin Zhang , Wenguo Yang , Xiaoming Sun

This article describes an accurate procedure for computing the mean first passage times of a finite irreducible Markov chain and a Markov renewal process. The method is a refinement to the Kohlas, Zeit fur Oper Res, 30,197-207, (1986)…

Probability · Mathematics 2016-02-17 Jeffrey J. Hunter

We consider the problem of performing inference with imprecise continuous-time hidden Markov chains, that is, imprecise continuous-time Markov chains that are augmented with random output variables whose distribution depends on the hidden…

Probability · Mathematics 2017-05-09 Thomas Krak , Jasper De Bock , Arno Siebes

We introduce discrete time Markov chains that preserve uniform measures on boxed plane partitions. Elementary Markov steps change the size of the box from (a x b x c) to ((a-1) x (b+1) x c) or ((a+1) x (b-1) x c). Algorithmic realization of…

Combinatorics · Mathematics 2011-08-19 Alexei Borodin , Vadim Gorin

Random walks are a fundamental model in applied mathematics and are a common example of a Markov chain. The limiting stationary distribution of the Markov chain represents the fraction of the time spent in each state during the stochastic…

Numerical Analysis · Computer Science 2018-01-08 Austin R. Benson , David F. Gleich , Lek-Heng Lim

The Expectation Maximization (EM) algorithm is a versatile tool for model parameter estimation in latent data models. When processing large data sets or data stream however, EM becomes intractable since it requires the whole data set to be…

Statistics Theory · Mathematics 2012-10-18 Sylvain Le Corff , Gersende Fort

A non trivial problem that arises in several applications is the estimation of the mean of a truncated normal distribution. In this paper, an iterative deterministic scheme for approximating this mean is proposed. It has been inspired from…

We develop new adaptive algorithms for temporal integration of nonlinear evolution equations on tensor manifolds. These algorithms, which we call step-truncation methods, are based on performing one time step with a conventional…

Numerical Analysis · Mathematics 2022-03-09 Abram Rodgers , Alec Dektor , Daniele Venturi

This paper considers the problem of randomized influence maximization over a Markovian graph process: given a fixed set of nodes whose connectivity graph is evolving as a Markov chain, estimate the probability distribution (over this fixed…

Social and Information Networks · Computer Science 2017-11-10 Buddhika Nettasinghe , Vikram Krishnamurthy

We give a general framework for inference in spanning tree models. We propose unified algorithms for the important cases of first-order expectations and second-order expectations in edge-factored, non-projective spanning-tree models. Our…

Computation and Language · Computer Science 2021-03-26 Ran Zmigrod , Tim Vieira , Ryan Cotterell

Iterative load balancing algorithms for indivisible tokens have been studied intensively in the past. Complementing previous worst-case analyses, we study an average-case scenario where the load inputs are drawn from a fixed probability…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-28 Leran Cai , Thomas Sauerwald

The paper presents new asymptotic recurrent algorithms of phase space reduction for regularly and singularly perturbed semi-Markov processes. These algorithms give effective conditions of weak convergence for distributions and convergence…

Probability · Mathematics 2019-07-09 Dmitrii Silvestrov

Computing smoothing distributions, the distributions of one or more states conditional on past, present, and future observations is a recurring problem when operating on general hidden Markov models. The aim of this paper is to provide a…

Probability · Mathematics 2012-02-15 Randal Douc , Aurélien Garivier , Eric Moulines , Jimmy Olsson

A semi-Markov process method for obtaining general counting statistics for open quantum systems is extended to the scenario of resetting. The simultaneous presence of random resets and wave function collapses means that the quantum jump…

Statistical Mechanics · Physics 2023-12-15 Fei Liu

We consider the problem of computing the value and an optimal strategy for minimizing the expected termination time in one-counter Markov decision processes. Since the value may be irrational and an optimal strategy may be rather…

Formal Languages and Automata Theory · Computer Science 2012-05-08 Tomáš Brázdil , Antonín Kučera , Petr Novotný , Dominik Wojtczak

Direct simulation of biomolecular dynamics in thermal equilibrium is challenging due to the metastable nature of conformation dynamics and the computational cost of molecular dynamics. Biased or enhanced sampling methods may improve the…

Chemical Physics · Physics 2015-06-12 Benjamin Trendelkamp-Schroer , Frank Noe

This paper discusses tractable development and statistical estimation of a continuous time stochastic process with a finite state space having non-Markov property. The process is formed by a finite mixture of right-continuous Markov jump…

Statistics Theory · Mathematics 2019-02-04 H. Frydman , B. A. Surya

Identification of the unknown parameters and orders of fractional chaotic systems is of vital significance in controlling and synchronization of fractional-order chaotic systems. However there exist basic hypotheses in traditional…

Chaotic Dynamics · Physics 2012-08-14 Fei Gao , Feng-Xia Fei , Qian Xu , Yan-Fang Deng , Yi-Bo Qi , Ilangko Balasingham