English
Related papers

Related papers: A mathematical framework for exact milestoning

200 papers

This paper leverages a framework based on averaged operators to tackle the problem of tracking fixed points associated with maps that evolve over time. In particular, the paper considers the Krasnosel'skii-Mann method in a settings where:…

Optimization and Control · Mathematics 2020-01-09 Emiliano Dall'Anese , Andrea Simonetto , Andrey Bernstein

Modern advanced analytics applications make use of machine learning techniques and contain multiple steps of domain-specific and general-purpose processing with high resource requirements. We present KeystoneML, a system that captures and…

Machine Learning · Computer Science 2016-11-01 Evan R. Sparks , Shivaram Venkataraman , Tomer Kaftan , Michael J. Franklin , Benjamin Recht

The vast majority of stochastic simulation models are imperfect in that they fail to exactly emulate real system dynamics. The inexactness of the simulation model, or model discrepancy, can impact the predictive accuracy and usefulness of…

Methodology · Statistics 2017-07-21 Matthew Plumlee , Henry Lam

Filtering---estimating the state of a partially observable Markov process from a sequence of observations---is one of the most widely studied problems in control theory, AI, and computational statistics. Exact computation of the posterior…

Artificial Intelligence · Computer Science 2013-01-07 Bhaskara Marthi , Hanna Pasula , Stuart Russell , Yuval Peres

We present a numerical method for convergence acceleration for multifidelity models of parameterized ordinary differential equations. The hierarchy of models is defined as trajectories computed using different timesteps in a time…

Numerical Analysis · Mathematics 2018-08-13 Vahid Keshavarzzadeh , Robert M. Kirby , Akil Narayan

We consider the approximation of the performance of random walks in the quarter-plane. The approximation is in terms of a random walk with a product-form stationary distribution, which is obtained by perturbing the transition probabilities…

Probability · Mathematics 2014-09-15 Jasper Goseling , Richard J. Boucherie , Jan-Kees van Ommeren

Many problems in machine learning can be formulated as solving entropy-regularized optimal transport on the space of probability measures. The canonical approach involves the Sinkhorn iterates, renowned for their rich mathematical…

Machine Learning · Computer Science 2023-11-29 Mohammad Reza Karimi , Ya-Ping Hsieh , Andreas Krause

We consider the approximation of expectations with respect to the distribution of a latent Markov process given noisy measurements. This is known as the smoothing problem and is often approached with particle and Markov chain Monte Carlo…

Computation · Statistics 2019-02-06 Lawrence Middleton , George Deligiannidis , Arnaud Doucet , Pierre E. Jacob

This paper introduces a new algorithm for numerically computing equilibrium (i.e. stationary) distributions for Markov chains and Markov jump processes with either a very large finite state space or a countably infinite state space. The…

Probability · Mathematics 2022-08-31 Alex Infanger , Peter W. Glynn

We present a numerical method to compute expectations of functionals of a piecewise-deterministic Markov process. We discuss time dependent functionals as well as deterministic time horizon problems. Our approach is based on the…

Probability · Mathematics 2012-01-31 Adrien Brandejsky , Benoîte de Saporta , François Dufour

We consider the problem of estimating the transition rate matrix of a continuous-time Markov chain from a finite-duration realisation of this process. We approach this problem in an imprecise probabilistic framework, using a set of prior…

Machine Learning · Statistics 2018-07-12 Thomas Krak , Alexander Erreygers , Jasper De Bock

We calculate exact convergence times to reach random bipartite entanglement for various random protocols. The eigenproblem of a Markovian chain governing the process is mapped to a spin chain, thereby obtaining exact expression for the gap…

Quantum Physics · Physics 2008-09-26 Marko Znidaric

A general method to describe stochastic dynamics of Markov processes is suggested. The method aims to solve three related problems. The determination of an optimal coordinate for the description of stochastic dynamics. The reconstruction of…

Chemical Physics · Physics 2013-12-25 Sergei V. Krivov

We present a centralized algorithmic framework for solving multi-robot path planning problems in general, two-dimensional, continuous environments while minimizing globally the task completion time. The framework obtains high levels of…

Robotics · Computer Science 2015-07-14 Jingjin Yu , Daniela Rus

We present a mathematical framework for constructing and analyzing parallel algorithms for lattice Kinetic Monte Carlo (KMC) simulations. The resulting algorithms have the capacity to simulate a wide range of spatio-temporal scales in…

Numerical Analysis · Mathematics 2015-05-28 Giorgos Arampatzis , Markos A. Katsoulakis , Petr Plechac , Michela Taufer , Lifan Xu

We consider the problem of optimally designing a system for repeated use under uncertainty. We develop a modeling framework that integrates design and operational phases, which are represented by a mixed-integer program and discounted-cost…

Optimization and Control · Mathematics 2024-03-25 Seth Brown , Saumya Sinha , Andrew J Schaefer

We present a simulation methodology for Bayesian estimation of rate parameters in Markov jump processes arising for example in stochastic kinetic models. To handle the problem of missing components and measurement errors in observed data,…

Computation · Statistics 2010-09-01 Michael Amrein , Hans R. Kuensch

Integrated task and motion planning has emerged as a challenging problem in sequential decision making, where a robot needs to compute high-level strategy and low-level motion plans for solving complex tasks. While high-level strategies…

Artificial Intelligence · Computer Science 2018-02-19 Siddharth Srivastava , Nishant Desai , Richard Freedman , Shlomo Zilberstein

The challenging problem of conducting fully Bayesian inference for the reaction rate constants governing stochastic kinetic models (SKMs) is considered. Given the challenges underlying this problem, the Markov jump process representation is…

Computation · Statistics 2019-01-10 Andrew Golightly , Emma Bradley , Tom Lowe , Colin S. Gillespie

Classification tasks are usually evaluated in terms of accuracy. However, accuracy is discontinuous and cannot be directly optimized using gradient ascent. Popular methods minimize cross-entropy, hinge loss, or other surrogate losses, which…

Machine Learning · Computer Science 2024-07-25 Ivan Karpukhin , Stanislav Dereka , Sergey Kolesnikov