English
Related papers

Related papers: Tractable Inference for Complex Stochastic Process…

200 papers

Discrete-time stochastic systems are an essential modelling tool for many engineering systems. We consider stochastic control systems that are evolving over continuous spaces. For this class of models, methods for the formal verification…

Systems and Control · Computer Science 2018-11-29 Sofie Haesaert , Sadegh Soudjani

Predicting the distribution of future states in a stochastic system, known as belief propagation, is fundamental to reasoning under uncertainty. However, nonlinear dynamics often make analytical belief propagation intractable, requiring…

Machine Learning · Computer Science 2025-09-22 Peter Amorese , Morteza Lahijanian

We consider the general class of time-homogeneous stochastic dynamical systems, both discrete and continuous, and study the problem of learning a representation of the state that faithfully captures its dynamics. This is instrumental to…

Machine Learning · Computer Science 2024-03-15 Vladimir R. Kostic , Pietro Novelli , Riccardo Grazzi , Karim Lounici , Massimiliano Pontil

Various AI models are increasingly being considered as part of clinical decision-support tools. However, the trustworthiness of such models is rarely considered. Clinicians are more likely to use a model if they can understand and trust its…

Artificial Intelligence · Computer Science 2020-03-09 Evangelia Kyrimi , Somayyeh Mossadegh , Nigel Tai , William Marsh

Recent research in decision theoretic planning has focussed on making the solution of Markov decision processes (MDPs) more feasible. We develop a family of algorithms for structured reachability analysis of MDPs that are suitable when an…

Artificial Intelligence · Computer Science 2013-04-24 Craig Boutilier , Ronen I. Brafman , Christopher W. Geib

Bayesian inference has theoretical attractions as a principled framework for reasoning about beliefs. However, the motivations of Bayesian inference which claim it to be the only 'rational' kind of reasoning do not apply in practice. They…

Machine Learning · Statistics 2022-11-14 Sebastian Farquhar

Validating and controlling safety-critical systems in uncertain environments necessitates probabilistic reachable sets of future state evolutions. The existing methods of computing probabilistic reachable sets normally assume that…

Systems and Control · Electrical Eng. & Systems 2025-02-03 Xun Shen , Ye Wang , Kazumune Hashimoto , Yuhu Wu , Sebastien Gros

Probabilistic guarantees of safety and performance are important in constrained dynamical systems with stochastic uncertainty. We consider the stochastic reachability problem, which maximizes the probability that the state remains within…

Optimization and Control · Mathematics 2020-12-01 Abraham P. Vinod , Meeko M. K. Oishi

We describe a novel approach to statistical learning from particles tracked while moving in a random environment. The problem consists in inferring properties of the environment from recorded snapshots. We consider here the case of a fluid…

Information Theory · Computer Science 2008-06-09 Michael Chertkov , Lukas Kroc , Massimo Vergassola

Motivation: Several different threads of research have been proposed for modeling and mining temporal data. On the one hand, approaches such as dynamic Bayesian networks (DBNs) provide a formal probabilistic basis to model relationships…

Machine Learning · Computer Science 2009-04-15 Debprakash Patnaik , Srivatsan Laxman , Naren Ramakrishnan

Stochastic differential equations (SDEs) provide a natural framework for modelling intrinsic stochasticity inherent in many continuous-time physical processes. When such processes are observed in multiple individuals or experimental units,…

Computation · Statistics 2016-05-19 Gavin A. Whitaker , Andrew Golightly , Richard J. Boys , Chris Sherlock

We analyze the dynamics of an algorithm for approximate inference with large Gaussian latent variable models in a student-teacher scenario. To model nontrivial dependencies between the latent variables, we assume random covariance matrices…

Machine Learning · Computer Science 2020-08-26 Burak Çakmak , Manfred Opper

State resetting is a fundamental but often overlooked capability of simulators. It supports sample-based planning by allowing resets to previously encountered simulation states, and enables calibration of simulators using real data by…

Machine Learning · Computer Science 2025-11-27 Nan Jiang

Stochastic processes defined on integer valued state spaces are popular within the physical and biological sciences. These models are necessary for capturing the dynamics of small systems where the individual nature of the populations…

Machine Learning · Statistics 2024-04-15 Luke O'Loughlin , John Maclean , Andrew Black

The Dirichlet Belief Network~(DirBN) has been recently proposed as a promising approach in learning interpretable deep latent representations for objects. In this work, we leverage its interpretable modelling architecture and propose a deep…

Machine Learning · Computer Science 2020-04-30 Yaqiong Li , Xuhui Fan , Ling Chen , Bin Li , Zheng Yu , Scott A. Sisson

Continuous-time Bayesian networks is a natural structured representation language for multicomponent stochastic processes that evolve continuously over time. Despite the compact representation, inference in such models is intractable even…

Artificial Intelligence · Computer Science 2012-05-14 Ido Cohn , Tal El-Hay , Nir Friedman , Raz Kupferman

Deep neural networks can be trained to be efficient and effective controllers for dynamical systems; however, the mechanics of deep neural networks are complex and difficult to guarantee. This work presents a general approach for providing…

Systems and Control · Computer Science 2019-06-05 Kyle D. Julian , Mykel J. Kochenderfer

We present Neural Bayesian Filtering (NBF), an algorithm for maintaining distributions over hidden states, called beliefs, in partially observable systems. NBF is trained to find a good latent representation of the beliefs induced by a…

Bayesian statistical models allow us to formalise our knowledge about the world and reason about our uncertainty, but there is a need for better procedures to accurately encode its complexity. One way to do so is through compositional…

Computation · Statistics 2017-03-01 Maria Lomeli

When designing optimal controllers for any system, it is often the case that the true state of the system is unknown to the controller, for example due to noisy measurements or partially observable states. Incomplete state information must…

Optimization and Control · Mathematics 2014-01-23 Kendra Lesser , Meeko Oishi