English
Related papers

Related papers: On the Stochastic Stability of Deep Markov Models

200 papers

The deep neural network multigrid solver (DNN-MG) combines a coarse-grid finite element simulation with a deep neural network that corrects the solution on finer grid levels, thereby improving the computational efficiency. In this work, we…

Numerical Analysis · Mathematics 2026-01-26 Robert Jendersie , Nils Margenberg , Christian Lessig , Thomas Richter

Diffusion models (DMs) represent state-of-the-art generative models for continuous inputs. DMs work by constructing a Stochastic Differential Equation (SDE) in the input space (ie, position space), and using a neural network to reverse it.…

Machine Learning · Computer Science 2024-05-14 Tianrong Chen , Jiatao Gu , Laurent Dinh , Evangelos A. Theodorou , Joshua Susskind , Shuangfei Zhai

As a relatively new field, network neuroscience has tended to focus on aggregate behaviours of the brain averaged over many successive experiments or over long recordings in order to construct robust brain models. These models are limited…

Neurons and Cognition · Quantitative Biology 2022-05-19 James Wilsenach , Katie Warnaby , Charlotte M. Deane , Gesine Reinert

Dynamical systems theory has long provided a foundation for understanding evolving phenomena across scientific domains. Yet, the application of this theory to complex real-world systems remains challenging due to issues in mathematical…

Machine Learning · Computer Science 2024-11-05 Samuel A. Moore , Brian P. Mann , Boyuan Chen

Probabilistic graphical models (PGMs) are widely used to discover latent structure in data, but their success hinges on selecting an appropriate model design. In practice, model specification is difficult and often requires iterative…

Machine Learning · Computer Science 2026-04-08 Kevin Zhang , Yixin Wang

A useful sampling-reconstruction model should be stable with respect to different kind of small perturbations, regardless whether they result from jitter, measurement errors, or simply from a small change in the model assumptions. In this…

General Mathematics · Mathematics 2007-05-31 E. costa-Reyes , A. Aldroubi , I. Krishtal

Deep Generative Models (DGMs) are versatile tools for learning data representations while adequately incorporating domain knowledge such as the specification of conditional probability distributions. Recently proposed DGMs tackle the…

Machine Learning · Computer Science 2024-01-30 Romain Lopez , Jan-Christian Huetter , Ehsan Hajiramezanali , Jonathan Pritchard , Aviv Regev

This paper studies deterministic and stochastic fixed-time stability of autonomous nonlinear discrete-time (DT) systems. Lyapunov conditions are first presented under which the fixed-time stability of deterministic DT system is certified.…

Systems and Control · Electrical Eng. & Systems 2022-07-21 Farzaneh Tatari , Hamidreza Modares

We propose sequential Monte Carlo based algorithms for maximum likelihood estimation of the static parameters in hidden Markov models with an intractable likelihood using ideas from approximate Bayesian computation. The static parameter…

Computation · Statistics 2013-11-19 Sinan Yildirim , Sumeetpal Singh , Thomas Dean , Ajay Jasra

In this paper we propose two behavioral distances that support approximate reasoning on Stochastic Markov Models (SMMs), that are continuous-time stochastic transition systems where the residence time on each state is described by a generic…

Formal Languages and Automata Theory · Computer Science 2014-03-26 Giorgio Bacci , Giovanni Bacci , Kim G. Larsen , Radu Mardare

Markov decision processes (MDP) are a well-established model for sequential decision-making in the presence of probabilities. In robust MDP (RMDP), every action is associated with an uncertainty set of probability distributions, modelling…

Artificial Intelligence · Computer Science 2024-12-16 Tobias Meggendorfer , Maximilian Weininger , Patrick Wienhöft

This work is concerned with the stability properties of linear stochastic differential equations with random (drift and diffusion) coefficient matrices, and the stability of a corresponding random transition matrix (or exponential…

Probability · Mathematics 2019-05-02 Adrian N. Bishop , Pierre Del Moral

Markov Population Models are a widespread formalism used to model the dynamics of complex systems, with applications in Systems Biology and many other fields. The associated Markov stochastic process in continuous time is often analyzed by…

Machine Learning · Computer Science 2021-06-25 Francesca Cairoli , Ginevra Carbone , Luca Bortolussi

Recent studies have proposed that one can summarize brain activity into dynamics among a relatively small number of hidden states and that such an approach is a promising tool for revealing brain function. Hidden Markov models (HMMs) are a…

Neurons and Cognition · Quantitative Biology 2021-09-02 Takahiro Ezaki , Yu Himeno , Takamitsu Watanabe , Naoki Masuda

Memory units have been widely used to enrich the capabilities of deep networks on capturing long-term dependencies in reasoning and prediction tasks, but little investigation exists on deep generative models (DGMs) which are good at…

Machine Learning · Computer Science 2016-05-31 Chongxuan Li , Jun Zhu , Bo Zhang

This work primarily focuses on an operator inference methodology aimed at constructing low-dimensional dynamical models based on a priori hypotheses about their structure, often informed by established physics or expert insights. Stability…

Machine Learning · Computer Science 2024-03-04 Igor Pontes Duff , Pawan Goyal , Peter Benner

Deep learning offers promising new ways to accurately model aleatoric uncertainty in robotic state estimation systems, particularly when the uncertainty distributions do not conform to traditional assumptions of being fixed and Gaussian. In…

Machine Learning · Computer Science 2025-02-28 Aastha Acharya , Caleb Lee , Marissa D'Alonzo , Jared Shamwell , Nisar R. Ahmed , Rebecca Russell

The stochastic subgradient method is a widely-used algorithm for solving large-scale optimization problems arising in machine learning. Often these problems are neither smooth nor convex. Recently, Davis et al. [1-2] characterized the…

Optimization and Control · Mathematics 2021-02-25 Shixiang Chen , Alfredo Garcia , Shahin Shahrampour

Factorial Hidden Markov Models (FHMMs) are powerful models for sequential data but they do not scale well with long sequences. We propose a scalable inference and learning algorithm for FHMMs that draws on ideas from the stochastic…

Machine Learning · Statistics 2016-10-31 Yin Cheng Ng , Pawel Chilinski , Ricardo Silva

This paper introduces new model parameterizations for learning discrete-time dynamical systems from data via the Koopman operator and studies their properties. Whereas most existing works on Koopman learning do not take into account the…

Systems and Control · Electrical Eng. & Systems 2025-05-09 Fletcher Fan , Bowen Yi , David Rye , Guodong Shi , Ian R. Manchester