English
Related papers

Related papers: Determining extended Markov parameterizations for …

200 papers

We present a novel algorithm for parameter learning in generic deep generative models that builds upon the predictive coding (PC) framework of computational neuroscience. Our approach modifies the standard PC algorithm to bring performance…

Machine Learning · Computer Science 2024-11-19 Umais Zahid , Qinghai Guo , Zafeirios Fountas

Modeling a high-dimensional Hamiltonian system in reduced dimensions with respect to coarse-grained (CG) variables can greatly reduce computational cost and enable efficient bottom-up prediction of main features of the system for many…

Computational Engineering, Finance, and Science · Computer Science 2021-04-09 Shu Wang , Zhan Ma , Wenxiao Pan

Positive self-similar Markov processes (pssMp) are positive Markov processes that satisfy the scaling property and it is known that they can be represented as the exponential of a time-changed L\'evy process via Lamperti representation. In…

Probability · Mathematics 2019-12-13 Grégoire Véchambre

The kinetic Langevin dynamics finds diverse applications in various disciplines such as molecular dynamics and Hamiltonian Monte Carlo sampling. In this paper, a novel splitting scalar auxiliary variable (SSAV) scheme is proposed for the…

Numerical Analysis · Mathematics 2025-09-05 Lei Dai , Yingsong Jiang , Xiaojie Wang

As sample sizes grow, scalability has become a central concern in the development of Markov chain Monte Carlo (MCMC) methods. One general approach to this problem, exemplified by the popular stochastic gradient Langevin dynamics (SGLD)…

Computation · Statistics 2024-12-04 Natesh S. Pillai , Aaron Smith , Azeem Zaman

Neural populations exhibit latent dynamical structures that drive time-evolving spiking activities, motivating the search for models that capture both intrinsic network dynamics and external unobserved influences. In this work, we introduce…

Machine Learning · Computer Science 2026-03-11 Yue Song , T. Anderson Keller , Yisong Yue , Pietro Perona , Max Welling

Molecular dynamics simulations have the potential to provide atomic-level detail and insight to important questions in chemical physics that cannot be observed in typical experiments. However, simply generating a long trajectory is…

Chemical Physics · Physics 2015-06-22 Christian R. Schwantes , Robert T. McGibbon , Vijay S. Pande

We propose a fast algorithm for the probabilistic solution of boundary value problems (BVPs), which are ordinary differential equations subject to boundary conditions. In contrast to previous work, we introduce a Gauss--Markov prior and…

Machine Learning · Statistics 2021-06-16 Nicholas Krämer , Philipp Hennig

We study a class of systems whose dynamics are described by generalized Langevin equations with state-dependent coefficients. We find that in the limit, in which all the characteristic time scales vanish at the same rate, the position…

Mathematical Physics · Physics 2020-12-16 Soon Hoe Lim , Jan Wehr

Computer simulations often involve both qualitative and numerical inputs. Existing Gaussian process (GP) methods for handling this mainly assume a different response surface for each combination of levels of the qualitative factors and…

Machine Learning · Statistics 2019-01-31 Yichi Zhang , Siyu Tao , Wei Chen , Daniel W. Apley

Unmeasured or latent variables are often the cause of correlations between multivariate measurements, which are studied in a variety of fields such as psychology, ecology, and medicine. For Gaussian measurements, there are classical tools…

Machine Learning · Computer Science 2022-01-28 Łukasz Kidziński , Francis K. C. Hui , David I. Warton , Trevor Hastie

Graphical Markov models combine conditional independence constraints with graphical representations of stepwise data generating processes.The models started to be formulated about 40 years ago and vigorous development is ongoing.…

Methodology · Statistics 2015-10-12 Nanny Wermuth

Latent variable models (LVMs) represent observed variables by parameterized functions of latent variables. Prominent examples of LVMs for unsupervised learning are probabilistic PCA or probabilistic SC which both assume a weighted linear…

Machine Learning · Computer Science 2023-12-18 Hamid Mousavi , Jakob Drefs , Florian Hirschberger , Jörg Lücke

Reinforcement Learning Algorithms are predominantly developed for stationary environments, and the limited literature that considers nonstationary environments often involves specific assumptions about changes that can occur in transition…

Machine Learning · Computer Science 2025-09-25 Ranga Shaarad Ayyagari , Revanth Raj Eega , Ambedkar Dukkipati

We investigate Markov property of rough surfaces. Using stochastic analysis we characterize the complexity of the surface roughness by means of a Fokker-Planck or Langevin equation. The obtained Langevin equation enables us to regenerate…

Statistical Mechanics · Physics 2009-11-10 G. R. Jafari , S. M. Fazeli , F. Ghasemi , S. M. Vaez Allaei , M. Reza Rahimi Tabar , A. Iraji zad , G. Kavei

We present a novel deep learning method for estimating time-dependent parameters in Markov processes through discrete sampling. Departing from conventional machine learning, our approach reframes parameter approximation as an optimization…

Markov models are widely used to describe processes of stochastic dynamics. Here, we show that Markov models are a natural consequence of the dynamical principle of Maximum Caliber. First, we show that when there are different possible…

Statistical Mechanics · Physics 2015-05-28 Hao Ge , Steve Presse , Kingshuk Ghosh , Ken Dill

This research presents a framework for describing the average velocity magnitude of an accelerated, self-propelled Brownian particle diffusing in a thermal fluid and confined by a harmonic external potential. The system is immersed in a…

Statistical Mechanics · Physics 2026-05-05 Pedro J. Colmenares

Dynamics of non-Markovian systems is a classic problem yet it attracts an everlasting activity in physics and beyond. A powerful tool for modeling such setups is the Generalized Langevin Equation, however, its analysis typically poses a…

Statistical Mechanics · Physics 2024-10-29 Mateusz Wiśniewski , Jakub Spiechowicz

We analyze prediction error in stochastic dynamical systems with memory, focusing on generalized Langevin equations (GLEs) formulated as stochastic Volterra equations. We establish that, under a strongly convex potential, trajectory…

Machine Learning · Statistics 2025-12-12 Quanjun Lang , Jianfeng Lu