English
Related papers

Related papers: Action Functional Gradient Descent algorithm for e…

200 papers

Many biological processes exhibit oscillatory behavior. Among these, glycolytic oscillations have been extensively studied due to their well-characterized biochemical reaction networks. However, the complexity of these networks necessitates…

Probability · Mathematics 2026-03-23 Arnab Ganguly , Hye-Won Kang

We introduce and test an algorithm that adaptively estimates large deviation functions characterizing the fluctuations of additive functionals of Markov processes in the long-time limit. These functions play an important role for predicting…

Statistical Mechanics · Physics 2023-03-30 Grégoire Ferré , Hugo Touchette

Stochastic gradient methods are the workhorse (algorithms) of large-scale optimization problems in machine learning, signal processing, and other computational sciences and engineering. This paper studies Markov chain gradient descent, a…

Optimization and Control · Mathematics 2018-09-13 Tao Sun , Yuejiao Sun , Wotao Yin

Optimal designs minimize the number of experimental runs (samples) needed to accurately estimate model parameters, resulting in algorithms that, for instance, efficiently minimize parameter estimate variance. Governed by knowledge of past…

Methodology · Statistics 2023-02-03 Nicholas W. Barendregt , Emily G. Webb , Zachary P. Kilpatrick

We construct path integrals for stochastic hybrid reaction-diffusion (RD) processes, in which the reaction terms depend on the discrete state of a randomly switching environment. We proceed by spatially discretizing a given RD system and…

Statistical Mechanics · Physics 2021-10-15 Paul C. Bressloff

Consider the standard stochastic reaction network model where the dynamics is given by a continuous-time Markov chain over a discrete lattice. For such models, estimation of parameter sensitivities is an important problem, but the existing…

Quantitative Methods · Quantitative Biology 2019-05-01 Patrik Dürrenberger , Ankit Gupta , Mustafa Khammash

In computational system biology, the mesoscopic model of reaction-diffusion kinetics is described by a continuous time, discrete space Markov process. To simulate diffusion stochastically, the jump coefficients are obtained by a…

Numerical Analysis · Mathematics 2018-02-19 Lina Meinecke , Stefan Engblom , Andreas Hellander , Per Lötstedt

Cellular signaling networks have evolved to cope with intrinsic fluctuations, coming from the small numbers of constituents, and the environmental noise. Stochastic chemical kinetics equations govern the way biochemical networks process…

Quantitative Methods · Quantitative Biology 2009-11-13 Yueheng Lan , Peter G. Wolynes , Garegin A. Papoian

Stochastic kinetic models describe systems across biology, chemistry, and physics where discrete events and small populations render deterministic approximations inadequate. Parameter inference and inverse design in these systems require…

Computational Physics · Physics 2026-03-06 Francesco Mottes , Qian-Ze Zhu , Michael P. Brenner

We present an efficient finite difference method for the computation of parameter sensitivities that is applicable to a wide class of continuous time Markov chain models. The estimator for the method is constructed by coupling the perturbed…

Numerical Analysis · Mathematics 2012-05-14 David F. Anderson

In this work, we present a general method to establish properties of multi-dimensional continuous-time Markov chains representing stochastic reaction networks. This method consists of grouping states together (via a partition of the state…

Probability · Mathematics 2025-05-27 Guillaume Ballif , Laurent Pfeiffer , Jakob Ruess

Inspired by dynamic programming, we propose Stochastic Virtual Gradient Descent (SVGD) algorithm where the Virtual Gradient is defined by computational graph and automatic differentiation. The method is computationally efficient and has…

Machine Learning · Computer Science 2019-08-01 Zheng Li , Shi Shu

Piecewise-deterministic Markov processes form a general class of non-diffusion stochastic models that involve both deterministic trajectories and random jumps at random times. In this paper, we state a new characterization of the jump rate…

Methodology · Statistics 2017-05-03 Romain Azaïs , Alexandre Genadot

The stochastic reaction network in which chemical species evolve through a set of reactions is widely used to model stochastic processes in physics, chemistry and biology. To characterize the evolving joint probability distribution in the…

Molecular Networks · Quantitative Biology 2023-02-08 Ying Tang , Jiayu Weng , Pan Zhang

In a variety of problems originating in supervised, unsupervised, and reinforcement learning, the loss function is defined by an expectation over a collection of random variables, which might be part of a probabilistic model or the external…

Machine Learning · Computer Science 2016-01-06 John Schulman , Nicolas Heess , Theophane Weber , Pieter Abbeel

We prove a large-deviation principle (LDP) for the sample paths of jump Markov processes in the small noise limit when, possibly, all the jump rates vanish uniformly, but slowly enough, in a region of the state space. We further discuss the…

Probability · Mathematics 2021-02-26 Andrea Agazzi , Luisa Andreis , Robert I. A. Patterson , D. R. Michiel Renger

We propose a general purpose variational inference algorithm that forms a natural counterpart of gradient descent for optimization. Our method iteratively transports a set of particles to match the target distribution, by applying a form of…

Machine Learning · Statistics 2019-09-10 Qiang Liu , Dilin Wang

Recent studies have shown that fractional calculus is an effective alternative mathematical tool in various scientific fields. However, some investigations indicate that results established in differential and integral calculus do not…

Optimization and Control · Mathematics 2026-03-09 Higor V. M. Ferreira , Camila A. Tavares , Nelson H. T. Lemes , José P. C. dos Santos

Stochastic gradient descent is an optimisation method that combines classical gradient descent with random subsampling within the target functional. In this work, we introduce the stochastic gradient process as a continuous-time…

Probability · Mathematics 2021-05-11 Jonas Latz

We propose an online parametric estimation method of stochastic differential equations with discrete observations and misspecified modelling based on online gradient descent. Our study provides uniform upper bounds for the risks of the…

Statistics Theory · Mathematics 2022-10-18 Shogo Nakakita