English
Related papers

Related papers: Large Deviations Properties of Maximum Entropy Mar…

200 papers

We derive a synaptic weight update rule for learning temporally precise spike train to spike train transformations in multilayer feedforward networks of spiking neurons. The framework, aimed at seamlessly generalizing error backpropagation…

Neural and Evolutionary Computing · Computer Science 2016-01-11 Arunava Banerjee

We study the temporal dissipation of variance and relative entropy for ergodic Markov Chains in continuous time, and compute explicitly the corresponding dissipation rates. These are identified, as is well known, in the case of the variance…

Probability · Mathematics 2022-05-19 Ioannis Karatzas , Jan Maas , Walter Schachermayer

For one-dimensional Jump-Drift and Jump-Diffusion processes converging towards some steady state, the large deviations of a long dynamical trajectory are described from two perspectives. Firstly, the joint probability of the empirical…

Statistical Mechanics · Physics 2021-08-17 Cecile Monthus

In this paper, we propose a variance reduction approach for Markov chains based on additive control variates and the minimization of an appropriate estimate for the asymptotic variance. We focus on the particular case when control variates…

Statistics Theory · Mathematics 2024-10-29 Denis Belomestny , Artur Goldman , Alexey Naumov , Sergey Samsonov

We derive a large deviation principle for families of random variables in the basin of attraction of spectrally positive stable distributions by proving a uniform version of the Tauberian theorem for Laplace-Stieltjes transforms. The main…

Probability · Mathematics 2026-05-25 Giampaolo Cristadoro , Gaia Pozzoli

The standard approach to fitting an autoregressive spike train model is to maximize the likelihood for one-step prediction. This maximum likelihood estimation (MLE) often leads to models that perform poorly when generating samples…

Machine Learning · Statistics 2020-10-26 Diego M. Arribas , Yuan Zhao , Il Memming Park

This paper proposes a new type of recurrence where we divide the Markov chains into intervals that start when the chain enters into a subset A, then sample another subset B far away from A and end when the chain again return to A. The…

Methodology · Statistics 2016-02-24 Lars Holden

Let $\Xi_n \subset \mathbb R^d$, $n\ge 1$, be a sequence of finite sets and consider a $\Xi_n$-valued, irreducible, reversible, continuous-time Markov chain $(X^{(n)}_t:t\ge 0)$. Denote by $\mathscr P(\mathbb R^d) $ the set of probability…

Probability · Mathematics 2025-12-09 Claudio Landim , Ricardo Misturini , Federico Sau

Markov processes restarted or reset at random times to a fixed state or region in space have been actively studied recently in connection with random searches, foraging, and population dynamics. Here we study the large deviations of…

Statistical Mechanics · Physics 2016-01-06 Janusz M. Meylahn , Sanjib Sabhapandit , Hugo Touchette

Statistical analysis and inferences on spike trains are one of the central topics in neural coding. It is of great interest to understand the underlying distribution and geometric structure of given spike train data. However, a fundamental…

Neurons and Cognition · Quantitative Biology 2015-06-11 Sergiusz Wesolowski , Alexandre A. Nikonov , Robert J. Contreras , Wei Wu

In the last few decades, noise-induced large fluctuations and transition phenomena have garnered significant attention in a variety of scientific contexts. The concept of prehistory probability has been proposed within the framework of…

Probability · Mathematics 2026-03-10 Feng Zhao , Jinjie Zhu , Yang Li , Xianbin Liu , Dongping Jin

Advances in modern technology have enabled the simultaneous recording of neural spiking activity, which statistically can be represented by a multivariate point process. We characterise the second order structure of this process via the…

Methodology · Statistics 2024-04-30 Carla Pinkney , Carolina Euan , Alex Gibberd , Ali Shojaie

The problem of efficiently sampling from a set of(undirected) graphs with a given degree sequence has many applications. One approach to this problem uses a simple Markov chain, which we call the switch chain, to perform the sampling. The…

Data Structures and Algorithms · Computer Science 2014-12-18 Catherine Greenhill

Estimating the entropy based on data is one of the prototypical problems in distribution property testing and estimation. For estimating the Shannon entropy of a distribution on $S$ elements with independent samples, [Paninski2004] showed…

Machine Learning · Computer Science 2018-09-25 Yanjun Han , Jiantao Jiao , Chuan-Zheng Lee , Tsachy Weissman , Yihong Wu , Tiancheng Yu

Most successful applications of deep learning involve similar training and test conditions. However, tasks such as biological sequence design involve searching for sequences that improve desirable properties beyond previously known values,…

Machine Learning · Computer Science 2025-05-27 Sophia Hager , Aleem Khan , Andrew Wang , Nicholas Andrews

We propose a new approach for estimating the finite dimensional transition matrix of a Markov chain using a large number of independent sample paths observed at random times. The sample paths may be observed as few as two times, and the…

Methodology · Statistics 2025-05-20 Daphne Aurouet , Valentin Patilea

A piecewise-deterministic Markov process, specified by random jumps and switching semi-flows, as well as the associated Markov chain given by its post-jump locations, are investigated in this paper. The existence of an exponentially…

Probability · Mathematics 2020-12-07 Dawid Czapla , Katarzyna Horbacz , Hanna Wojewódka-Ściążko

The relative timing of action potentials in neurons recorded from local cortical networks often shows a non-trivial dependence, which is then quantified by cross-correlation functions. Theoretical models emphasize that such spike train…

Neurons and Cognition · Quantitative Biology 2017-06-28 Taskin Deniz , Stefan Rotter

The field of complex networks studies a wide variety of interacting systems by representing them as networks. To understand their properties and mutual relations, the randomisation of network connections is a commonly used tool. However,…

Statistical Mechanics · Physics 2024-10-18 Noam Abadi , Franco Ruzzenenti

We explore the dependence structure in the sampled sequence of large networks. We consider randomized algorithms to sample the nodes and study extremal properties in any associated stationary sequence of characteristics of interest like…

Social and Information Networks · Computer Science 2015-02-25 Konstantin Avrachenkov , Natalia M. Markovich , Jithin K. Sreedharan