English
Related papers

Related papers: Growth and Structure of Stochastic Sequences

200 papers

We derive learning rules for finding the connections between units in stochastic dynamical networks from the recorded history of a ``visible'' subset of the units. We consider two models. In both of them, the visible units are binary and…

Disordered Systems and Neural Networks · Physics 2021-04-13 Joanna Tyrcha , John Hertz

SLE_k stochastic processes describe growth of random curves which, in some cases, may be identified with boundaries of two dimensional critical percolating clusters. By generalizing SLE_k growths to formal Markov processes on the central…

Mathematical Physics · Physics 2008-11-26 M. Bauer , D. Bernard

Neural spikes in the brain form stochastic sequences, i.e., belong to the class of pulse noises. This stochasticity is a counterintuitive feature because extracting information - such as the commonly supposed neural information of mean…

Neural and Evolutionary Computing · Computer Science 2015-03-31 Laszlo B. Kish , Claes-Goran Granqvist , Sergey M. Bezrukov , Tamas Horvath

This work theoretically studies stochastic neural networks, a main type of neural network in use. We prove that as the width of an optimized stochastic neural network tends to infinity, its predictive variance on the training set decreases…

Machine Learning · Computer Science 2022-05-25 Liu Ziyin , Hanlin Zhang , Xiangming Meng , Yuting Lu , Eric Xing , Masahito Ueda

Several networks occurring in real life have modular structures that are arranged in an hierarchical fashion. In this paper, we have proposed a model for such networks, using a stochastic generation method. Using this model we show that,…

Physics and Society · Physics 2009-03-12 Raj Kumar Pan , Sitabhra Sinha

We study the entropy rate of pattern sequences of stochastic processes, and its relationship to the entropy rate of the original process. We give a complete characterization of this relationship for i.i.d. processes over arbitrary…

Information Theory · Computer Science 2007-07-13 George M. Gemelos , Tsachy Weissman

I give a highly selective overview of the way statistical mechanics explains the microscopic origins of the time asymmetric evolution of macroscopic systems towards equilibrium and of first order phase transitions in equilibrium. These…

Mathematical Physics · Physics 2009-10-31 Joel L. Lebowitz

The existence of the {\em typical set} is key for data compression strategies and for the emergence of robust statistical observables in macroscopic physical systems. Standard approaches derive its existence from a restricted set of…

Statistical Mechanics · Physics 2022-02-10 Rudolf Hanel , Bernat Corominas-Murtra

We study a stochastic model based on a modified fragmentation of a finite interval. The mechanism consists in cutting the interval at a random location and substituting a unique fragment on the right of the cut to regenerate and preserve…

Statistical Mechanics · Physics 2018-04-25 Jean-Yves Fortin

A construction sequence for a graph is a listing of the elements of the graph (the set of vertices and edges) such that each edge follows both its endpoints. The construction number of the graph is the number of such sequences. We determine…

Combinatorics · Mathematics 2024-12-03 Paul C. Kainen

An infinite binary sequence is deemed to be random if it has all definable properties that hold almost surely for the usual probability measure on the set of infinite binary sequences. There are only countably many such properties, so it…

Probability · Mathematics 2011-03-18 Peter G. Doyle

We consider birth-and-death stochastic evolution of genotypes with different lengths. The genotypes might mutate that provides a stochastic changing of lengthes by a free diffusion law. The birth and death rates are length dependent which…

Populations and Evolution · Quantitative Biology 2015-06-16 Dmitri Finkelshtein , Yuri Kondratiev , Oleksandr Kutoviy , Stanislav Molchanov , Elena Zhizhina

Sequential modelling entails making sense of sequential data, which naturally occurs in a wide array of domains. One example is systems that interact with users, log user actions and behaviour, and make recommendations of items of potential…

Information Retrieval · Computer Science 2021-09-15 Christian Hansen

It is argued that the present log-normal distribution of language sizes is, to a large extent, a consequence of demographic dynamics within the population of speakers of each language. A two-parameter stochastic multiplicative process is…

Data Analysis, Statistics and Probability · Physics 2009-11-13 Damian H. Zanette

We provide a general framework to study stochastic sequences related to individual learning in economics, learning automata in computer sciences, social learning in marketing, and other applications. More precisely, we study the asymptotic…

Probability · Mathematics 2014-10-07 Carlos Oyarzun , Johannes Ruf

For each of (i) arbitrary stochastic reset, (ii) deterministic reset with arbitrary period, (iii) reset at arbitrary constant rate, and then in the sense of either (a) first-order stochastic dominance or (b) expectation (i.e. for each of…

Probability · Mathematics 2020-05-12 Matija Vidmar

Pattern forming systems allow for a wealth of states, where wavelengths and orientation of patterns varies and defects disrupt patches of monocrystalline regions. Growth of patterns has long been recognized as a strong selection mechanism.…

Pattern Formation and Solitons · Physics 2023-02-28 Ryan Goh , Arnd Scheel

Many stochastic physical systems evolve smoothly over time in the sense that the distribution of states changes regularly across time steps. The transition from current state to the next state can often be modeled as the combination of a…

Machine Learning · Computer Science 2026-05-29 Jules Berman , Tobias Blickhan , Benjamin Peherstorfer

The study of "random segments" is a classic issue in geometrical probability, whose complexity depends on how it is defined. But in apparently simple models, the random behavior is not immediate. In the present manuscript the following…

Probability · Mathematics 2023-09-07 Paulo Manrique-Mirón

How to model distribution of sequential data, including but not limited to speech and human motions, is an important ongoing research problem. It has been demonstrated that model capacity can be significantly enhanced by introducing…

Machine Learning · Computer Science 2018-06-19 Guokun Lai , Bohan Li , Guoqing Zheng , Yiming Yang