English
Related papers

Related papers: Random sampling of long-memory stationary processe

200 papers

We examine the asymptotic behaviour of the sample autocovariance in a continuous-time moving average model with long-range dependence. We show that it is either asymptotically Rosenblatt distributed or stable distributed. This shows that…

Probability · Mathematics 2015-11-24 Felix Spangenberg

Over-parameterized deep neural networks (DNNs) with sufficient capacity to memorize random noise can achieve excellent generalization performance, challenging the bias-variance trade-off in classical learning theory. Recent studies claimed…

Machine Learning · Computer Science 2022-11-15 Xiao Zhang , Haoyi Xiong , Dongrui Wu

Episodic memory is a psychology term which refers to the ability to recall specific events from the past. We suggest one advantage of this particular type of memory is the ability to easily assign credit to a specific state when remembered…

Machine Learning · Computer Science 2018-06-05 Kenny J. Young , Richard S. Sutton , Shuo Yang

A binary fluid mixture in contact with lateral particle reservoirs is considered. By imposing different particle concentrations in these reservoirs, the system can be maintained under controlled non-equilibrium conditions. Previous…

Statistical Mechanics · Physics 2026-04-01 O. Politano , Alejandro L. Garcia , F. Baras , M. Malek Mansour

A systematic investigation of the effect of the history force on particle advection is carried out for both heavy and light particles. General relations are given to identify parameter regions where the history force is expected to be…

Fluid Dynamics · Physics 2014-07-25 Anton Daitche , Tamás Tél

In this paper we introduce a new sampling algorithm which has the potential to be adopted as a universal replacement to the Metropolis--Hastings algorithm. It is related to the slice sampler, and motivated by an algorithm which is…

Computation · Statistics 2020-10-19 Yanxin Li , Stephen G. Walker

We study an exactly solvable random walk model with long-range memory on arbitrary networks. The walker performs unbiased random steps to nearest-neighbor nodes and intermittently resets to previously visited nodes in a preferential way,…

Statistical Mechanics · Physics 2024-12-11 Ana Gabriela Guerrero-Estrada , Alejandro P. Riascos , Denis Boyer

In empirical studies of random walks, continuous trajectories of animals or individuals are usually sampled over a finite number of points in space and time. It is however unclear how this partial observation affects the measured…

Physics and Society · Physics 2018-03-13 Riccardo Gallotti , Rémi Louf , Jean-Marc Luck , Marc Barthelemy

We consider the problem of `discrete-time persistence', which deals with the zero-crossings of a continuous stochastic process, X(T), measured at discrete times, T = n(\Delta T). For a Gaussian Stationary Process the persistence (no…

Statistical Mechanics · Physics 2009-11-07 George C. M. A. Ehrhardt , Alan J. Bray , Satya N. Majumdar

Large Language Models (LLMs) frequently memorize long sequences verbatim, often with serious legal and privacy implications. Much prior work has studied such verbatim memorization using observational data. To complement such work, we…

Computation and Language · Computer Science 2024-07-26 Jing Huang , Diyi Yang , Christopher Potts

In random sequential covering, identical objects are deposited randomly, irreversibly, and sequentially; only attempts increasing the coverage are accepted. A finite system eventually gets congested, and we study the statistics of congested…

Probability · Mathematics 2023-03-28 P. L. Krapivsky

The Levy diffusion processes are a form of non ordinary statistical mechanics resting, however, on the conventional Markov property. As a consequence of this, their dynamic derivation is possible provided that (i) a source of randomness is…

Statistical Mechanics · Physics 2016-08-31 Mauro Bologna , Paolo Grigolini , Juri Riccardi

The paper deals with a question of robustness of inferences, carried out on a continuous-time stationary process contaminated by a small trend, to this departure from stationarity. We show that a smoothed periodogram approach to parameter…

Statistics Theory · Mathematics 2016-01-27 M. S. Ginovyan , A. A. Sahakyan

Catastrophic forgetting affects the training of neural networks, limiting their ability to learn multiple tasks sequentially. From the perspective of the well established plasticity-stability dilemma, neural networks tend to be overly…

Machine Learning · Computer Science 2020-06-15 Seyed Iman Mirzadeh , Mehrdad Farajtabar , Razvan Pascanu , Hassan Ghasemzadeh

We study the statistical properties of random numbers under the Martin-L\"of definition of randomness, proving that random numbers obey analogues of Strong Law of Large Numbers, the Law of the Iterated Logarithm, and that they are normal.…

Logic · Mathematics 2014-10-14 Matthew Pancia

Newtonian, undamped motion in single-well potentials belong to a class of well-studied conservative systems. Here, we investigate and compare long-time properties of fully deterministic motions in single-well potentials with analogous…

Statistical Mechanics · Physics 2019-09-27 Michal Mandrysz , Bartlomiej Dybiec

While recurrent neural networks have found success in a variety of natural language processing applications, they are general models of sequential data. We investigate how the properties of natural language data affect an LSTM's ability to…

Computation and Language · Computer Science 2019-04-09 Nelson F. Liu , Omer Levy , Roy Schwartz , Chenhao Tan , Noah A. Smith

This paper concerns a spectral estimation problem in which we want to find a spectral density function that is consistent with estimated second-order statistics. It is an inverse problem admitting multiple solutions, and selection of a…

Optimization and Control · Mathematics 2019-08-08 Bin Zhu

We consider consistent particle systems, which include independent random walkers, the symmetric exclusion and inclusion processes, as well as the dual of the KMP model. Consistent systems are such that the distribution obtained by first…

Probability · Mathematics 2019-12-24 Gioia Carinci , Cristian Giardinà , Frank Redig

In this paper we give explicit examples of power-law correlated stationary Markovian processes y(t) where the stationary pdf shows tails which are gaussian or exponential. These processes are obtained by simply performing a coordinate…

Statistical Mechanics · Physics 2010-12-08 Salvatore Miccichè