English
Related papers

Related papers: Sharp error terms for return time statistics under…

200 papers

Using a proper model to characterize a time series is crucial in making accurate predictions. In this work we use time-varying autoregressive process (TVAR) to describe non-stationary time series and model it as a mixture of multiple stable…

Machine Learning · Statistics 2016-11-17 Jie Ding , Mohammad Noshad , Vahid Tarokh

We consider a biological population whose environment varies periodically in time, exhibiting two very different "seasons" : one is favorable and the other one is unfavorable. For monotone differential models with concave nonlinearities, we…

Dynamical Systems · Mathematics 2018-04-23 Martin Strugarek , Hongjun Ji

We consider binary infinite order stochastic chains perturbed by a random noise. This means that at each time step, the value assumed by the chain can be randomly and independently flipped with a small fixed probability. We show that the…

Probability · Mathematics 2007-07-20 Pierre Collet , Antonio Galves , Florencia G. Leonardi

Estimating the entropy based on data is one of the prototypical problems in distribution property testing and estimation. For estimating the Shannon entropy of a distribution on $S$ elements with independent samples, [Paninski2004] showed…

Machine Learning · Computer Science 2018-09-25 Yanjun Han , Jiantao Jiao , Chuan-Zheng Lee , Tsachy Weissman , Yihong Wu , Tiancheng Yu

The paper concerns a particular example of the Gibbs sampler and its mixing efficiency. Coordinates of a point are rerandomized in the unit square $[0,1]^2$ to approach a stationary distribution with density proportional to…

Probability · Mathematics 2018-10-09 Balázs Gerencsér

We propose novel algorithms for sequence prediction based on ideas from stringology. These algorithms are time and space efficient and satisfy mistake bounds related to particular stringological complexity measures of the sequence. In this…

Formal Languages and Automata Theory · Computer Science 2026-03-31 Vanessa Kosoy

Stochastic Approximation (SA) is a widely used algorithmic approach in various fields, including optimization and reinforcement learning (RL). Among RL algorithms, Q-learning is particularly popular due to its empirical success. In this…

Machine Learning · Statistics 2024-01-26 Yixuan Zhang , Qiaomin Xie

While on the one hand, chaotic dynamical systems can be predicted for all time given exact knowledge of an initial state, they are also in many cases rapidly mixing, meaning that smooth probabilistic information (quantified by measures) on…

Dynamical Systems · Mathematics 2024-05-08 Caroline L. Wormell

In this paper, we extend the notion of gapped strings to elastic-degenerate strings. An elastic-degenerate string can been seen as an ordered collection of k > 1 seeds (substrings/subpatterns) interleaved by elastic-degenerate symbols such…

Data Structures and Algorithms · Computer Science 2016-10-27 Costas Iliopoulos , Ritu Kundu , Solon Pissis

We consider the problem of estimating the trace of a matrix function $f(A)$. In certain situations, in particular if $f(A)$ cannot be well approximated by a low-rank matrix, combining probing methods based on graph colorings with stochastic…

Numerical Analysis · Mathematics 2023-08-16 Andreas Frommer , Michele Rinelli , Marcel Schweitzer

The generalization error of a learning algorithm refers to the discrepancy between the loss of a learning algorithm on training data and that on unseen testing data. Various information-theoretic bounds on the generalization error have been…

Information Theory · Computer Science 2025-06-24 Xuetong Wu , Jonathan H. Manton , Uwe Aickelin , Jingge Zhu

We consider an \emph{approximate} version of the trace reconstruction problem, where the goal is to recover an unknown string $s\in\{0,1\}^n$ from $m$ traces (each trace is generated independently by passing $s$ through a probabilistic…

Data Structures and Algorithms · Computer Science 2021-07-21 Diptarka Chakraborty , Debarati Das , Robert Krauthgamer

In this work, we deal with an iteration method for approximating a fixed point of a contraction mapping using the Mann's algorithm under functional random errors. We first show its almost complete convergence to the fixed point by mean of…

Probability · Mathematics 2017-01-24 Bahia Barache , Idir Arab , Abdelnasser Dahmani

Predictive recursion (PR) is a fast stochastic algorithm for nonparametric estimation of mixing distributions in mixture models. It is known that the PR estimates of both the mixing and mixture densities are consistent under fairly mild…

Statistics Theory · Mathematics 2011-11-28 Ryan Martin

We consider stochastic point processes generating time series exhibiting power laws of spectrum and distribution density (Phys. Rev. E 71, 051105 (2005)) and apply them for modeling the trading activity in the financial markets and for the…

Data Analysis, Statistics and Probability · Physics 2015-05-18 B. Kaulakys , M. Alaburda , V. Gontis

Asymmetric statistical errors arise for experimental results obtained by Maximum Likelihood estimation, in cases where the number of results is finite and the log likelihood function is not a symmetric parabola. This note discusses how…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Roger Barlow

We consider list versions of sparse approximation problems, where unlike the existing results in sparse approximation that consider situations with unique solutions, we are interested in multiple solutions. We introduce these problems and…

Information Theory · Computer Science 2014-08-12 Mahmoud Abo Khamis , Anna C. Gilbert , Hung Q. Ngo , Atri Rudra

We prove that for any $\alpha$-mixing stationnary process the hitting time of any $n$-string $A_n$ converges, when suitably normalized, to an exponential law. We identify the normalization constant $\lambda(A_n)$. A similar statement holds…

Dynamical Systems · Mathematics 2010-07-28 Miguel Abadi , Benoit Saussol

Motivated by the widespread use of temporal-difference (TD-) and Q-learning algorithms in reinforcement learning, this paper studies a class of biased stochastic approximation (SA) procedures under a mild "ergodic-like" assumption on the…

Machine Learning · Statistics 2020-09-02 Gang Wang , Bingcong Li , Georgios B. Giannakis

Parametric estimation for diffusion processes is considered for high frequency observations over a fixed time interval. The processes solve stochastic differential equations with an unknown parameter in the diffusion coefficient. We find…

Methodology · Statistics 2017-04-03 Nina Munkholt Jakobsen , Michael Sørensen