English
Related papers

Related papers: Concentration inequalities for sequential dynamica…

200 papers

Transformer models have achieved remarkable results in a wide range of applications. However, their scalability is hampered by the quadratic time and memory complexity of the self-attention mechanism concerning the sequence length. This…

Machine Learning · Computer Science 2024-02-27 Yury Nahshan , Joseph Kampeas , Emir Haleva

We extend recent higher order concentration results in the discrete setting to include functions of possibly dependent variables whose distribution (on the product space) satisfies a logarithmic Sobolev inequality with respect to a…

Probability · Mathematics 2020-05-15 Friedrich Götze , Holger Sambale , Arthur Sinulis

We establish some quantitative concentration estimates for the empirical measure of many independent variables, in transportation distances. As an application, we provide some error bounds for particle simulations in a model mean field…

Probability · Mathematics 2013-09-19 Francois Bolley , Arnaud Guillin , Cedric Villani

We investigate the statistics of recurrences to finite size intervals for chaotic dynamical systems. We find that the typical distribution presents an exponential decay for almost all recurrence times except for a few short times affected…

Chaotic Dynamics · Physics 2007-05-23 E. G. Altmann , E. C. da Silva , I. L. Caldas

Recent studies have shown that one-dimensional driven systems can exhibit phase separation even if the dynamics is governed by local rules. The ABC model, which comprises three particle species that diffuse asymmetrically around a ring,…

Statistical Mechanics · Physics 2016-08-31 M. Clincy , B. Derrida , M. R. Evans

Irreversibility and acausality of a sub-system are established in exactly soluble harmonic models with reversible and causal dynamics. It is shown that initial conditions, imposed on some dynamical degrees of freedom may break time reversal…

High Energy Physics - Theory · Physics 2015-05-30 Janos Polonyi

Transformer architectures have achieved state-of-the-art results on a variety of sequence modeling tasks. However, their attention mechanism comes with a quadratic complexity in sequence lengths, making the computational overhead…

Computation and Language · Computer Science 2022-06-03 Hao Peng , Jungo Kasai , Nikolaos Pappas , Dani Yogatama , Zhaofeng Wu , Lingpeng Kong , Roy Schwartz , Noah A. Smith

Group sequential designs in clinical trials allow for interim efficacy and futility monitoring. Adjustment for baseline covariates can increase power and precision of estimated effects. However, inconsistently applying covariate adjustment…

Methodology · Statistics 2023-08-11 Marlena S. Bannick , Sonya L. Heltshe , Noah Simon

A functional limit theorem for the partial maxima of a long memory stable sequence produces a limiting process that can be described as a $\beta$-power time change in the classical Fr\'echet extremal process, for $\beta$ in a subinterval of…

Probability · Mathematics 2016-06-07 Céline Lacaux , Gennady Samorodnitsky

Moving from univariate to bivariate jointly dependent long-memory time series introduces a phase parameter $(\gamma)$, at the frequency of principal interest, zero; for short-memory series $\gamma=0$ automatically. The latter case has also…

Statistics Theory · Mathematics 2008-11-07 P. M. Robinson

We consider nonequilibrium transport in a simple chain of identical mechanical cells in which particles move around. In each cell, there is a rotating disc, with which these particles interact, and this is the only interaction in the model.…

Statistical Mechanics · Physics 2008-07-15 Jean-Pierre Eckmann , Carlos Mejia-Monasterio , Emmanuel Zabey

The convex transform order is one way to make precise comparison between the skewness of probability distributions on the real line. We establish a simple and complete characterisation of when one Beta distribution is smaller than another…

Probability · Mathematics 2021-01-01 Idir Arab , Paulo Eduardo Oliveira , Tilo Wiklund

We investigate the asymptotic behavior of probability measures associated with stochastic dynamical systems featuring either globally contracting or $B_{r}$-contracting drift terms. While classical results often assume constant diffusion…

Dynamical Systems · Mathematics 2025-05-14 Simone Betteti , Francesco Bullo

In this paper, we apply Devroye inequality to study various statistical estimators and fluctuations of observables for processes. Most of these observables are suggested by dynamical systems. These applications concern the co-variance…

Dynamical Systems · Mathematics 2009-11-10 J. -R. Chazottes , P. Collet , B. Schmitt

Conventional wisdom indicates that initial memory should decay away exponentially in time for general (noncritial) equilibration processes. In particular, time-integrated quantities such as heat are presumed to lose initial memory in a…

Statistical Mechanics · Physics 2015-06-11 J. S. Lee , Chulan Kwon , Hyunggyu Park

The classic paradigms for learning and memory recall focus on strengths of synaptic couplings and how these can be modulated to encode memories. In a previous paper [A. K. Behera, M. Rao, S. Sastry, and S. Vaikuntanathan, Physical Review X…

Disordered Systems and Neural Networks · Physics 2024-10-10 Agnish Kumar Behera , Matthew Du , Uday Jagadisan , Srikanth Sastry , Madan Rao , Suriyanarayanan Vaikuntanathan

Via operator theoretic methods, we formalize the concentration phenomenon for a given observable `$r$' of a discrete time Markov chain with `$\mu_{\pi}$' as invariant ergodic measure, possibly having support on an unbounded state space. The…

Machine Learning · Computer Science 2023-06-01 Muhammad Abdullah Naeem , Miroslav Pajic

We consider a one dimensional affine switched system obtained from a formal limit of a two dimensional linear system. We show this is equivalent to minimising the average digit in beta representations with unrestricted digits. We give a…

Optimization and Control · Mathematics 2025-09-11 Carl P. Dettmann

We study approximation of non-autonomous linear differential equations with variable delay over infinite intervals. We use piecewise constant argument to obtain a corresponding discrete difference equation. The study of numerical…

Classical Analysis and ODEs · Mathematics 2016-07-26 Daniel Sepúlveda

We introduce and analyze a **memory-weighted velocity operator** \(\mathscr{V}_{\alpha,\beta}\) as a mathematical framework for describing rates of change in systems with time-varying, power-law memory. The operator employs two independent…

Mathematical Physics · Physics 2026-01-23 Jiahao Jiang