English
Related papers

Related papers: Recursive estimation of time-average variance cons…

200 papers

Oscillators are ubiquitous in nature, and usually associated with the existence of an asymptotic phase that governs the long-term dynamics of the oscillator. % We show that asymptotic phase can be estimated using a carefully chosen series…

Dynamical Systems · Mathematics 2022-03-10 Simon Wilshin , Matthew D. Kvalheim , Clayton Scott , Shai Revzen

Although the Transformer has become the cornerstone of modern AI, its autoregressive inference suffers from a linearly growing KV Cache and a computational complexity of O(N^2 d), severely hindering its ability to process ultra-long…

Machine Learning · Computer Science 2025-09-03 Zhongpan Tang

The geometric median covariation matrix is a robust multivariate indicator of dispersion which can be extended without any difficulty to functional data. We define estimators, based on recursive algorithms, that can be simply updated at…

Statistics Theory · Mathematics 2016-07-12 Hervé Cardot , Antoine Godichon-Baggioni

This paper considers time-average stochastic optimization, where a time average decision vector, an average of decision vectors chosen in every time step from a time-varying (possibly non-convex) set, minimizes a convex objective function…

Optimization and Control · Mathematics 2015-01-29 Sucha Supittayapornpong , Michael J. Neely

Th\^eo1 is a frequency stability statistic which is similar to the Allan variance but can provide stability estimates at longer averaging factors and with higher confidence. However, the calculation of Th\^eo1 is significantly slower than…

Data Analysis, Statistics and Probability · Physics 2021-06-08 Ben Lewis

Continuous-time generative models, such as diffusion models, flow matching, and rectified flow, learn time-dependent vector fields but are typically trained with objectives that treat timesteps independently, leading to high estimator…

Machine Learning · Computer Science 2026-02-23 Chika Maduabuchi , Jindong Wang

Dynamical spectral estimation is a well-established numerical approach for estimating eigenvalues and eigenfunctions of the Markov transition operator from trajectory data. Although the approach has been widely applied in biomolecular…

Numerical Analysis · Mathematics 2023-10-03 Robert J. Webber , Erik H. Thiede , Douglas Dow , Aaron R. Dinner , Jonathan Weare

This paper considers regression tasks involving high-dimensional multivariate processes whose structure is dependent on some {known} graph topology. We put forth a new definition of time-vertex wide-sense stationarity, or joint stationarity…

Machine Learning · Computer Science 2019-07-09 Andreas Loukas , Nathanaël Perraudin

High-dimensional vector autoregressive (VAR) models are important tools for the analysis of multivariate time series. This paper focuses on high-dimensional time series and on the different regularized estimation procedures proposed for…

Machine Learning · Statistics 2020-06-11 Jonas Krampe , Efstathios Paparoditis

While matrix variate regression models have been studied in many existing works, classical statistical and computational methods for the analysis of the regression coefficient estimation are highly affected by high dimensional and noisy…

Machine Learning · Statistics 2022-05-17 Hsin-Hsiung Huang , Feng Yu , Xing Fan , Teng Zhang

Arbitrary varying channels (AVC) are used to model communication settings in which a channel state may vary arbitrarily over time. Their primary objective is to circumvent statistical assumptions on channel variation. Traditional studies on…

Information Theory · Computer Science 2024-07-04 Michael Langberg , Oron Sabag

We study a variable length Markov chain model associated with a group of stationary processes that share the same context tree but each process has potentially different conditional probabilities. We propose a new model selection and…

Methodology · Statistics 2016-01-01 Alexandre Belloni , Roberto I. Oliveira

Vector autoregressions (VARs) are a widely used tool for modelling multivariate time-series. It is common to assume a VAR is stationary; this can be enforced by imposing the stationarity condition which restricts the parameter space of the…

In this paper, we analyse the consistency of the Simplified Refined Instrumental Variable method for Continuous-time systems (SRIVC). It is well known that the intersample behaviour of the input signal influences the quality and accuracy of…

Systems and Control · Electrical Eng. & Systems 2019-10-02 Siqi Pan , Rodrigo A. González , James S. Welsh , Cristian R. Rojas

In this paper, we investigate a nonparametric approach to provide a recursive estimator of the transition density of a non-stationary piecewise-deterministic Markov process, from only one observation of the path within a long time. In this…

Statistics Theory · Mathematics 2013-05-07 Romain Azaïs

Many real-world systems modeled using partial differential equations (PDEs) involve unknown parameters that must be estimated from limited, noisy system observations. While typically assumed to be constants, some of these unobserved…

Methodology · Statistics 2025-08-19 Andrea Arnold

A variational formula for the asymptotic variance of general Markov processes is obtained. As application, we get a upper bound of the mean exit time of reversible Markov processes, and some comparison theorems between the reversible and…

Probability · Mathematics 2021-06-02 Lu-Jing Huang , Yong-Hua Mao , Tao Wang

Recurrence quantification analysis (RQA) is a widely used tool for studying complex dynamical systems, but its standard implementation requires computationally expensive calculations of recurrence plots (RPs) and line length histograms.…

Chaotic Dynamics · Physics 2026-01-06 Norbert Marwan

We consider the problem of approximating the stationary distribution of an ergodic Markov chain given a set of sampled transitions. Classical simulation-based approaches assume access to the underlying process so that trajectories of…

Machine Learning · Computer Science 2020-03-03 Junfeng Wen , Bo Dai , Lihong Li , Dale Schuurmans

Connectionist temporal classification (CTC) is commonly adopted for sequence modeling tasks like speech recognition, where it is necessary to preserve order between the input and target sequences. However, CTC is only applied to…

Machine Learning · Computer Science 2023-12-18 Zheng Nan , Ting Dang , Vidhyasaharan Sethu , Beena Ahmed