English
Related papers

Related papers: Accurate estimator of correlations between asynchr…

200 papers

We propose an asynchronous, decentralized algorithm for consensus optimization. The algorithm runs over a network in which the agents communicate with their neighbors and perform local computation. In the proposed algorithm, each agent can…

Optimization and Control · Mathematics 2017-03-06 Tianyu Wu , Kun Yuan , Qing Ling , Wotao Yin , Ali H. Sayed

We discuss the various definitions of time correlation functions and how to estimate them from experimental or simulation data. We start with the various definitions, both in real and in Fourier space, and explain how to extract from them a…

Statistical Mechanics · Physics 2020-02-06 Tomas S. Grigera

Properly estimating correlations between objects at different spatial scales necessitates $\mathcal{O}(n^2)$ distance calculations. For this reason, most widely adopted packages for estimating correlations use clustering algorithms to…

Sensors are the key to environmental monitoring, which impart benefits to smart cities in many aspects, such as providing real-time air quality information to assist human decision-making. However, it is impractical to deploy massive…

Machine Learning · Computer Science 2024-04-24 Junfeng Hu , Yuxuan Liang , Zhencheng Fan , Li Liu , Yifang Yin , Roger Zimmermann

We consider the estimation of approximate factor models for time series data, where strong serial and cross-sectional correlations amongst the idiosyncratic component are present. This setting comes up naturally in many applications, but…

Methodology · Statistics 2019-12-10 Jiahe Lin , George Michailidis

Time series anomaly detection plays a crucial role in a wide range of real-world applications. Given that time series data can exhibit different patterns at different sampling granularities, multi-scale modeling has proven beneficial for…

Machine Learning · Computer Science 2025-10-15 Beibu Li , Qichao Shentu , Yang Shu , Hui Zhang , Ming Li , Ning Jin , Bin Yang , Chenjuan Guo

Computable Information Density (CID), the ratio of the length of a losslessly compressed data file to that of the uncompressed file, is a measure of order and correlation in both equilibrium and nonequilibrium systems. Here we show that…

Statistical Mechanics · Physics 2020-10-26 Stefano Martiniani , Yuval Lemberg , Paul M. Chaikin , Dov Levine

Finding interdependency relations between (possibly multivariate) time series provides valuable knowledge about the processes that generate the signals. Information theory sets a natural framework for non-parametric measures of several…

Information Theory · Computer Science 2016-02-09 German Gomez-Herrero , Wei Wu , Kalle Rutanen , Miguel C. Soriano , Gordon Pipa , Raul Vicente

Massive data analysis calls for distributed algorithms and theories. We design a multi-round distributed algorithm for canonical correlation analysis. We construct principal directions through the convex formulation of canonical correlation…

Computation · Statistics 2024-12-24 Canyi Chen , Liping Zhu

With the advent of surveys containing millions to billions of galaxies, it is imperative to develop analysis techniques that utilize the available statistical power. In galaxy clustering, even small sample contamination arising from…

Cosmology and Nongalactic Astrophysics · Physics 2020-02-18 Humna Awan , Eric Gawiser

Simulating sample correlation matrices is important in many areas of statistics. Approaches such as generating Gaussian data and finding their sample correlation matrix or generating random uniform $[-1,1]$ deviates as pairwise correlations…

Statistics Theory · Mathematics 2013-12-09 Johanna Hardin , Stephan Ramon Garcia , David Golan

Causal inference on time series data is a challenging problem, especially in the presence of unobserved confounders. This work focuses on estimating the causal effect between two time series that are confounded by a third, unobserved time…

Machine Learning · Statistics 2024-11-19 Felix Schur , Jonas Peters

In passive monitoring using sensor networks, low energy supplies drastically constrain sensors in terms of calculation and communication abilities. Designing processing algorithms at the sensor level that take into account these constraints…

Applications · Statistics 2015-11-23 Augusto Zebadua , Pierre-Olivier Amblard , Eric Moisan , Olivier . J. J. Michel

We present a method to compensate statistical errors in the calculation of correlations on asynchronous time series. The method is based on the assumption of an underlying time series. We set up a model and apply it to financial data to…

Statistical Finance · Quantitative Finance 2010-07-07 Michael C. Münnix , Rudi Schäfer , Thomas Guhr

Time delay estimation has long been an active area of research. In this work, we show that compressive sensing with interpolation may be used to achieve good estimation precision while lowering the sampling frequency. We propose an…

Information Theory · Computer Science 2013-06-12 Karsten Fyhn , Marco F. Duarte , Søren Holdt Jensen

This paper proposes a flexible framework for inferring large-scale time-varying and time-lagged correlation networks from multivariate or high-dimensional non-stationary time series with piecewise smooth trends. Built on a novel and unified…

Methodology · Statistics 2023-02-13 Lujia Bai , Weichi Wu

We apply Bayesian statistics to the estimation of correlation functions. We give the probability distributions of auto- and cross-correlations as functions of the data. Our procedure uses the measured data optimally and informs about the…

Data Analysis, Statistics and Probability · Physics 2022-12-27 Angel Gutierrez-Rubio , Juan S. Rojas-Arias , Jun Yoneda , Seigo Tarucha , Daniel Loss , Peter Stano

Correlation remains to be one of the most widely used statistical tools for assessing the strength of relationships between data series. This paper presents a novel compositional correlation method for detecting linear and nonlinear…

Methodology · Statistics 2022-02-09 Fatih Dikbas

Canonical correlation analysis (CCA) describes the associations between two sets of variables by maximizing the correlation between linear combinations of the variables in each data set. However, in high-dimensional settings where the…

Methodology · Statistics 2015-01-07 Ines Wilms , Christophe Croux

An increasing body of research focuses on using neural networks to model time series. A common assumption in training neural networks via maximum likelihood estimation on time series is that the errors across time steps are uncorrelated.…

Machine Learning · Computer Science 2021-10-12 Fan-Keng Sun , Christopher I. Lang , Duane S. Boning