English
Related papers

Related papers: Granger Causality Analysis Based on Quantized Mini…

200 papers

Evaluating the performance of Grammatical Error Correction (GEC) systems is a challenging task due to its subjectivity. Designing an evaluation metric that is as objective as possible is crucial to the development of GEC task. However,…

Computation and Language · Computer Science 2023-10-18 Jingheng Ye , Yinghui Li , Qingyu Zhou , Yangning Li , Shirong Ma , Hai-Tao Zheng , Ying Shen

In continuation to a recent work on the statistical--mechanical analysis of minimum mean square error (MMSE) estimation in Gaussian noise via its relation to the mutual information (the I-MMSE relation), here we propose a simple and more…

Information Theory · Computer Science 2016-11-17 Neri Merhav

The Gauss Markov theorem states that the weighted least squares estimator is a linear minimum variance unbiased estimation (MVUE) in linear models. In this paper, we take a first step towards extending this result to non linear settings via…

Machine Learning · Computer Science 2023-11-30 Tzvi Diskin , Yonina C. Eldar , Ami Wiesel

Granger causality is widely used for causal structure discovery in complex systems from multivariate time series data. Traditional Granger causality tests based on linear models often fail to detect even mild non-linear causal…

Machine Learning · Computer Science 2025-10-23 Ziyi Zhang , Shaogang Ren , Xiaoning Qian , Nick Duffield

Robust diffusion adaptive estimation algorithms based on the maximum correntropy criterion (MCC), including adaptation to combination MCC and combination to adaptation MCC, are developed to deal with the distributed estimation over network…

Machine Learning · Statistics 2016-02-04 Wentao Ma , Badong Chen , Jiandong Duan , Haiquan Zhao

A simple yet efficient method of linear regression estimation (LRE) is presented for quantum state tomography. In this method, quantum state reconstruction is converted into a parameter estimation problem of a linear regression model and…

Quantum Physics · Physics 2013-12-18 Bo Qi , Zhibo Hou , Li Li , Daoyi Dong , Guoyong Xiang , Guangcan Guo

Mendelian randomization (MR) is a widely used tool for causal inference in the presence of unmeasured confounders, which uses single nucleotide polymorphisms (SNPs) as instrumental variables to estimate causal effects. However, SNPs often…

Methodology · Statistics 2025-04-29 Ruoyu Wang , Haoyu Zhang , Xihong Lin

Identifying directed interactions between species from time series of their population densities has many uses in ecology. This key statistical task is equivalent to causal time series inference, which connects to the Granger causality (GC)…

Populations and Evolution · Quantitative Biology 2020-11-10 Frederic Barraquand , Coralie Picoche , Matteo Detto , Florian Hartig

A lower bound on the minimum mean-squared error (MSE) in a Bayesian estimation problem is proposed in this paper. This bound utilizes a well-known connection to the deterministic estimation setting. Using the prior distribution, the bias…

Information Theory · Computer Science 2009-05-27 Zvika Ben-Haim , Yonina C. Eldar

With the advancement of deep learning technologies, various neural network-based Granger causality models have been proposed. Although these models have demonstrated notable improvements, several limitations remain. Most existing approaches…

Machine Learning · Computer Science 2025-10-28 Meiliang Liu , Huiwen Dong , Xiaoxiao Yang , Yunfang Xu , Zijin Li , Zhengye Si , Xinyue Yang , Zhiwen Zhao

A popular approach to nonparametric option pricing is the Minimum Cross Entropy (MCE) method based on minimization of the relative Kullback-Leibler entropy of the price density distribution and a given reference density, with observable…

Statistical Mechanics · Physics 2007-05-23 Igor Halperin

Wiener and Granger have introduced an intuitive concept of causality between two variables which is based on the idea that an effect never occurs before its cause. Later, Geweke has generalized this concept to a multivariate Granger…

When is optimal estimation linear? It is well known that, when a Gaussian source is contaminated with Gaussian noise, a linear estimator minimizes the mean square estimation error. This paper analyzes, more generally, the conditions for…

Information Theory · Computer Science 2015-03-19 Emrah Akyol , Kumar Viswanatha , Kenneth Rose

Objective: Cortico-muscular communication patterns are instrumental in understanding movement control. Estimating significant causal relationships between motor cortex electroencephalogram (EEG) and surface electromyogram (sEMG) from…

Signal Processing · Electrical Eng. & Systems 2025-01-22 Farwa Abbas , Verity McClelland , Zoran Cvetkovic , Wei Dai

Causality in time series can be challenging to determine, especially in the presence of non-linear dependencies. Granger causality helps analyze potential relationships between variables, thereby offering a method to determine whether one…

Machine Learning · Computer Science 2025-10-13 Harsh Poonia , Felix Divo , Kristian Kersting , Devendra Singh Dhami

Motivated by emerging technologies for energy efficient analog computing and continuous-time processing, this paper proposes continuous-time minimum mean squared error estimation for multiple-input multiple-output (MIMO) systems based on an…

Information Theory · Computer Science 2022-09-05 Ayano Nakai-Kasai , Tadashi Wadayama

While most classical approaches to Granger causality detection repose upon linear time series assumptions, many interactions in neuroscience and economics applications are nonlinear. We develop an approach to nonlinear Granger causality…

Machine Learning · Statistics 2018-06-26 Alex Tank , Ian Cover , Nicholas J. Foti , Ali Shojaie , Emily B. Fox

We consider mean squared estimation with lookahead of a continuous-time signal corrupted by additive white Gaussian noise. We show that the mutual information rate function, i.e., the mutual information rate as function of the…

Information Theory · Computer Science 2016-11-18 Kartik Venkat , Tsachy Weissman , Yair Carmon , Shlomo Shamai

It is a challenging research endeavor to infer causal relationships in multivariate observational time-series. Such data may be represented by graphs, where nodes represent time-series, and edges directed causal influence scores between…

Information Theory · Computer Science 2022-05-09 Axel Wismüller , Ali Vosoughi , Adora DSouza , Anas Abidin

This paper examines the problem of estimating the parameters of a bandlimited signal from samples corrupted by random jitter (timing noise) and additive iid Gaussian noise, where the signal lies in the span of a finite basis. For the…

Applications · Statistics 2015-03-24 Daniel S. Weller , Vivek K Goyal