English
Related papers

Related papers: Canonical correlation regression with noisy data

200 papers

Instrumental variable methods provide useful tools for inferring causal effects in the presence of unmeasured confounding. To apply these methods with large-scale data sets, a major challenge is to find valid instruments from a possibly…

Methodology · Statistics 2024-09-24 Xinyi Zhang , Linbo Wang , Stanislav Volgushev , Dehan Kong

Instrumental variables have proven useful, in particular within the social sciences and economics, for making inference about the causal effect of a random variable, B, on another random variable, C, in the presence of unobserved…

Methodology · Statistics 2012-06-26 Roland R. Ramsahai

We present a method to reconstruct autocorrelated signals together with their autocorrelation structure from nonlinear, noisy measurements for arbitrary monotonous nonlinear instrument response. In the presented formulation the algorithm…

Methodology · Statistics 2018-02-14 Jakob Knollmüller , Theo Steininger , Torsten A. Enßlin

In high-dimensional data, structured noise caused by observed and unobserved factors affecting multiple target variables simultaneously, imposes a serious challenge for modeling, by masking the often weak signal. Therefore, (1) explaining…

Canonical correlation analysis (CCA) is a classic statistical method for discovering latent co-variation that underpins two or more observed random vectors. Several extensions and variations of CCA have been proposed that have strengthened…

Machine Learning · Computer Science 2023-12-22 Paris A. Karakasis , Nicholas D. Sidiropoulos

This paper investigates fairness and bias in Canonical Correlation Analysis (CCA), a widely used statistical technique for examining the relationship between two sets of variables. We present a framework that alleviates unfairness by…

Machine Learning · Computer Science 2023-09-28 Zhuoping Zhou , Davoud Ataee Tarzanagh , Bojian Hou , Boning Tong , Jia Xu , Yanbo Feng , Qi Long , Li Shen

As machine-learning models grow in size, their implementation requirements cannot be met by a single computer system. This observation motivates distributed settings, in which intermediate computations are performed across a network of…

Machine Learning · Computer Science 2024-08-21 Yuval Ben-Hur , Yuval Cassuto

How does one find dimensions in multivariate data that are reliably expressed across repetitions? For example, in a brain imaging study one may want to identify combinations of neural signals that are reliably expressed across multiple…

Machine Learning · Statistics 2022-12-05 Lucas C. Parra , Stefan Haufe , Jacek P. Dmochowski

This article considers inference in linear instrumental variables models with many regressors, all of which could be endogenous. We propose the STIV estimator. Identification robust confidence sets are derived by solving linear programs. We…

Statistics Theory · Mathematics 2021-08-09 Eric Gautier , Christiern Rose

Canonical correlation analysis is a technique to extract common features from a pair of multivariate data. In complex situations, however, it does not extract useful features because of its linearity. On the other hand, kernel method used…

Machine Learning · Computer Science 2007-05-23 Shotaro Akaho

In using multiple regression methods for prediction, one often considers the linear combination of explanatory variables as an index. Seeking a single such index when here are multiple responses is rather more complicated. One classical…

Methodology · Statistics 2020-11-19 Stephen Portnoy , Joseph Haimberg

I calculate the statistics of correlation of two digitized noiselike signals, which are drawn from complex Gaussian distributions, sampled, quantized, correlated, and averaged. Averaged over many such samples, the correlation r approaches a…

Astrophysics · Physics 2009-11-11 Carl Gwinn

Instrumental variables (IVs) are widely used to estimate causal effects in the presence of unobserved confounding between exposure and outcome. An IV must affect the outcome exclusively through the exposure and be unconfounded with the…

Canonical correlation analysis (CCA) is a multivariate statistical technique for finding the linear relationship between two sets of variables. The kernel generalization of CCA named kernel CCA has been proposed to find nonlinear relations…

Machine Learning · Statistics 2017-01-17 Xiaowei Zhang , Delin Chu , Li-Zhi Liao , Michael K. Ng

Insurance pricing systems should fulfill the auto-calibration property to ensure that there is no systematic cross-financing between different price cohorts. Often, regression models are not auto-calibrated. We propose to apply isotonic…

Methodology · Statistics 2023-01-10 Mario V. Wüthrich , Johanna Ziegel

Reliable state estimation depends on accurately modeled noise covariances, which are difficult to determine in practice. This paper formulates the noise covariance estimation as a bilevel optimization problem that factorizes the joint…

Systems and Control · Electrical Eng. & Systems 2025-12-08 Haoying Li , Yifan Peng , Yuchi Wu , Junfeng Wu

Researchers often use instrumental variables (IV) models to investigate the causal relationship between an endogenous variable and an outcome while controlling for covariates. When an exogenous variable is unavailable to serve as the…

Econometrics · Economics 2025-06-18 Moses Stewart

We study iterative regularization for linear models, when the bias is convex but not necessarily strongly convex. We characterize the stability properties of a primal-dual gradient based approach, analyzing its convergence in the presence…

Machine Learning · Statistics 2020-10-30 Cesare Molinari , Mathurin Massias , Lorenzo Rosasco , Silvia Villa

We introduce a toolkit for uncovering spurious correlations between recording characteristics and target class in speech datasets. Spurious correlations may arise due to heterogeneous recording conditions, a common scenario for…

The objective function of a matrix factorization model usually aims to minimize the average of a regression error contributed by each element. However, given the existence of stochastic noises, the implicit deviations of sample data from…

Machine Learning · Computer Science 2016-10-31 Guang-He Lee , Shao-Wen Yang , Shou-De Lin