English
Related papers

Related papers: Statistical properties of large data sets with lin…

200 papers

We analyse the structure of the distribution of eigenvalues of the stock market correlation matrix with increasing length of the time series representing the price changes. We use 100 highly-capitalized stocks from the American market and…

Physics and Society · Physics 2009-11-11 J. Kwapien , P. Oswiecimka , S. Drozdz

Over the past decade, deep learning has proven to be a highly effective tool for learning meaningful features from raw data. However, it remains an open question how deep networks perform hierarchical feature learning across layers. In this…

Machine Learning · Computer Science 2025-11-17 Peng Wang , Xiao Li , Can Yaras , Zhihui Zhu , Laura Balzano , Wei Hu , Qing Qu

We propose a method to detect model misspecifications in nonlinear causal additive and potentially heteroscedastic noise models. We aim to identify predictor variables for which we can infer the causal effect even in cases of such…

Methodology · Statistics 2024-03-28 Christoph Schultheiss , Peter Bühlmann

Gaussian process-based latent variable models are flexible and theoretically grounded tools for nonlinear dimension reduction, but generalizing to non-Gaussian data likelihoods within this nonlinear framework is statistically challenging.…

Machine Learning · Statistics 2020-06-22 Gregory W. Gundersen , Michael Minyi Zhang , Barbara E. Engelhardt

Time-varying linear state-space models are powerful tools for obtaining mathematically interpretable representations of neural signals. For example, switching and decomposed models describe complex systems using latent variables that evolve…

We present a probabilistic framework for overlapping community discovery and link prediction for relational data, given as a graph. The proposed framework has: (1) a deep architecture which enables us to infer multiple layers of latent…

Machine Learning · Statistics 2017-06-19 Changwei Hu , Piyush Rai , Lawrence Carin

This paper introduces a general Bayesian non- parametric latent feature model suitable to per- form automatic exploratory analysis of heterogeneous datasets, where the attributes describing each object can be either discrete, continuous or…

Machine Learning · Statistics 2017-07-27 Isabel Valera , Melanie F. Pradier , Zoubin Ghahramani

The high-dimensional data setting, in which p >> n, is a challenging statistical paradigm that appears in many real-world problems. In this setting, learning a compact, low-dimensional representation of the data can substantially help…

Machine Learning · Computer Science 2018-08-07 Micol Marchetti-Bowick , Benjamin J. Lengerich , Ankur P. Parikh , Eric P. Xing

Machine learning and statistics typically focus on building models that capture the vast majority of the data, possibly ignoring a small subset of data as "noise" or "outliers." By contrast, here we consider the problem of jointly…

Machine Learning · Computer Science 2016-08-19 Brendan Juba

Factor analysis is a widely used statistical tool in many scientific disciplines, such as psychology, economics, and sociology. As observations linked by networks become increasingly common, incorporating network structures into factor…

Methodology · Statistics 2024-03-27 Jinming Li , Gongjun Xu , Ji Zhu

In this article, a general information-plus-noise transmission model is assumed, the receiver end of which is composed of a large number of sensors and is unaware of the noise pattern. For this model, and under reasonable assumptions, a set…

Information Theory · Computer Science 2015-06-12 Julia Vinogradova , Romain Couillet , Walid Hachem

The estimation of parameters in a linear model is considered under the hypothesis that the noise, with finite second order statistics, can be represented in a given deterministic basis by random coefficients. An extended underdetermined…

Statistics Theory · Mathematics 2014-05-06 Piero Barone , Isabella Lari

Personality traits are latent variables, and as such, are impossible to measure without the use of an assessment. Responses on the assessments can be influenced by both transient (state-related) error and measurement error, obscuring the…

Applications · Statistics 2017-06-02 Amy E. Nussbaum , Cornelis J. Potgieter , Michael Chmielewski

Sparse latent multi-factor models have been used in many exploratory and predictive problems with high-dimensional multivariate observations. Because of concerns with identifiability, the latent factors are almost always assumed to be…

Applications · Statistics 2013-12-09 Vinicius Diniz Mayrink , Joseph Edward Lucas

Structured latent attribute models (SLAMs) are a special family of discrete latent variable models widely used in social and biological sciences. This paper considers the problem of learning significant attribute patterns from a SLAM with…

Methodology · Statistics 2019-06-07 Yuqi Gu , Gongjun Xu

Simulating sample correlation matrices is important in many areas of statistics. Approaches such as generating Gaussian data and finding their sample correlation matrix or generating random uniform $[-1,1]$ deviates as pairwise correlations…

Statistics Theory · Mathematics 2013-12-09 Johanna Hardin , Stephan Ramon Garcia , David Golan

As the application of deep neural networks proliferates in numerous areas such as medical imaging, video surveillance, and self driving cars, the need for explaining the decisions of these models has become a hot research topic, both at the…

Machine Learning · Computer Science 2021-06-01 Ronny Luss , Pin-Yu Chen , Amit Dhurandhar , Prasanna Sattigeri , Yunfeng Zhang , Karthikeyan Shanmugam , Chun-Chen Tu

We study low-rank matrix regression in settings where matrix-valued predictors and scalar responses are observed across multiple individuals. Rather than assuming a fully homogeneous coefficient matrices across individuals, we accommodate…

Methodology · Statistics 2025-10-28 Di Wang , Xiaoyu Zhang , Guodong Li , Wenyang Zhang

Anomaly detection is a relevant problem in the area of data analysis. In networked systems, where individual entities interact in pairs, anomalies are observed when pattern of interactions deviates from patterns considered regular. Properly…

Social and Information Networks · Computer Science 2023-10-25 Hadiseh Safdari , Caterina De Bacco

High-dimensional multivariate spatial-temporal data arise frequently in a wide range of applications; however, there are relatively few statistical methods that can simultaneously deal with spatial, temporal and variable-wise dependencies…

Methodology · Statistics 2020-02-05 Elynn Y. Chen , Xin Yun , Rong Chen , Qiwei Yao