English
Related papers

Related papers: Determining the Dimension and Structure of the Sub…

200 papers

A key obstacle in automated analytics and meta-learning is the inability to recognize when different datasets contain measurements of the same variable. Because provided attribute labels are often uninformative in practice, this task may be…

Machine Learning · Computer Science 2019-09-12 Jonas Mueller , Alex Smola

To construct models of large, multivariate complex systems, such as those in biology, one needs to constrain which variables are allowed to interact. This can be viewed as detecting "local" structures among the variables. In the context of…

Data Analysis, Statistics and Probability · Physics 2023-10-19 Mahajabin Rahman , Ilya Nemenman

It is increasingly common to evaluate the same coreference resolution (CR) model on multiple datasets. Do these multi-dataset evaluations allow us to draw meaningful conclusions about model generalization? Or, do they rather reflect the…

Computation and Language · Computer Science 2024-06-19 Ian Porada , Alexandra Olteanu , Kaheer Suleman , Adam Trischler , Jackie Chi Kit Cheung

In real-world data, information is stored in extremely large feature vectors. These variables are typically correlated due to complex interactions involving many features simultaneously. Such correlations qualitatively correspond to…

Machine Learning · Computer Science 2025-05-22 Santiago Acevedo , Alex Rodriguez , Alessandro Laio

The increasing availability of massive data sets poses a series of challenges for machine learning. Prominent among these is the need to learn models under hardware or human resource constraints. In such resource-constrained settings, a…

Machine Learning · Computer Science 2021-09-28 Zalán Borsos , Mojmír Mutný , Marco Tagliasacchi , Andreas Krause

Identifying structural parameters in linear simultaneous-equation models is a longstanding challenge. Recent work exploits information in higher-order moments of non-Gaussian data. In this literature, the structural errors are typically…

Econometrics · Economics 2025-09-11 Ziyu Jiang

Building successful recommender systems requires uncovering the underlying dimensions that describe the properties of items as well as users' preferences toward them. In domains like clothing recommendation, explaining users' preferences…

Information Retrieval · Computer Science 2016-04-21 Ruining He , Chunbin Lin , Jianguo Wang , Julian McAuley

Scientific practice typically involves repeatedly studying a system, each time trying to unravel a different perspective. In each study, the scientist may take measurements under different experimental conditions (interventions,…

Machine Learning · Statistics 2014-03-11 Sofia Triantafillou , Ioannis Tsamardinos

In many application domains, networks are observed with node-level features. In such settings, a common problem is to assess whether or not nodal covariates are correlated with the network structure itself. Here, we present four novel…

Machine Learning · Statistics 2025-09-05 Alexander Fuchs-Kreiss , Keith Levin

Detecting anomalies in large complex systems is a critical and challenging task. The difficulties arise from several aspects. First, collecting ground truth labels or prior knowledge for anomalies is hard in real-world systems, which often…

Machine Learning · Computer Science 2021-06-01 Huiling Qin , Xianyuan Zhan , Yu Zheng

Empirical studies show that real world networks often exhibit multiple scales of topological descriptions. However, it is still an open problem how to identify the intrinsic multiple scales of networks. In this article, we consider…

Physics and Society · Physics 2010-07-27 Hua-Wei Shen , Xue-Qi Cheng , Bin-Xing Fang

Structural quantities such as order parameters and correlation functions are often employed to gain insight into the physical behavior and properties of condensed matter systems. While standard quantities for characterizing structure exist,…

Soft Condensed Matter · Physics 2017-08-23 Aaron S. Keys , Christopher R. Iacovella , Sharon C. Glotzer

We show that correlation matrices with particular average and variance of the correlation coefficients have a notably restricted spectral structure. Applying geometric methods, we derive lower bounds for the largest eigenvalue and the…

Mathematical Physics · Physics 2021-08-25 Yuriy Stepanov , Hendrik Herrmann , Thomas Guhr

The estimation of modal parameters from a set of noisy measured data is a highly judgmental task, with user expertise playing a significant role in distinguishing between estimated physical and noise modes of a test-piece. Various methods…

Applications · Statistics 2017-09-13 Vahid Yaghoubi , Majid K. Vakilzadeh , Thomas J. S. Abrahamsson

Factor and sparse models are two widely used methods to impose a low-dimensional structure in high-dimensions. However, they are seemingly mutually exclusive. We propose a lifting method that combines the merits of these two models in a…

Econometrics · Economics 2022-09-07 Jianqing Fan , Ricardo Masini , Marcelo C. Medeiros

Complex systems are fascinating because their rich macroscopic properties emerge from the interaction of many simple parts. Understanding the building principles of these emergent phenomena in nature requires assessing natural complex…

Neurons and Cognition · Quantitative Biology 2022-11-17 Anna Levina , Viola Priesemann , Johannes Zierenberg

It is well known that correlations in microarray data represent a serious nuisance deteriorating the performance of gene selection procedures. This paper is intended to demonstrate that the correlation structure of microarray data provides…

Applications · Statistics 2007-12-18 Lev Klebanov , Andrei Yakovlev

Complex systems are often driven by higher-order interactions among multiple units, naturally represented as hypergraphs. Understanding dependency structures within these hypergraphs is crucial for understanding and predicting the behavior…

Social and Information Networks · Computer Science 2025-05-29 John Hood , Caterina De Bacco , Aaron Schein

This article reviews recent progress in high-dimensional bootstrap. We first review high-dimensional central limit theorems for distributions of sample mean vectors over the rectangles, bootstrap consistency results in high dimensions, and…

Statistics Theory · Mathematics 2022-05-20 Victor Chernozhukov , Denis Chetverikov , Kengo Kato , Yuta Koike

Correlation matrices contain a wide variety of spatio-temporal information about a dynamical system. Predicting correlation matrices from partial time series information of a few nodes characterizes the spatio-temporal dynamics of the…

Machine Learning · Computer Science 2023-03-14 Nikhil Easaw , Woo Seok Lee , Prashant Singh Lohiya , Sarika Jalan , Priodyuti Pradhan