English
Related papers

Related papers: High-Dimensional Inference with the generalized Ho…

200 papers

We analyze a Hopfield neural network with a quasi-diagonal connection matrix. We use the term "quasi-diagonal matrix" to denote a matrix with all elements equal zero except the elements on the first super- and sub-diagonals of the principle…

Disordered Systems and Neural Networks · Physics 2025-02-11 Leonid Litinskii

This paper develops the inferential theory for latent factor models estimated from large dimensional panel data with missing observations. We propose an easy-to-use all-purpose estimator for a latent factor model by applying principal…

Econometrics · Economics 2022-01-11 Ruoxuan Xiong , Markus Pelger

The importance of higher-order relations is widely recognized in a large number of real-world systems. However, annotating them is a tedious and sometimes impossible task. Consequently, current approaches for data modelling either ignore…

Machine Learning · Computer Science 2025-06-06 Iulia Duta , Pietro Liò

In this paper, we develop new statistical theory for probabilistic principal component analysis models in high dimensions. The focus is the estimation of the noise variance, which is an important and unresolved issue when the number of…

Statistics Theory · Mathematics 2014-06-23 Damien Passemier , Zhaoyuan Li , Jian-Feng Yao

We study large N behavior of the IIB matrix model using the equivalence between the IIB matrix model for finite N and a field theory on a non-commutative periodic lattice with N x N sites. We find that the large N dependences of correlation…

High Energy Physics - Theory · Physics 2017-02-01 Naofumi Kitsunezaki , Shozo Uehara

Complex systems are often driven by higher-order interactions among multiple units, naturally represented as hypergraphs. Understanding dependency structures within these hypergraphs is crucial for understanding and predicting the behavior…

Social and Information Networks · Computer Science 2025-05-29 John Hood , Caterina De Bacco , Aaron Schein

We consider stochastic systems of interacting particles or agents, with dynamics determined by an interaction kernel which only depends on pairwise distances. We study the problem of inferring this interaction kernel from observations of…

Statistics Theory · Mathematics 2020-07-31 Fei Lu , Mauro Maggioni , Sui Tang

Statistical inference on the explained variation of an outcome by a set of covariates is of particular interest in practice. When the covariates are of moderate to high-dimension and the effects are not sparse, several approaches have been…

Methodology · Statistics 2022-01-24 Hua Yun Chen

The paper considers linear regression problems where the number of predictor variables is possibly larger than the sample size. The basic motivation of the study is to combine the points of view of model selection and functional regression…

Statistics Theory · Mathematics 2012-02-24 Alois Kneip , Pascal Sarda

This paper is concerned with the modeling and analysis of two of the most commonly used recurrent neural network models (i.e., Hopfield neural network and firing-rate neural network) with dynamic recurrent connections undergoing Hebbian…

Optimization and Control · Mathematics 2024-03-25 Veronica Centorrino , Francesco Bullo , Giovanni Russo

Data analysis in science, e.g., high-energy particle physics, is often subject to an intractable likelihood if the observables and observations span a high-dimensional input space. Typically the problem is solved by reducing the…

Data Analysis, Statistics and Probability · Physics 2021-01-14 Stefan Wunsch , Simon Jörger , Roger Wolf , Günter Quast

The Hopfield network (HN) is a classical model of associative memory whose dynamics are closely related to the Ising spin system with 2-body interactions. Stored patterns are encoded as minima of an energy function shaped by a Hebbian…

Applied Physics · Physics 2025-09-23 Marco Cafiso , Paolo Paradisi

The adaptive voter model allows for studying the interplay between homophily, the tendency of like-minded individuals to attract each other, and social influence, the tendency for connected individuals to influence each other. However, it…

Physics and Society · Physics 2023-03-21 Nikos Papanikolaou , Renaud Lambiotte , Giacomo Vaccario

We introduce a method for learning pairwise interactions in a manner that satisfies strong hierarchy: whenever an interaction is estimated to be nonzero, both its associated main effects are also included in the model. We motivate our…

Methodology · Statistics 2013-08-14 Michael Lim , Trevor Hastie

Specific protein-protein interactions are crucial in the cell, both to ensure the formation and stability of multi-protein complexes, and to enable signal transduction in various pathways. Functional interactions between proteins result in…

Biological Physics · Physics 2016-11-21 Anne-Florence Bitbol , Robert S. Dwyer , Lucy J. Colwell , Ned S. Wingreen

The problem of statistical inference for regression coefficients in a high-dimensional single-index model is considered. Under elliptical symmetry, the single index model can be reformulated as a proxy linear model whose regression…

Statistics Theory · Mathematics 2021-03-02 Hamid Eftekhari , Moulinath Banerjee , Ya'acov Ritov

Statistical network analysis primarily focuses on inferring the parameters of an observed network. In many applications, especially in the social sciences, the observed data is the groups formed by individual subjects. In these…

Methodology · Statistics 2023-08-09 Zhibing He , Yunpeng Zhao , Peter Bickel , Charles Weko , Dan Cheng , Jirui Wang

We focus on the high-dimensional linear regression problem, where the algorithmic goal is to efficiently infer an unknown feature vector $\beta^*\in\mathbb{R}^p$ from its linear measurements, using a small number $n$ of samples. Unlike most…

Statistics Theory · Mathematics 2023-09-19 David Gamarnik , Eren C. Kızıldağ , Ilias Zadik

We study two-layer belief networks of binary random variables in which the conditional probabilities Pr[childlparents] depend monotonically on weighted sums of the parents. In large networks where exact probabilistic inference is…

Machine Learning · Computer Science 2013-02-01 Michael Kearns , Lawrence Saul

Networks are frequently used to model complex systems comprised of interacting elements. While edges capture the topology of direct interactions, the true complexity of many systems originates from higher-order patterns in paths by which…

Social and Information Networks · Computer Science 2022-10-04 Christoph Gote , Vincenzo Perri , Ingo Scholtes