English
Related papers

Related papers: Estimating Large Correlation Matrices for Internat…

200 papers

We consider Bayesian estimation of a $p\times p$ precision matrix, when $p$ can be much larger than the available sample size $n$. It is well known that consistent estimation in such ultra-high dimensional situations requires regularization…

Statistics Theory · Mathematics 2014-11-07 Sayantan Banerjee , Subhashis Ghosal

The two-point correlation function of the galaxy distribution is a key cosmological observable that allows us to constrain the dynamical and geometrical state of our Universe. To measure the correlation function we need to know both the…

Jointly modeling and forecasting economic and financial variables across a large set of countries has long been a significant challenge. Two primary approaches have been utilized to address this issue: the vector autoregressive model with…

Machine Learning · Statistics 2025-03-12 Sanyou Wu , Dan Yang , Yan Xu , Long Feng

The Internet is a complex network of interconnected routers and the existence of collective behavior such as congestion suggests that the correlations between different connections play a crucial role. It is thus critical to measure and…

Disordered Systems and Neural Networks · Physics 2009-11-07 Marc Barthelemy , Bernard Gondran , Eric Guichard

Relatedness is a quantification of how much two human activities are similar in terms of the inputs and contexts needed for their development. Under the idea that it is easier to move between related activities than towards unrelated ones,…

Physics and Society · Physics 2021-03-11 Andrea Tacchella , Andrea Zaccaria , Marco Miccheli , Luciano Pietronero

Recent availability of geo-localized data capturing individual human activity together with the statistical data on international migration opened up unprecedented opportunities for a study on global mobility. In this paper we consider it…

Social and Information Networks · Computer Science 2016-01-22 Alexander Belyi , Iva Bojic , Stanislav Sobolevsky , Izabela Sitko , Bartosz Hawelka , Lada Rudikova , Alexander Kurbatski , Carlo Ratti

Knowledge of population distribution is critical for building infrastructure, distributing resources, and monitoring the progress of sustainable development goals. Although censuses can provide this information, they are typically conducted…

Machine Learning · Computer Science 2021-10-07 Isaac Neal , Sohan Seth , Gary Watmough , Mamadou S. Diallo

This work deals with the generation of theoretical correlation matrices with specific sparsity patterns, associated to graph structures. We present a novel approach based on convex optimization, offering greater flexibility compared to…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Ali Fakhar , Kévin Polisano , Irène Gannaz , Sophie Achard

We present a new approach to automatic amortized inference in universal probabilistic programs which improves performance compared to current methods. Our approach is a variation of inference compilation (IC) which leverages deep neural…

Machine Learning · Computer Science 2019-10-29 William Harvey , Andreas Munk , Atılım Güneş Baydin , Alexander Bergholm , Frank Wood

The Future Elderly Model and related microsimulations are modeled as Markov chains. These simulations rely on longitudinal survey data to estimate their transition models. The use of survey data presents several incomplete data problems,…

Computation · Statistics 2017-07-11 Duncan Ermini Leaf

Relational probabilistic models have the challenge of aggregation, where one variable depends on a population of other variables. Consider the problem of predicting gender from movie ratings; this is challenging because the number of movies…

Matrix permanent plays a key role in data association probability calculations. Exact algorithms (such as Ryser's) scale exponentially with matrix size. Fully polynomial time randomized approximation schemes exist but are quite complex.…

Signal Processing · Electrical Eng. & Systems 2018-07-18 Lingji Chen

This paper constructs internationally consistent measures of macroeconomic uncertainty. Our econometric framework extracts uncertainty from revisions in data obtained from standardized national accounts. Applying our model to post-WWII…

Econometrics · Economics 2021-01-01 Andreas Dibiasi , Samad Sarferaz

Armed conflict has led to an unprecedented number of internally displaced persons (IDPs) - individuals who are forced out of their homes but remain within their country. IDPs often urgently require shelter, food, and healthcare, yet…

Applications · Statistics 2023-07-27 Benjamin Q. Huynh , Sanjay Basu

Probabilistic projections of baseline (with no additional mitigation policies) future carbon emissions are important for sound climate risk assessments. Deep uncertainty surrounds many drivers of projected emissions. Here we use a simple…

Applications · Statistics 2022-02-25 Vivek Srikrishnan , Yawen Guan , Richard S. J. Tol , Klaus Keller

Correlation matrices are a standard tool in the analysis of the time evolution of complex systems in general and financial markets in particular. Yet most analysis assume stationarity of the underlying time series. This tends to be an…

Mathematical Physics · Physics 2013-09-11 Vinayak , Rudi Schäfer , Thomas H. Seligman

Ranking sectors and countries within global value chains is of paramount importance to estimate risks and forecast growth in large economies. However, this task is often non-trivial due to the lack of complete and accurate information on…

Physics and Society · Physics 2025-01-28 Silvia Bartolucci , Fabio Caccioli , Francesco Caravelli , Pierpaolo Vivo

Floods affected more than 2 billion people worldwide from 1998 to 2017 and their occurrence is expected to increase due to climate warming, population growth and rapid urbanization. Recent approaches for understanding the resilience of…

Physics and Society · Physics 2022-02-03 Simone Loreti , Enrico Ser-Giacomi , Andreas Zischg , Margreth Keiler , Marc Barthelemy

This paper introduces a martingale that characterizes two properties of evolving forecast distributions. Ideal forecasts of a future event behave as martingales, sequen- tially updating the forecast to leverage the available information as…

Machine Learning · Computer Science 2021-05-17 Dean P. Foster , Robert A. Stine

Comparing clusterings is central to evaluating unsupervised models, yet the many existing similarity measures can produce widely divergent, sometimes contradictory, evaluations. Clustering similarity measures are typically organized into…

Machine Learning · Statistics 2025-11-06 Alexander J. Gates