English
Related papers

Related papers: High-dimensional random landscapes: from typical t…

200 papers

We consider the problem of inferring the topology of a network using the measurements available at the end nodes, without cooperation from the internal nodes. To this end, we provide a simple method to obtain path interference which…

Networking and Internet Architecture · Computer Science 2019-03-19 Anurag Rai , Eytan Modiano

Estimating large covariance and precision matrices are fundamental in modern multivariate analysis. The problems arise from statistical analysis of large panel economics and finance data. The covariance matrix reveals marginal correlations…

Methodology · Statistics 2015-04-17 Jianqing Fan , Yuan Liao , Han Liu

The Hessian of a neural network captures parameter interactions through second-order derivatives of the loss. It is a fundamental object of study, closely tied to various problems in deep learning, including model design, optimization, and…

Machine Learning · Computer Science 2021-07-02 Sidak Pal Singh , Gregor Bachmann , Thomas Hofmann

Extreme value theory for univariate and low-dimensional observations has been explored in considerable detail, but the field is still in an early stage regarding high-dimensional settings. This paper focuses on H\"usler-Reiss models, a…

Methodology · Statistics 2024-12-17 Johannes Lederer , Marco Oesting

In the field of statistical learning and data analysis, estimating precision matrices (i.e., the inverse of covariance matrices) is a critical task, particularly for understanding dependency structures among variables. However, traditional…

Methodology · Statistics 2026-05-15 Zhongfeng Qin , Hao Xu , Wenhao Cui , Wan Tian

This paper studies inference in linear models with a high-dimensional parameter matrix that can be well-approximated by a ``spiked low-rank matrix.'' A spiked low-rank matrix has rank that grows slowly compared to its dimensions and nonzero…

Statistics Theory · Mathematics 2023-01-04 Victor Chernozhukov , Christian Hansen , Yuan Liao , Yinchu Zhu

Significant advances have been made recently on training neural networks, where the main challenge is in solving an optimization problem with abundant critical points. However, existing approaches to address this issue crucially rely on a…

Machine Learning · Computer Science 2019-02-28 Weihao Gao , Ashok Vardhan Makkuva , Sewoong Oh , Pramod Viswanath

Variational representations of divergences and distances between high-dimensional probability distributions offer significant theoretical insights and practical advantages in numerous research areas. Recently, they have gained popularity in…

Machine Learning · Computer Science 2022-03-25 Jeremiah Birrell , Markos A. Katsoulakis , Yannis Pantazis

We study rare events in systems of diffusive fields driven out of equilibrium by the boundaries. We present a numerical technique and use it to calculate the probabilities of rare events in one and two dimensions. Using this technique, we…

Statistical Mechanics · Physics 2015-09-10 Guy Bunin , Yariv Kafri , Daniel Podolsky

Predicting the performance of an optimization algorithm on a new problem instance is crucial in order to select the most appropriate algorithm for solving that problem instance. For this purpose, recent studies learn a supervised machine…

Machine Learning · Computer Science 2022-03-23 Risto Trajanov , Stefan Dimeski , Martin Popovski , Peter Korošec , Tome Eftimov

In this study, we investigate the problem of classifying, characterizing, and designing efficient algorithms for hard inference problems on planar graphs, in the limit of infinite size. The problem is considered hard if, for a deterministic…

Statistics Theory · Mathematics 2016-01-01 Iuliana Teodorescu , Razvan Teodorescu , Pranav Warman

This article conducts a large dimensional study of a simple yet quite versatile classification model, encompassing at once multi-task and semi-supervised learning, and taking into account uncertain labeling. Using tools from random matrix…

Machine Learning · Statistics 2024-02-22 Victor Leger , Romain Couillet

This paper studies the problems of identifiability and estimation in high-dimensional nonparametric latent structure models. We introduce an identifiability theorem that generalizes existing conditions, establishing a unified framework…

Statistics Theory · Mathematics 2025-08-06 Yichen Lyu , Pengkun Yang

The variance--covariance matrix plays a central role in the inferential theories of high-dimensional factor models in finance and economics. Popular regularization methods of directly exploiting sparsity are not directly applicable to many…

Methodology · Statistics 2012-03-15 Jianqing Fan , Yuan Liao , Martina Mincheva

We consider random energy landscapes constructed from d-dimensional lattices or trees. The distribution of the number of local minima in such landscapes follows a large deviation principle and we derive the associated law exactly for…

Statistical Mechanics · Physics 2009-11-11 Satya N. Majumdar , Olivier C. Martin

Accurate information on the distribution of vegetation species is used as a proxy for the health of an ecosystem, a currency of international environmental treaties, and a necessary planning tool for forest preservation and rehabilitation,…

Methodology · Statistics 2023-09-20 Henry Scharf , Jonathan Schierbaum , Hana Matsumoto , Tim Assal

Random cost simulations were introduced as a method to investigate optimization problems in systems with conflicting constraints. Here I study the approach in connection with the training of a feed-forward multilayer perceptron, as used in…

High Energy Physics - Phenomenology · Physics 2009-10-28 Bernd A. Berg

State-of-the-art quantum algorithms routinely tune dynamically parametrized cost functionals for combinatorics, machine learning, equation-solving, or energy minimization. However, large search complexity often demands many (noisy) quantum…

Quantum Physics · Physics 2022-01-12 Mogens Dalgaard , Felix Motzoi , Jacob Sherson

The two primary approaches for high-dimensional regression problems are sparse methods (e.g., best subset selection, which uses the L0-norm in the penalty) and ensemble methods (e.g., random forests). Although sparse methods typically yield…

Methodology · Statistics 2024-10-31 Anthony-Alexander Christidis , Stefan Van Aelst , Ruben Zamar

We study gradient flow on the multi-index regression problem for high-dimensional Gaussian data. Multi-index functions consist of a composition of an unknown low-rank linear projection and an arbitrary unknown, low-dimensional link…

Machine Learning · Statistics 2023-11-03 Alberto Bietti , Joan Bruna , Loucas Pillaud-Vivien
‹ Prev 1 4 5 6 7 8 10 Next ›