中文
相关论文

相关论文: Information Theoretic Limits for Linear Prediction…

200 篇论文

In this paper, we study high-dimensional estimation from truncated samples. We focus on two fundamental and classical problems: (i) inference of sparse Gaussian graphical models and (ii) support recovery of sparse linear models. (i) For…

机器学习 · 统计学 2020-06-18 Arnab Bhattacharyya , Rathin Desai , Sai Ganesh Nagarajan , Ioannis Panageas

We study a random graph model for small-world networks which are ubiquitous in social and biological sciences. In this model, a dense cycle of expected bandwidth $n \tau$, representing the hidden one-dimensional geometry of vertices, is…

统计理论 · 数学 2024-02-02 Cheng Mao , Alexander S. Wein , Shenduo Zhang

Generative graph models struggle to scale due to the need to predict the existence or type of edges between all node pairs. To address the resulting quadratic complexity, existing scalable models often impose restrictive assumptions such as…

机器学习 · 计算机科学 2024-05-24 Yiming Qin , Clement Vignac , Pascal Frossard

We study the problem of consistently recovering the sparsity pattern of a regression parameter vector from correlated observations governed by deterministic missing data patterns using Lasso. We consider the case in which the observed…

机器学习 · 计算机科学 2022-06-13 Chuyang Ke , Jean Honorio

The problem of consistently estimating the sparsity pattern of a vector $\betastar \in \real^\mdim$ based on observations contaminated by noise arises in various contexts, including subset selection in regression, structure estimation in…

统计理论 · 数学 2007-07-13 Martin J. Wainwright

We study the problem of sampling a random signal with sparse support in frequency domain. Shannon famously considered a scheme that instantaneously samples the signal at equispaced times. He proved that the signal can be reconstructed as…

信息论 · 计算机科学 2012-11-22 Adel Javanmard , Andrea Montanari

This research establishes that many real-world networks exhibit bounded expansion, a strong notion of structural sparsity, and demonstrates that it can be leveraged to design efficient algorithms for network analysis. We analyze several…

社会与信息网络 · 计算机科学 2018-10-15 Erik D. Demaine , Felix Reidl , Peter Rossmanith , Fernando Sanchez Villaamil , Somnath Sikdar , Blair D. Sullivan

The problem of constructing confidence sets in the high-dimensional linear model with $n$ response variables and $p$ parameters, possibly $p\ge n$, is considered. Full honest adaptive inference is possible if the rate of sparse estimation…

统计理论 · 数学 2013-12-19 Richard Nickl , Sara van de Geer

We propose two novel approaches to the recovery of an (approximately) sparse signal from noisy linear measurements in the case that the signal is a priori known to be non-negative and obey given linear equality constraints, such as simplex…

信息论 · 计算机科学 2015-06-17 Jeremy Vila , Philip Schniter

Linear structural equation models postulate noisy linear relationships between variables of interest. Each model corresponds to a path diagram, which is a mixed graph with directed edges that encode the domains of the linear functions and…

统计理论 · 数学 2018-05-16 Mathias Drton , Christopher Fox , Andreas Käufl , Guillaume Pouliot

Many popular statistical models, such as factor and random effects models, give arise a certain type of covariance structures that is a summation of low rank and sparse matrices. This paper introduces a penalized approximation framework to…

统计方法学 · 统计学 2015-03-19 Xi Luo

We study the problem of sampling and reconstruction of bandlimited graph signals where the objective is to select a node subset of prescribed cardinality that ensures interpolation of the original signal with the lowest reconstruction…

信号处理 · 电气工程与系统科学 2018-07-20 Abolfazl Hashemi , Rasoul Shafipour , Haris Vikalo , Gonzalo Mateos

Regularized m-estimators are widely used due to their ability of recovering a low-dimensional model in high-dimensional scenarios. Some recent efforts on this subject focused on creating a unified framework for establishing oracle bounds,…

统计方法学 · 统计学 2023-09-06 Eduardo F. Mendes , Gabriel J. P. Pinto

We consider the problem of high-dimensional Gaussian graphical model selection. We identify a set of graphs for which an efficient estimation algorithm exists, and this algorithm is based on thresholding of empirical conditional…

机器学习 · 计算机科学 2012-03-06 Animashree Anandkumar , Vincent Y. F. Tan , Alan. S. Willsky

Inference and optimization of real-value edge variables in sparse graphs are studied using the Bethe approximation and replica method of statistical physics. Equilibrium states of general energy functions involving a large set of real…

无序系统与神经网络 · 物理学 2009-11-11 K. Y. Michael Wong , D. Saad

When modeling network data using a latent position model, it is typical to assume that the nodes' positions are independently and identically distributed. However, this assumption implies the average node degree grows linearly with the…

统计理论 · 数学 2025-01-07 Neil A. Spencer , Cosma Rohilla Shalizi

We present novel information-theoretic limits on detecting sparse changes in Ising models, a problem that arises in many applications where network changes can occur due to some external stimuli. We show that the sample complexity for…

信息论 · 计算机科学 2020-11-10 Aditya Gangrade , Bobak Nazer , Venkatesh Saligrama

Empirical measures of financial connectedness based on Forecast Error Variance Decompositions (FEVDs) often yield dense network structures that obscure true transmission channels and complicate the identification of systemic risk. This…

计量经济学 · 经济学 2026-01-19 Fu Ouyang , Thomas T. Yang , Wenying Yao

In statistical inference problems, we wish to obtain lower bounds on the minimax risk, that is to bound the performance of any possible estimator. A standard technique to obtain risk lower bounds involves the use of Fano's inequality. In an…

信息论 · 计算机科学 2018-04-06 Ramji Venkataramanan , Oliver Johnson

There have been many attempts to identify high-dimensional network features via multivariate approaches. Specifically, when the number of voxels or nodes, denoted as p, are substantially larger than the number of images, denoted as n, it…

统计方法学 · 统计学 2020-08-04 Moo K. Chung