English
Related papers

Related papers: Information-Theoretic Lower Bounds for Recovery of…

200 papers

Resource-constrained systems are prevalent in communications. Such a system is composed of many components but only some of them can be allocated with resources such as time slots. According to the amount of information about the system,…

Information Theory · Computer Science 2014-04-02 Albert Y. S. Lam , Yanhui Geng , Victor O. K. Li

We propose a graphical model for representing networks of stochastic processes, the minimal generative model graph. It is based on reduced factorizations of the joint distribution over time. We show that under appropriate conditions, it is…

Information Theory · Computer Science 2015-03-13 Christopher J. Quinn , Negar Kiyavash , Todd P. Coleman

We consider a brand with a given budget that wants to promote a product over multiple rounds of influencer marketing. In each round, it commissions an influencer to promote the product over a social network, and then observes the subsequent…

Machine Learning · Computer Science 2019-11-11 Shatian Wang , Zhen Xu , Van-Anh Truong

This paper studies the multi-cascade influence maximization problem, which explores strategies for launching one information cascade in a social network with multiple existing cascades. With natural extensions to the classic models, we…

Social and Information Networks · Computer Science 2019-12-03 Guangmo Tong , Ruiqi Wang , Zheng Dong

Cascade processes are responsible for many important phenomena in natural and social sciences. Simple models of irreversible dynamics on graphs, in which nodes activate depending on the state of their neighbors, have been successfully…

Disordered Systems and Neural Networks · Physics 2013-09-16 Fabrizio Altarelli , Alfredo Braunstein , Luca Dall'Asta , Riccardo Zecchina

Network reconstruction consists in retrieving the hidden interaction structure of a system from observations. Many reconstruction algorithms have been proposed, although less research has been devoted to describe their theoretical…

We study the classical problem of community recovery in stochastic block models with a fixed number of communities, with a twist: We seek algorithms that are stable with respect to node-wise changes in the graph structure, formally defined…

Statistics Theory · Mathematics 2026-05-18 Laurentiu Marchis , Ethan D'souza , Tomáš Flídr , Po-Ling Loh

We study the fundamental problem of estimating an unknown discrete distribution $p$ over $d$ symbols, given $n$ i.i.d. samples from the distribution. We are interested in minimizing the KL divergence between the true distribution and the…

Machine Learning · Statistics 2025-05-30 Jiayuan Ye , Vitaly Feldman , Kunal Talwar

We study the dynamics of the processes in the small-world networks with a power-law degree distribution where every node is considered to be in one of the two available statuses. We present an algorithm for generation of such network and…

Statistical Mechanics · Physics 2019-07-19 Bahruz Gadjiev , Tatiana Progulova

In this work, we investigate the sampling and reconstruction of spectrally $s$-sparse bandlimited graph signals governed by heat diffusion processes. We propose a random space-time sampling regime, referred to as {randomized} dynamical…

Numerical Analysis · Mathematics 2024-10-24 Longxiu Huang , Dongyang Li , Sui Tang , Qing Yao

We study a majority based preference diffusion model in which the members of a social network update their preferences based on those of their connections. Consider an undirected graph where each node has a strict linear order over a set of…

Social and Information Networks · Computer Science 2023-12-27 Ahad N. Zehmakan

We consider distributed convex optimization problems originated from sample average approximation of stochastic optimization, or empirical risk minimization in machine learning. We assume that each machine in the distributed computing…

Optimization and Control · Mathematics 2015-01-05 Yuchen Zhang , Lin Xiao

Decentralized optimization with time-varying networks is an emerging paradigm in machine learning. It saves remarkable communication overhead in large-scale deep training and is more robust in wireless scenarios especially when nodes are…

Machine Learning · Computer Science 2022-11-02 Xinmeng Huang , Kun Yuan

A direct numerical solution of the radiative transfer equation or any kinetic equation is typically expensive, since the radiative intensity depends on time, space and direction. An expansion in the direction variables yields an equivalent…

Mathematical Physics · Physics 2023-10-10 Benjamin Seibold , Martin Frank

Finding interdependency relations between (possibly multivariate) time series provides valuable knowledge about the processes that generate the signals. Information theory sets a natural framework for non-parametric measures of several…

Information Theory · Computer Science 2016-02-09 German Gomez-Herrero , Wei Wu , Kalle Rutanen , Miguel C. Soriano , Gordon Pipa , Raul Vicente

Privacy preserving networks can be modelled as decentralized networks (e.g., sensors, connected objects, smartphones), where communication between nodes of the network is not controlled by an all-knowing, central node. For this type of…

Machine Learning · Statistics 2016-10-06 Igor Colin , Christophe Dupuy

In this work we propose a nonlinear stabilization technique for convection-diffusion-reaction and pure transport problems discretized with space-time isogeometric analysis. The stabilization is based on a graph-theoretic artificial…

Numerical Analysis · Computer Science 2019-11-18 Jesús Bonilla , Santiago Badia

We propose new continuous-time formulations for first-order stochastic optimization algorithms such as mini-batch gradient descent and variance-reduced methods. We exploit these continuous-time models, together with simple Lyapunov analysis…

Optimization and Control · Mathematics 2020-03-12 Antonio Orvieto , Aurelien Lucchi

In this article, we are concerned with the analysis on the numerical reconstruction of the spatial component in the source term of a time-fractional diffusion equation. This ill-posed problem is solved through a stabilized nonlinear…

Numerical Analysis · Mathematics 2020-05-06 Daijun Jiang , Yikan Liu , Dongling Wang

We characterize the communication complexity of the following distributed estimation problem. Alice and Bob observe infinitely many iid copies of $\rho$-correlated unit-variance (Gaussian or $\pm1$ binary) random variables, with unknown…

Information Theory · Computer Science 2019-04-19 Uri Hadar , Jingbo Liu , Yury Polyanskiy , Ofer Shayevitz