English
Related papers

Related papers: Maximum and Leaky Maximum Propagation

200 papers

Large language models (LLMs) often struggle with strict memory, latency, and power demands. To meet these demands, various forms of dynamic sparsity have been proposed that reduce compute on an input-by-input basis. These methods improve…

Computation and Language · Computer Science 2024-04-09 Jordan Dotzel , Yash Akhauri , Ahmed S. AbouElhamayed , Carly Jiang , Mohamed Abdelfattah , Zhiru Zhang

A recent study characterizing failures in computer networks shows that transient single element (node/link) failures are the dominant failures in large communication networks like the Internet. Thus, having the routing paths globally…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-11-11 Amit M. Bhosle , Teofilo F. Gonzalez

Maximal $\alpha$-leakage is a tunable measure of information leakage based on the accuracy of guessing an arbitrary function of private data based on public data. The parameter $\alpha$ determines the loss function used to measure the…

Information Theory · Computer Science 2019-04-08 Jiachun Liao , Lalitha Sankar , Oliver Kosut , Flavio P. Calmon

Dropout is typically interpreted as bagging a large number of models sharing parameters. We show that using dropout in a network can also be interpreted as a kind of data augmentation in the input space without domain knowledge. We present…

Machine Learning · Statistics 2016-01-11 Xavier Bouthillier , Kishore Konda , Pascal Vincent , Roland Memisevic

We introduce a distributed algorithm, termed noise-robust distributed maximum consensus (RD-MC), for estimating the maximum value within a multi-agent network in the presence of noisy communication links. Our approach entails redefining the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-18 Ehsan Lari , Reza Arablouei , Naveen K. D. Venkategowda , Stefan Werner

The study of spreading processes often analyzes networks at different resolutions, e.g., at the level of individuals or countries, but it is not always clear how properties at one resolution can carry over to another. Accordingly, in this…

Physics and Society · Physics 2024-12-04 Baike She , Matthew Hale

We study the information leakage to a guessing adversary in index coding with a general message distribution. Under both vanishing-error and zero-error decoding assumptions, we develop lower and upper bounds on the optimal leakage rate,…

Information Theory · Computer Science 2022-05-24 Yucheng Liu , Lawrence Ong , Phee Lep Yeoh , Parastoo Sadeghi , Joerg Kliewer , Sarah Johnson

Existing information-theoretic frameworks based on maximum entropy network ensembles are not able to explain the emergence of heterogeneity in complex networks. Here, we fill this gap of knowledge by developing a classical framework for…

Physics and Society · Physics 2020-07-08 Filippo Radicchi , Dmitri Krioukov , Harrison Hartle , Ginestra Bianconi

Energy harvesting has emerged as a powerful technology for complementing current battery-powered communication systems in order to extend their lifetime. In this paper a general framework is introduced for the optimization of communication…

Information Theory · Computer Science 2012-03-14 Bertrand Devillers , Deniz Gunduz

In this work, we study bounds on the capacity of full-duplex Gaussian 1-2-1 networks with imperfect beamforming. In particular, different from the ideal 1-2-1 network model introduced in [1], in this model beamforming patterns result in…

Information Theory · Computer Science 2020-05-15 Yahya H. Ezzeldin , Martina Cardone , Christina Fragouli , Giuseppe Caire

We investigate boosted online regression and propose a novel family of regression algorithms with strong theoretical bounds. In addition, we implement several variants of the proposed generic algorithm. We specifically provide theoretical…

Statistics Theory · Mathematics 2016-12-07 Dariush Kari , Farhan Khan , Selami Ciftci , Suleyman Serdar Kozat

We study outage regions for energy-constrained multi-hop and adaptive multi-route networks with an arbitrary number of relay nodes. Optimal power allocation strategies in the sense that outage probability is minimized are derived depending…

Information Theory · Computer Science 2009-08-10 Tobias Renk , Holger Jaekel , Friedrich K. Jondral

In this paper we estimate the propagation of liquidity shocks through interbank markets when the information about the underlying credit network is incomplete. We show that techniques such as Maximum Entropy currently used to reconstruct…

Risk Management · Quantitative Finance 2013-10-08 Iacopo Mastromatteo , Elia Zarinelli , Matteo Marsili

Consider a lossy packet network of queues, communicating over a wireless medium. This paper presents a throughput-optimal transmission strategy for a unicast network when feedback is available, which has the following advantages: It…

Information Theory · Computer Science 2008-04-29 Brian Smith , Babak Hassibi

In this paper, we investigate the performance of incremental redundancy combining as a new cooperative relaying protocol for large M2M networks with opportunistic relaying. The nodes in the large M2M network are modeled by a Poisson Point…

Information Theory · Computer Science 2017-02-02 Amogh Rajanna , Mos Kaveh

Classical percolation theory underlies many processes of information transfer along the links of a network. In these standard situations, the requirement for two nodes to be able to communicate is the presence of at least one uninterrupted…

Statistical Mechanics · Physics 2023-10-25 Lorenzo Cirigliano , Claudio Castellano , Gábor Timár

Motivated by a variety of applications in control engineering and information sciences, we study network resource allocation problems where the goal is to optimally allocate a fixed amount of resource over a network of nodes. In these…

Optimization and Control · Mathematics 2017-08-25 Thinh T. Doan , Carolyn L. Beck

We present a new method to propagate lower bounds on conditional probability distributions in conventional Bayesian networks. Our method guarantees to provide outer approximations of the exact lower bounds. A key advantage is that we can…

Artificial Intelligence · Computer Science 2012-05-14 Daniel Andrade , Bernhard Sick

Mechanistic network models specify the mechanisms by which networks grow and change, allowing researchers to investigate complex systems using both simulation and analytical techniques. Unfortunately, it is difficult to write likelihoods…

Methodology · Statistics 2023-07-19 Jonathan Larson , Jukka-Pekka Onnela

The identification of the minimal set of nodes that maximizes the propagation of information is one of the most relevant problems in network science. In this paper, we introduce a new method to find the set of initial spreaders to maximize…

‹ Prev 1 3 4 5 6 7 10 Next ›