English
Related papers

Related papers: Measuring Multi-Source Redundancy in Factor Graphs

200 papers

This work proposes to put up a tool for diagnosing multi faults based on model using techniques of detection and localization inspired from the community of artificial intelligence and that of automatic. The diagnostic procedure to be…

Systems and Control · Computer Science 2012-03-27 Imtiez Fliss , Moncef Tagina

We present "PATRED", a technique that uses the addition of redundant information to facilitate the detection of specific, generally described patterns in line-charts during the visual exploration of the charts. We compared different…

Computation · Statistics 2022-05-30 Salomon Eisler , Joachim Meyer

Disentanglement via mechanism sparsity was introduced recently as a principled approach to extract latent factors without supervision when the causal graph relating them in time is sparse, and/or when actions are observed and affect them…

Machine Learning · Statistics 2022-07-19 Sébastien Lachapelle , Simon Lacoste-Julien

The entropy of a pair of random variables is commonly depicted using a Venn diagram. This representation is potentially misleading, however, since the multivariate mutual information can be negative. This paper presents new measures of…

Information Theory · Computer Science 2020-04-22 Conor Finn , Joseph T. Lizier

Using graphs to model irregular information domains is an effective approach to deal with some of the intricacies of contemporary (network) data. A key aspect is how the data, represented as graph signals, depend on the topology of the…

Signal Processing · Electrical Eng. & Systems 2023-05-02 Fernando J. Iglesias Garcia , Santiago Segarra , Antonio G. Marques

The design of methods for inference from time sequences has traditionally relied on statistical models that describe the relation between a latent desired sequence and the observed one. A broad family of model-based algorithms have been…

Machine Learning · Computer Science 2021-12-28 Nir Shlezinger , Nariman Farsad , Yonina C. Eldar , Andrea J. Goldsmith

Network robustness research aims at finding a measure to quantify network robustness. Once such a measure has been established, we will be able to compare networks, to improve existing networks and to design new networks that are able to…

Discrete Mathematics · Computer Science 2013-11-21 W. Ellens , R. E. Kooij

Probabilistic graphical models provide a powerful tool to describe complex statistical structure, with many real-world applications in science and engineering from controlling robotic arms to understanding neuronal computations. A major…

Artificial Intelligence · Computer Science 2023-05-04 Yicheng Fei , Xaq Pitkow

Expectation propagation is a general approach to fast approximate inference for graphical models. The existing literature treats models separately when it comes to deriving and coding expectation propagation inference algorithms. This comes…

Methodology · Statistics 2018-01-17 Wilson Y. Chen , Matt P. Wand

Rigidity theory enables us to specify the conditions of unique localizability in the cooperative localization problem of wireless sensor networks. This paper presents a combinatorial rigidity approach to measure (i) generic rigidity and…

Systems and Control · Computer Science 2015-02-06 Tolga Eren

Graphs are used in almost every scientific discipline to express relations among a set of objects. Algorithms that compare graphs, and output a closeness score, or a correspondence among their nodes, are thus extremely important. Despite…

Discrete Mathematics · Computer Science 2020-11-17 Sam Safavi , José Bento

The problem of how to properly quantify redundant information is an open question that has been the subject of much recent research. Redundant information refers to information about a target variable S that is common to two or more…

Information Theory · Computer Science 2017-07-14 Robin A. A. Ince

In weighted graphs the shortest path between two nodes is often reached through an indirect path, out of all possible connections, leading to structural redundancies which play key roles in the dynamics and evolution of complex networks. We…

Social and Information Networks · Computer Science 2023-06-14 Felipe Xavier Costa , Rion Brattig Correia , Luis M. Rocha

We introduce the concept of pattern graphs--directed acyclic graphs representing how response patterns are associated. A pattern graph represents an identifying restriction that is nonparametrically identified/saturated and is often a…

Methodology · Statistics 2020-12-04 Yen-Chi Chen

Several studies have identified a significant amount of redundancy in the network traffic. For example, it is demonstrated that there is a great amount of redundancy within the content of a server over time. This redundancy can be leveraged…

Information Theory · Computer Science 2016-11-18 Mohsen Sardari , Ahmad Beirami , Faramarz Fekri

This paper addresses the problem of adding redundancy to a collection of physical objects so that the overall system is more robust to failures. In contrast to its information counterpart, which can exploit parity to protect multiple…

Information Theory · Computer Science 2017-11-09 Jennifer Tang , Da Wang , Yury Polyanskiy , Gregory Wornell

Failures of fairness or robustness in machine learning predictive settings can be due to undesired dependencies between covariates, outcomes and auxiliary factors of variation. A common strategy to mitigate these failures is data balancing,…

We define a measure of redundant information based on projections in the space of probability distributions. Redundant information between random variables is information that is shared between those variables. But in contrast to mutual…

Information Theory · Computer Science 2013-05-30 Malte Harder , Christoph Salge , Daniel Polani

We address the problem of distributed state estimation of a linear dynamical process in an attack-prone environment. Recent attempts to solve this problem impose stringent redundancy requirements on the measurement and communication…

Systems and Control · Electrical Eng. & Systems 2020-01-22 Aritra Mitra , Faiq Ghawash , Shreyas Sundaram , Waseem Abbas

Most information dynamics and statistical causal analysis frameworks rely on the common intuition that causal interactions are intrinsically pairwise -- every 'cause' variable has an associated 'effect' variable, so that a 'causal arrow'…

Neurons and Cognition · Quantitative Biology 2019-09-06 Pedro A. M. Mediano , Fernando Rosas , Robin L. Carhart-Harris , Anil K. Seth , Adam B. Barrett