English
Related papers

Related papers: Towards a Synergy-based Approach to Measuring Info…

200 papers

Partial information decomposition has recently found applications in biological signal processing and machine learning. Despite its impacts, the decomposition was introduced through an informal and heuristic route, and its exact operational…

Information Theory · Computer Science 2025-02-18 Chao Tian , Shlomo Shamai

The prevalence of new technologies and social media has amplified the effects of misinformation on our societies. Thus, it is necessary to create computational tools to mitigate their effects effectively. This study aims to provide a…

Human-Computer Interaction · Computer Science 2019-03-19 Alireza Karduni

In many information networks, data items -- such as updates in social networks, news flowing through interconnected RSS feeds and blogs, measurements in sensor networks, route updates in ad-hoc networks -- propagate in an uncoordinated…

Databases · Computer Science 2012-02-01 Dóra Erdös , Vatche Ishakian , Andrei Lapets , Evimaria Terzi , Azer Bestavros

We present a measure of local information transfer, derived from an existing averaged information-theoretical measure, namely transfer entropy. Local transfer entropy is used to produce profiles of the information transfer into each…

Cellular Automata and Lattice Gases · Physics 2008-09-22 Joseph T. Lizier , Mikhail Prokopenko , Albert Y. Zomaya

In this thesis we consider the problem of information hiding in the scenarios of interactive systems, statistical disclosure control, and refinement of specifications. We apply quantitative approaches to information flow in the first two…

Cryptography and Security · Computer Science 2012-02-14 Mário S. Alvim

The information theoretic quantity known as mutual information finds wide use in classification and community detection analyses to compare two classifications of the same set of objects into groups. In the context of classification…

Social and Information Networks · Computer Science 2020-04-29 M. E. J. Newman , George T. Cantwell , Jean-Gabriel Young

This two-part paper discusses robustification methodologies for linear-iterative distributed algorithms for consensus and coordination problems in multicomponent systems, in which unreliable communication links may drop packets. We consider…

Systems and Control · Computer Science 2011-09-30 Alejandro D. Dominguez-Garcia , Christoforos N. Hadjicostis , Nitin H. Vaidya

During a spontaneous change, a macroscopic physical system will evolve towards a macro-state with more realizations. This observation is at the basis of the Statistical Mechanical version of the Second Law of Thermodynamics, and it provides…

Statistical Mechanics · Physics 2020-04-22 Mengjie Zu , Arunkumar Bupathy , Daan Frenkel , Srikanth Sastry

We consider the interaction of a small quantum system (a qubit) with a structured environment consisting on many levels. The qubit will experience a decoherence process, which implies that its initial information will be transferred to the…

Quantum Physics · Physics 2010-06-01 A. Perez

Fusing measurements from multiple, heterogeneous, partial sources, observing a common object or process, poses challenges due to the increasing availability of numbers and types of sensors. In this work we propose, implement and validate an…

The exploration of complex physical or technological processes usually requires exploiting available information from different sources: (i) physical laws often represented as a family of parameter dependent partial differential equations…

Numerical Analysis · Mathematics 2020-02-04 Albert Cohen , Wolfgang Dahmen , Ron DeVore

Measurements can detect errors in a decohered quantum memory allowing active error correction to increase the memory time. Previous understanding of this mechanism has focused on evaluating the performance of error correction algorithms…

Quantum Physics · Physics 2024-07-11 Jacob Hauser , Yimu Bao , Shengqi Sang , Ali Lavasani , Utkarsh Agrawal , Matthew P. A. Fisher

Determining how much of the sensory information carried by a neural code contributes to behavioral performance is key to understand sensory function and neural information flow. However, there are as yet no analytical tools to compute this…

In this work, a strategy to estimate the information transfer between the elements of a complex system, from the time series associated to the evolution of this elements, is presented. By using the nearest neighbors of each state, the local…

Information Theory · Computer Science 2018-12-05 P. Garcia , R. Mujica

We consider a robotic vehicle tasked with gathering information by visiting a set of spatially-distributed data sources, the locations of which are not known a priori, but are discovered on the fly. We assume a first-order robot dynamics…

Robotics · Computer Science 2017-04-10 Fangchang Ma , Sertac Karaman

This paper develops new methodology, together with related theories, for combining information from independent studies through confidence distributions. A formal definition of a confidence distribution and its asymptotic counterpart (i.e.,…

Statistics Theory · Mathematics 2007-06-13 Kesar Singh , Minge Xie , William E. Strawderman

Observations on the past provide some hints about what will happen in the future, and this can be quantified using information theory. The ``predictive information'' defined in this way has connections to measures of complexity that have…

Statistical Mechanics · Physics 2007-05-23 William Bialek , Naftali Tishby

Clustering evaluation measures are frequently used to evaluate the performance of algorithms. However, most measures are not properly normalized and ignore some information in the inherent structure of clusterings. We model the relation…

Machine Learning · Computer Science 2012-09-05 Qiaoliang Xiang , Qi Mao , Kian Ming Chai , Hai Leong Chieu , Ivor Tsang , Zhendong Zhao

Spreading information through a network of devices is a core activity for most distributed systems. As such, self-stabilizing algorithms implementing information spreading are one of the key building blocks enabling aggregate computing to…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-23 Yuanqiu Mo , Soura Dasgupta , Jacob Beal

Meta-analytic methods tend to take all-or-nothing approaches to study-level heterogeneity, assuming all studies are heterogeneous or homogeneous, leading to inefficiency and/or bias in estimation and inference. In this paper, we develop a…

Methodology · Statistics 2026-03-12 Elizabeth M. Davis , Emily C. Hector