Related papers: Information Gain as a Tool for Assessing Biosignat…
Model selection is the problem of distinguishing competing models, perhaps featuring different numbers of parameters. The statistics literature contains two distinct sets of tools, those based on information theory such as the Akaike…
Assessing the quality of discovered results is an important open problem in data mining. Such assessment is particularly vital when mining itemsets, since commonly many of the discovered patterns can be easily explained by background…
Accurate object pose estimation using multi-modal perception such as visual and tactile sensing have been used for autonomous robotic manipulators in literature. Due to variation in density of visual and tactile data, a novel probabilistic…
Exoplanet research is carried out at the limits of the capabilities of current telescopes and instruments. The studied signals are weak, and often embedded in complex systematics from instrumental, telluric, and astrophysical sources.…
An agent acquires information dynamically until her belief about a binary state reaches an upper or lower threshold. She can choose any signal process subject to a constraint on the rate of entropy reduction. Strategies are ordered by "time…
We describe a straightforward modification of frequently invoked methods for the determination of the statistical significance of a gamma-ray signal observed in a counting process. A simple criterion is proposed to decide whether a set of…
In machine learning or scientific computing, model performance is measured with an objective function. But why choose one objective over another? Information theory gives one answer: To maximize the information in the model, select the…
The concept of autonomy is fundamental for understanding biological organization and the evolutionary transitions of living systems. Understanding how a system constitutes itself as an individual, cohesive, self-organized entity is a…
We study a Bayesian persuasion setting with binary actions (adopt and reject) for Receiver. We examine the following question - how well can Sender perform, in terms of persuading Receiver to adopt, when ignorant of Receiver's utility? We…
We investigate the relationship between the information gain and the interaction strength between the quantum system and the measuring device. A strategy is proposed to calculate the information gain of the measuring device as the coupling…
This paper presents case-study results on the application of information theoretic approach to gate-level evolutionary circuit design. We introduce information measures to provide better estimates of synthesis criteria of digital circuits.…
In this article an analysis of the fundamentals used to search for extraterrestrial artificial signals in the galaxy, which have been developing for more than five decades, is presented. It is shown that the key factor for the success of…
Bayesian optimal experimental design provides a principled framework for selecting experimental settings that maximize obtained information. In this work, we focus on estimating the expected information gain in the setting where the…
Recently, the hyperspectral sensors have improved our ability to monitor the earth surface with high spectral resolution. However, the high dimensionality of spectral data brings challenges for the image processing. Consequently, the…
We present an analytic model to estimate the capabilities of space missions dedicated to the search for biosignatures in the atmosphere of rocky planets located in the habitable zone of nearby stars. Relations between performance and…
For sensory networks, we determine the rate with which they acquire information about the changing external conditions. Comparing this rate with the thermodynamic entropy production that quantifies the cost of maintaining the network, we…
The Gaia mission is expected to provide highly accurate astrometric, photometric, and spectroscopic measurements for about $10^9$ objects. Automated classification of detected sources is a key part of the data processing. Here a few aspects…
Perimeter cybersecurity, while essential, has proven insufficient against sophisticated, coordinated, and cyber-physical attacks. In contrast, mission-centric cybersecurity emphasizes finding evidence of attack impact on mission success,…
Using multiple ion beam analysis measurements, or techniques, combined with self-consistent data processing, generally allows extracting more (or more accurate) information from the measurements than processing separately data from single…
With new advancements in technology, it is now possible to collect data for a variety of different metrics describing tumor growth, including tumor volume, composition, and vascularity, among others. For any proposed model of tumor growth…