English
Related papers

Related papers: Towards the full information chain theory: answer …

200 papers

Data depth is a concept in multivariate statistics that measures the centrality of a point in a given data cloud in $\IR^d$. If the depth of a point can be represented as the minimum of the depths with respect to all one-dimensional…

Computation · Statistics 2020-07-17 Rainer Dyckerhoff , Pavlo Mozharovskyi , Stanislav Nagy

As information becomes increasingly sizable for organizations to maintain the challenge of organizing data still remains. More importantly, the on-going process of analysing incoming data occurs on a continual basis and organizations should…

Databases · Computer Science 2021-05-19 Bryar A. Hassan , Shko M. Qader

Information theory and the framework of information dynamics have been used to provide tools to characterise complex systems. In particular, we are interested in quantifying information storage, information modification and information…

Information Theory · Computer Science 2013-03-25 Oliver Obst , Joschka Boedecker , Benedikt Schmidt , Minoru Asada

All sequential decision-making agents explore so as to acquire knowledge about a particular target. It is often the responsibility of the agent designer to construct this target which, in rich and complex environments, constitutes a onerous…

Machine Learning · Computer Science 2021-10-28 Dilip Arumugam , Benjamin Van Roy

From this set of procedures for given clause we shall choose only interrogation of experts on pairs decisions. It is widely widespread method. It makes the whole chapter in the theory of the decision-making, well investigated with the…

Optimization and Control · Mathematics 2010-03-05 V. Zhukovin , N. Chkhikvadze , Z. Alimbarashvili

Search systems are increasingly used for gaining knowledge through accessing relevant resources from a vast volume of content. However, search systems provide only limited support to users in knowledge acquisition contexts. Specifically,…

Information Retrieval · Computer Science 2022-04-26 Yasin Ghafourian

Online knowledge repositories typically rely on their users or dedicated editors to evaluate the reliability of their content. These evaluations can be viewed as noisy measurements of both information reliability and information source…

Social and Information Networks · Computer Science 2017-04-04 Behzad Tabibian , Isabel Valera , Mehrdad Farajtabar , Le Song , Bernhard Schölkopf , Manuel Gomez-Rodriguez

In practical data integration systems, it is common for the data sources being integrated to provide conflicting information about the same entity. Consequently, a major challenge for data integration is to derive the most complete and…

Databases · Computer Science 2012-03-05 Bo Zhao , Benjamin I. P. Rubinstein , Jim Gemmell , Jiawei Han

Concept-based Models are a class of inherently explainable networks that improve upon standard Deep Neural Networks by providing a rationale behind their predictions using human-understandable `concepts'. With these models being highly…

Machine Learning · Computer Science 2025-06-06 Sanchit Sinha , Aidong Zhang

Evaluating the channel capacity is one of many key problems in information theory. In this work we derive rather-mild sufficient conditions under which the capacity is finite and achievable. These conditions are derived for generic,…

Information Theory · Computer Science 2015-12-18 Jihad Fahs , Ibrahim Abou-Faycal

The uncertainty quantification and risk modeling are hot topics in the operation and planning of energy systems. The system operators and planners are decision-makers that need to handle the uncertainty of input data of their models. As an…

Systems and Control · Electrical Eng. & Systems 2019-12-03 Majid Majidi , Behnam Mohammadi-Ivatlooa , Alireza Soroudi

In this paper, we study a problem of detecting the source of diffused information by querying individuals, given a sample snapshot of the information diffusion graph, where two queries are asked: {\em (i)} whether the respondent is the…

Social and Information Networks · Computer Science 2020-10-23 Jaeyoung Choi , Sangwoo Moon , Jiin Woo , Kyunghwan Son , Jinwoo Shin , Yung Yi

We propose an information-theoretic framework for analyzing control systems based on the close relationship of controllers to communication channels. A communication channel takes an input state and transforms it into an output state. A…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Hugo Touchette , Seth Lloyd

In this paper, based on results of exact learning and test theory, we study arbitrary infinite binary information systems each of which consists of an infinite set of elements and an infinite set of two-valued functions (attributes) defined…

Computational Complexity · Computer Science 2022-01-13 Mikhail Moshkov

We initiate an investigation how the fundamental concept of independence can be represented effectively in the presence of incomplete information in relational databases. The concepts of possible and certain independence are proposed, and…

Databases · Computer Science 2025-10-10 Miika Hannula , Minna Hirvonen , Juha Kontinen , Sebastian Link

We introduce a bottleneck method for learning data representations based on information deficiency, rather than the more traditional information sufficiency. A variational upper bound allows us to implement this method efficiently. The…

Information Theory · Computer Science 2020-11-05 Pradeep Kr. Banerjee , Guido Montúfar

Large language models (LLMs) have rapidly evolved from text generators into powerful problem solvers. Yet, many open tasks demand critical thinking, multi-source, and verifiable outputs, which are beyond single-shot prompting or standard…

A data depth measures the centrality of a point with respect to an empirical distribution. Postulates are formulated, which a depth for functional data should satisfy, and a general approach is proposed to construct multivariate data depths…

Methodology · Statistics 2018-01-31 Karl Mosler , Yulia Polyakova

Information Theory concepts and methodologies conform the background of how communication systems are studied and understood. They are mainly focused on the source-channel-receiver problem and on the asymptotic limits of accuracy and…

Adaptation and Self-Organizing Systems · Physics 2017-05-16 Nicolás Rubido , Celso Grebogi , Murilo S. Baptista

Two kinds of systems have been defined during the long history of WSD: principled systems that define which knowledge types are useful for WSD, and robust systems that use the information sources at hand, such as, dictionaries, light-weight…

Computation and Language · Computer Science 2007-05-23 Eneko Agirre , David Martinez