English
Related papers

Related papers: Applications of Information Inequalities to Databa…

200 papers

Assessing and improving the quality of data in data-intensive systems are fundamental challenges that have given rise to numerous applications targeting transformation and cleaning of data. However, while schema design, data cleaning, and…

Databases · Computer Science 2017-12-12 Rada Chirkova , Jon Doyle , Juan L. Reutter

Today's intelligent computing environments, including Internet of Things, cloud computing and fog computing, allow many organizations around the world to optimize their resource allocation regarding time and energy consumption. Due to the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-09 Fatemeh Rahmani , Javad Hassannataj Joloudari , Shahab Shamshirband , Seyedakbar Mostafavi

This work provides data-processing and majorization inequalities for $f$-divergences, and it considers some of their applications to coding problems. This work also provides tight bounds on the R\'{e}nyi entropy of a function of a discrete…

Information Theory · Computer Science 2021-04-01 Igal Sason

Although information theory has found success in disciplines, the literature on its applications to software evolution is limit. We are still missing artifacts that leverage the data and tooling available to measure how the information…

Software Engineering · Computer Science 2023-04-27 Adriano Torres , Sebastian Baltes , Christoph Treude , Markus Wagner

Information-theoretic bounded rationality describes utility-optimizing decision-makers whose limited information-processing capabilities are formalized by information constraints. One of the consequences of bounded rationality is that…

Machine Learning · Computer Science 2020-06-30 Heinke Hihn , Sebastian Gottwald , Daniel A. Braun

We introduce the notion of a database system that is information theoretically "Secure In Between Accesses"--a database system with the properties that 1) users can efficiently access their data, and 2) while a user is not accessing their…

Cryptography and Security · Computer Science 2016-05-10 Gregory Valiant , Paul Valiant

One approach to confronting computational hardness is to try to understand the contribution of various parameters to the running time of algorithms and the complexity of computational tasks. Almost no computational tasks in real life are…

Computational Complexity · Computer Science 2011-11-23 Rodney G. Downey , Dimitrios M. Thilikos

Feature selection is one of the most fundamental problems in machine learning. An extensive body of work on information-theoretic feature selection exists which is based on maximizing mutual information between subsets of features and class…

Machine Learning · Statistics 2016-06-10 Shuyang Gao , Greg Ver Steeg , Aram Galstyan

This paper reveals a conceptually new connection from information theory to approximation theory via quantum algorithms for entropy estimation. Specifically, we provide an information-theoretic lower bound $\Omega(\sqrt{n})$ on the…

Quantum Physics · Physics 2025-09-04 Qisheng Wang

We describe and develop a close relationship between two problems that have customarily been regarded as distinct: that of maximizing entropy, and that of minimizing worst-case expected loss. Using a formulation grounded in the equilibrium…

Statistics Theory · Mathematics 2007-06-13 Peter D. Grunwald , A. Philip Dawid

Inducing association rules is one of the central tasks in data mining applications. Quantitative association rules induced from databases describe rich and hidden relationships holding within data that can prove useful for various…

Computational Complexity · Computer Science 2007-05-23 Fabrizio Angiulli , Giovambattista Ianni , Luigi Palopoli

Uncertainty arises naturally inmany application domains due to, e.g., data entry errors and ambiguity in data cleaning. Prior work in incomplete and probabilistic databases has investigated the semantics and efficient evaluation of ranking…

Databases · Computer Science 2023-05-04 Su Feng , Boris Glavic , Oliver Kennedy

The ability to estimate resource consumption of SQL queries is crucial for a number of tasks in a database system such as admission control, query scheduling and costing during query optimization. Recent work has explored the use of…

Databases · Computer Science 2012-08-02 Jiexing Li , Arnd Christian König , Vivek Narasayya , Surajit Chaudhuri

During the last two decades, concentration of measure has been a subject of various exciting developments in convex geometry, functional analysis, statistical physics, high-dimensional statistics, probability theory, information theory,…

Information Theory · Computer Science 2015-10-13 Maxim Raginsky , Igal Sason

Bounds on information combining are entropic inequalities that determine how the information, or entropy, of a set of random variables can change when they are combined in certain prescribed ways. Such bounds play an important role in…

Information Theory · Computer Science 2020-11-10 Christoph Hirche

We present a generalization of the maximal inequalities that upper bound the expectation of the maximum of $n$ jointly distributed random variables. We control the expectation of a randomly selected random variable from $n$ jointly…

Probability · Mathematics 2017-08-31 Jiantao Jiao , Yanjun Han , Tsachy Weissman

The uncertainty quantification and risk modeling are hot topics in the operation and planning of energy systems. The system operators and planners are decision-makers that need to handle the uncertainty of input data of their models. As an…

Systems and Control · Electrical Eng. & Systems 2019-12-03 Majid Majidi , Behnam Mohammadi-Ivatlooa , Alireza Soroudi

In some areas of management and commerce, especially in Electronic commerce (E-commerce), that are accelerated by advances in Web technologies, it is essential to support the decision making process using formal methods. Among the problems…

Logic in Computer Science · Computer Science 2007-05-23 Denis V. Popel , Nawar Al-Hakeem

Quantum computing has emerged as a transformative tool for future data management. Classical problems in database domains, including query optimization, data integration, and transaction management, have recently been addressed using…

Databases · Computer Science 2024-03-06 Rihan Hai , Shih-Han Hung , Sebastian Feld

Many new database application domains such as experimental sciences and medicine are characterized by large sequences as their main form of data. Using approximate representation can significantly reduce the required storage and search…

Databases · Computer Science 2019-04-22 Hagit Shatkay , Stanley B. Zdonik