English
Related papers

Related papers: An Extended Result on the Optimal Estimation under…

200 papers

Set-membership estimation (SME) outputs a set estimator that guarantees to cover the groundtruth. Such sets are, however, defined by (many) abstract (and potentially nonconvex) constraints and therefore difficult to manipulate. We present…

Optimization and Control · Mathematics 2024-08-05 Yukai Tang , Jean-Bernard Lasserre , Heng Yang

We establish the theoretical framework for implementing the maximumn entropy on the mean (MEM) method for linear inverse problems in the setting of approximate (data-driven) priors. We prove a.s. convergence for empirical means and further…

Machine Learning · Statistics 2024-12-25 Matthew King-Roskamp , Rustum Choksi , Tim Hoheisel

We revisit the well-studied problem of estimating the Shannon entropy of a probability distribution, now given access to a probability-revealing conditional sampling oracle. In this model, the oracle takes as input the representation of a…

Cryptography and Security · Computer Science 2022-06-03 Priyanka Golia , Brendan Juba , Kuldeep S. Meel

We study a quantity called discrete layered entropy, which approximates the Shannon entropy within a logarithmic gap. Compared to the Shannon entropy, the discrete layered entropy is piecewise linear, approximates the expected length of the…

Information Theory · Computer Science 2026-01-27 Cheuk Ting Li

When constructing models of the world, we aim for optimal compressions: models that include as few details as possible while remaining as accurate as possible. But which details -- or features measured in data -- should we choose to include…

Quantitative Methods · Quantitative Biology 2025-05-06 David P. Carcamo , Nicholas J. Weaver , Purushottam D. Dixit , Christopher W. Lynn

We consider the problem of finite sample corrections for entropy estimation. New estimates of the Shannon entropy are proposed and their systematic error (the bias) is computed analytically. We find that our results cover correction…

Statistical Mechanics · Physics 2009-11-10 Thomas Schürmann

The concept of entropy, firstly introduced in information theory, rapidly became popular in many applied sciences via Shannon's formula to measure the degree of heterogeneity among observations. A rather recent research field aims at…

Methodology · Statistics 2017-03-20 Linda Altieri , Daniela Cocchi , Giulia Roli

We propose a new way to measure inequalities such as the glass ceiling effect in attributed networks. Existing measures typically rely solely on node degree distribution or degree assortativity, but our approach goes beyond these measures…

Social and Information Networks · Computer Science 2023-03-20 Rui Luo , Buddhika Nettasinghe , Vikram Krishnamurthy

This paper introduces an objective metric for evaluating a parsing scheme. It is based on Shannon's original work with letter sequences, which can be extended to part-of-speech tag sequences. It is shown that this regular language is an…

cmp-lg · Computer Science 2008-02-03 Caroline Lyon , Stephen Brown

We describe an approach to improving model fitting and model generalization that considers the entropy of distributions of modelling residuals. We use simple simulations to demonstrate the observational signatures of overfitting on ordered…

Methodology · Statistics 2019-08-05 Barnaby Rowe

The expected improvement (EI) algorithm is a popular strategy for information collection in optimization under uncertainty. The algorithm is widely known to be too greedy, but nevertheless enjoys wide use due to its simplicity and ability…

Machine Learning · Computer Science 2017-05-30 Chao Qin , Diego Klabjan , Daniel Russo

The R{\'e}nyi entropy is one of the important information measures that generalizes Shannon's entropy. The quantum R{\'e}nyi entropy has a fundamental role in quantum information theory, therefore, bounding this quantity is of vital…

Mathematical Physics · Physics 2016-09-26 Hadi Reisizadeh , S. Mahmoud Manjegani

This paper considers an information bottleneck problem with the objective of obtaining a most informative representation of a hidden feature subject to a R\'enyi entropy complexity constraint. The optimal bottleneck trade-off between…

Information Theory · Computer Science 2021-02-01 Jian-Jia Weng , Fady Alajaji , Tamás Linder

We present a detailed derivation of some estimators of Shannon entropy for discrete distributions. They hold for finite samples of N points distributed into M "boxes", with N and M -> oo, but N/M < oo. In the high sampling regime (<< 1…

Data Analysis, Statistics and Probability · Physics 2011-11-09 P. Grassberger

Effective Capacity (EC) indicates the maximum communication rate subject to a certain delay constraint while effective energy efficiency (EEE) denotes the ratio between EC and power consumption. In this paper, we analyze the EEE of…

Information Theory · Computer Science 2018-01-30 Mohammad Shehab , Endrit Dosti , Hirley Alves , Matti Latva-aho

To handle with inverse problems, two probabilistic approaches have been proposed: the maximum entropy on the mean (MEM) and the Bayesian estimation (BAYES). The main object of this presentation is to compare these two approaches which are…

Data Analysis, Statistics and Probability · Physics 2007-05-23 A. Mohammad-Djafari

The total energy efficiency (TEE), defined as the ratio between the total data rate and the total power consumption, is considered the most meaningful performance metric in terms of energy efficiency (EE). Nevertheless, it does not depend…

Information Theory · Computer Science 2019-12-03 Christos N. Efrem , Athanasios D. Panagopoulos

We propose a novel information-theoretic approach for Bayesian optimization called Predictive Entropy Search (PES). At each iteration, PES selects the next evaluation point that maximizes the expected information gained with respect to the…

Machine Learning · Statistics 2014-06-11 José Miguel Hernández-Lobato , Matthew W. Hoffman , Zoubin Ghahramani

Problems of probabilistic inference and decision making under uncertainty commonly involve continuous random variables. Often these are discretized to a few points, to simplify assessments and computations. An alternative approximation is…

Artificial Intelligence · Computer Science 2013-03-08 William B. Poland , Ross D. Shachter

The Maximum Mutual Information (MMI) criterion is different from the Least Error Rate (LER) criterion. It can reduce failing to report small probability events. This paper introduces the Channels Matching (CM) algorithm for the MMI…

Machine Learning · Computer Science 2019-01-30 Chenguang Lu
‹ Prev 1 3 4 5 6 7 10 Next ›