English
Related papers

Related papers: An information measure for comparing top $k$ lists

200 papers

The problem of identifying to which of a given set of classes objects belong is ubiquitous, occurring in many research domains and application areas, including medical diagnosis, financial decision making, online commerce, and national…

Machine Learning · Computer Science 2024-09-20 David J. Hand , Peter Christen , Sumayya Ziyad

We address the practical problems of estimating the information relations that characterize large networks. Building on methods developed for analysis of the neural code, we show that reliable estimates of mutual information can be obtained…

Information Theory · Computer Science 2007-07-13 Noam Slonim , Gurinder S. Atwal , Gasper Tkacik , William Bialek

Multi-label ranking, which returns multiple top-ranked labels for each instance, has a wide range of applications for visual tasks. Due to its complicated setting, prior arts have proposed various measures to evaluate model performances.…

Machine Learning · Computer Science 2024-07-10 Zitai Wang , Qianqian Xu , Zhiyong Yang , Peisong Wen , Yuan He , Xiaochun Cao , Qingming Huang

We consider the problem of selecting a subset of alternatives given noisy evaluations of the relative strength of different alternatives. We wish to select a k-subset (for a given k) that provides a maximum likelihood estimate for one of…

Artificial Intelligence · Computer Science 2012-10-19 Ariel D. Procaccia , Sashank J. Reddi , Nisarg Shah

We introduce an information theoretic measure of statistical structure, called 'binding information', for sets of random variables, and compare it with several previously proposed measures including excess entropy, Bialek et al.'s…

Statistics Theory · Mathematics 2010-12-10 Samer A. Abdallah , Mark D. Plumbley

Fairness is an emerging and challenging topic in recommender systems. In recent years, various ways of evaluating and therefore improving fairness have emerged. In this study, we examine existing evaluation measures of fairness in…

Information Retrieval · Computer Science 2024-05-21 Theresia Veronika Rampisela , Maria Maistro , Tuukka Ruotsalo , Christina Lioma

We consider data in the form of pairwise comparisons of n items, with the goal of precisely identifying the top k items for some value of k < n, or alternatively, recovering a ranking of all the items. We analyze the Copeland counting…

Machine Learning · Computer Science 2016-04-28 Nihar B. Shah , Martin J. Wainwright

Hierarchical classification addresses the problem of classifying items into a hierarchy of classes. An important issue in hierarchical classification is the evaluation of different classification algorithms, which is complicated by the…

Artificial Intelligence · Computer Science 2015-04-01 Aris Kosmopoulos , Ioannis Partalas , Eric Gaussier , Georgios Paliouras , Ion Androutsopoulos

We propose a novel measure to assess the presence of meso-scale structures in complex networks. This measure is based on the identification of regular patterns in the adjacency matrix of the network, and on the calculation of the quantity…

Physics and Society · Physics 2015-06-18 Massimiliano Zanin , Pedro A. Sousa , Ernestina Menasalvas

In mathematics information is a number that measures uncertainty (entropy) based on a probabilistic distribution, often of an obscure origin. In real life language information is a datum, a statement, more precisely, a formula. But such a…

Artificial Intelligence · Computer Science 2022-05-17 Anatol Slissenko

A method is discussed that allows combining sets of differential or inclusive measurements. It is assumed that at least one measurement was obtained with simultaneously fitting a set of nuisance parameters, representing sources of…

Data Analysis, Statistics and Probability · Physics 2018-01-09 Jan Kieseler

Correlations disguised in various forms underlie a host of important phenomena in classical and quantum systems, such as information and energy exchanges. The quantum mutual information and the norm of the correlation matrix are both…

Quantum Physics · Physics 2020-04-15 S. Alipour , S. Tuohino , A. T. Rezakhani , T. Ala-Nissila

We define a measure of redundant information based on projections in the space of probability distributions. Redundant information between random variables is information that is shared between those variables. But in contrast to mutual…

Information Theory · Computer Science 2013-05-30 Malte Harder , Christoph Salge , Daniel Polani

The introduction of the partial information decomposition generated a flurry of proposals for defining an intersection information that quantifies how much of "the same information" two or more random variables specify about a target random…

Information Theory · Computer Science 2015-06-11 Virgil Griffith , Edwin K. P. Chong , Ryan G. James , Christopher J. Ellison , James P. Crutchfield

Information theory is built on probability measures and by definition a probability measure has total mass 1. Probability measures are used to model uncertainty, and one may ask how important it is that the total mass is one. We claim that…

Information Theory · Computer Science 2022-02-08 Peter Harremoës

Recently, it has been claimed that a linear relationship between a measure of information content and word length is expected from word length optimization and it has been shown that this linearity is supported by a strong correlation…

Data Analysis, Statistics and Probability · Physics 2019-12-11 Ramon Ferrer-i-Cancho , Fermín Moscoso del Prado Martín

Probabilistic representation spaces convey information about a dataset and are shaped by factors such as the training data, network architecture, and loss function. Comparing the information content of such spaces is crucial for…

Machine Learning · Computer Science 2025-02-20 Kieran A. Murphy , Sam Dillavou , Dani S. Bassett

A common challenge for e-commerce sellers is to decide what product images to display on online shopping sites. In this paper, we propose and validate a novel metric, k-value, to quantify the information richness of an image set, and we…

Human-Computer Interaction · Computer Science 2025-08-11 Zhu Yuting , Cao Xinyu , Su Yuzhuo , Ma Yongbin

Information retrieval (IR) systems often leverage query data to suggest relevant items to users. This introduces the possibility of unfairness if the query (i.e., input) and the resulting recommendations unintentionally correlate with…

Machine Learning · Statistics 2019-09-17 Rinat Khaziev , Bryce Casavant , Pearce Washabaugh , Amy A. Winecoff , Matthew Graham

We review possible measures of complexity which might in particular be applicable to situations where the complexity seems to arise spontaneously. We point out that not all of them correspond to the intuitive (or "naive") notion, and that…

Data Analysis, Statistics and Probability · Physics 2012-08-20 Peter Grassberger