English
Related papers

Related papers: Information content of partially rank-ordered set …

200 papers

This paper studies a Markov network model for unbalanced data, aiming to solve the problems of classification bias and insufficient minority class recognition ability of traditional machine learning models in environments with uneven class…

Machine Learning · Computer Science 2025-02-06 Junliang Du , Shiyu Dou , Bohuan Yang , Jiacheng Hu , Tai An

Recently, fundamental conditions on the sampling patterns have been obtained for finite completability of low-rank matrices or tensors given the corresponding ranks. In this paper, we consider the scenario where the rank is not given and we…

Machine Learning · Computer Science 2017-11-03 Morteza Ashraphijuo , Xiaodong Wang , Vaneet Aggarwal

In this paper, we analyze the impact of compressed sensing with complex random matrices on Fisher information and the Cram\'{e}r-Rao Bound (CRB) for estimating unknown parameters in the mean value function of a complex multivariate normal…

Statistics Theory · Mathematics 2023-07-19 Pooria Pakrooh , Ali Pezeshki , Louis L. Scharf , Douglas Cochran , Stephen D. Howard

This paper provides a systematic approach to semiparametric identification that is based on statistical information as a measure of its "quality". Identification can be regular or irregular, depending on whether the Fisher information for…

Statistics Theory · Mathematics 2021-07-01 Juan Carlos Escanciano

Shannon entropy is widely used to measure the complexity of DNA sequences but suffers from saturation effects that limit its discriminative power for long uniform segments. We introduce a novel metric, the entropy rank ratio R, which…

Information Theory · Computer Science 2025-11-10 Emmanuel Pio Pastore , Giuseppe Passarino , Peppino Sapia , Francesco De Rango

Many studies that gather social network data use survey methods that lead to censored, missing or otherwise incomplete information. For example, the popular fixed rank nomination (FRN) scheme, often used in studies of schools and…

Methodology · Statistics 2012-12-27 Peter Hoff , Bailey Fosdick , Alex Volfovsky , Katherine Stovel

Sorted data is usually easier to compress than unsorted permutations of the same data. This motivates a simple compression scheme: specify the sorted permutation of the data along with a representation of the sorted data compressed…

Data Structures and Algorithms · Computer Science 2014-11-24 Oscar Stiffelman

This thesis details a class of partial orders on the space of probability distributions and the space of density operators which capture the idea of information content. Some links to domain theory and computational linguistics are also…

Logic in Computer Science · Computer Science 2017-01-25 John van de Wetering

Constructing prediction sets with coverage guarantees for unobserved outcomes is a core problem in modern statistics. Methods for predictive inference have been developed for a wide range of settings, but usually only consider test data…

Methodology · Statistics 2025-07-11 Yonghoon Lee , Eric Tchetgen Tchetgen , Edgar Dobriban

Obtaining a reliable estimate of the joint probability mass function (PMF) of a set of random variables from observed data is a significant objective in statistical signal processing and machine learning. Modelling the joint PMF as a tensor…

Machine Learning · Statistics 2026-02-03 Joseph K. Chege , Arie Yeredor , Martin Haardt

In this paper we give an overview of partial orders on the space of probability distributions that carry a notion of information content and serve as a generalisation of the Bayesian order given in (Coecke and Martin, 2011). We investigate…

Computation and Language · Computer Science 2016-08-05 John van de Wetering

Recommender systems leverage extensive user interaction data to model preferences; however, directly modeling these data may introduce biases that disproportionately favor popular items. In this paper, we demonstrate that popularity bias…

Information Retrieval · Computer Science 2025-04-21 Jiahao Liu , Dongsheng Li , Hansu Gu , Peng Zhang , Tun Lu , Li Shang , Ning Gu

We propose a sampling scheme suitable for reducing a data set prior to selecting a hypothesis with minimum empirical risk. The sampling only considers a subset of the ultimate (unknown) hypothesis set, but can nonetheless guarantee that the…

Machine Learning · Computer Science 2013-06-25 Paul Mineiro , Nikos Karampatziakis

In a recent paper entitled "Inconsistencies of Recently Proposed Citation Impact Indicators and how to Avoid Them," Schreiber (2012, at arXiv:1202.3861) proposed (i) a method to assess tied ranks consistently and (ii) fractional attribution…

Digital Libraries · Computer Science 2012-04-10 Loet Leydesdorff

Random sampling is an essential tool in the processing and transmission of data. It is used to summarize data too large to store or manipulate and meet resource constraints on bandwidth or battery power. Estimators that are applied to the…

Databases · Computer Science 2015-03-19 Edith Cohen , Haim Kaplan

A new framework is introduced for examining and evaluating the fundamental limits of lossless data compression, that emphasizes genuinely non-asymptotic results. The {\em sample complexity} of compressing a given source is defined as the…

Information Theory · Computer Science 2026-04-16 Terence Viaud , Ioannis Kontoyiannis

Measuring what linguistic information is encoded in neural models of language has become popular in NLP. Researchers approach this enterprise by training "probes" - supervised models designed to extract linguistic structure from another…

Computation and Language · Computer Science 2020-05-13 Rowan Hall Maudslay , Josef Valvoda , Tiago Pimentel , Adina Williams , Ryan Cotterell

We investigate a Poisson sampling design in the presence of unknown selection probabilities when applied to a population of unknown size for multiple sampling occasions. The fixed-population model is adopted and extended upon for inference.…

Methodology · Statistics 2020-01-30 Kyle Vincent , Saman Muthukumarana

The use of principal component methods to analyze functional data is appropriate in a wide range of different settings. In studies of ``functional data analysis,'' it has often been assumed that a sample of random functions is observed…

Statistics Theory · Mathematics 2016-08-16 Peter Hall , Hans-Georg Müller , Jane-Ling Wang

The fair-ranking problem, which asks to rank a given set of items to maximize utility subject to group fairness constraints, has received attention in the fairness, information retrieval, and machine learning literature. Recent works,…

Machine Learning · Computer Science 2022-12-01 Anay Mehrotra , Nisheeth K. Vishnoi