English
Related papers

Related papers: Shannon Entropy is better Feature than Category an…

200 papers

Comparison-based algorithms are algorithms for which the execution of each operation is solely based on the outcome of a series of comparisons between elements. Comparison-based computations can be naturally represented via the following…

Data Structures and Algorithms · Computer Science 2020-11-17 Michel Schellekens

Graph neural networks (GNNs) have proven to be an effective tool for enhancing the performance of recommender systems. However, these systems often suffer from popularity bias, leading to an unfair advantage for frequently interacted items,…

Information Retrieval · Computer Science 2026-04-29 Nemat Gholinejad , Mostafa Haghir Chehreghani

We revisit the well-studied problem of estimating the Shannon entropy of a probability distribution, now given access to a probability-revealing conditional sampling oracle. In this model, the oracle takes as input the representation of a…

Cryptography and Security · Computer Science 2022-06-03 Priyanka Golia , Brendan Juba , Kuldeep S. Meel

We introduce a novel entropy-related function, \textit{non-repeatability}, designed to capture dynamical behaviors in complex systems. Its normalized form, \textit{mutability}, has been previously applied in statistical physics as a…

Statistical Mechanics · Physics 2025-04-04 Eugenio E. Vogel , Francisco J. Peña , G. Saravia , P. Vargas

Performing effective preference-based data retrieval requires detailed and preferentially meaningful structurized information about the current user as well as the items under consideration. A common problem is that representations of items…

Artificial Intelligence · Computer Science 2011-01-13 Joachim Selke , Wolf-Tilo Balke

In this paper, I expand Shannon's definition of entropy into a new form of entropy that allows integration of information from different random events. Shannon's notion of entropy is a special case of my more general definition of entropy.…

Machine Learning · Computer Science 2008-11-04 Stefan Jaeger

Achieving fairness in text-to-image generation demands mitigating social biases without compromising visual fidelity, a challenge critical to responsible AI. Current fairness evaluation procedures for text-to-image models rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Marco N. Bochernitsan , Rodrigo C. Barros , Lucas S. Kupssinskü

Typical use cases of sentiment analysis usually revolve around assessing the probability of a text belonging to a certain sentiment and deriving insight concerning it; little work has been done to explore further use cases derived using…

Machine Learning · Statistics 2021-04-01 Thomas Konstantinovsky

Recent work in recommender systems mainly focuses on fairness in recommendations as an important aspect of measuring recommendations quality. A fairness-aware recommender system aims to treat different user groups similarly. Relevant work…

Information Retrieval · Computer Science 2022-05-18 Hossein A. Rahmani , Mohammadmehdi Naghiaei , Mahdi Dehghan , Mohammad Aliannejadi

We consider the problem of classifying documents not by topic, but by overall sentiment, e.g., determining whether a review is positive or negative. Using movie reviews as data, we find that standard machine learning techniques definitively…

Computation and Language · Computer Science 2007-05-23 Bo Pang , Lillian Lee , Shivakumar Vaithyanathan

It is not obvious how to extend Shannon's original information entropy to higher dimensions, and many different approaches have been tried. We replace the English text symbol sequence originally used to illustrate the theory by a discrete,…

Information Theory · Computer Science 2016-09-06 Kieran G. Larkin

Estimating entropies from limited data series is known to be a non-trivial task. Naive estimations are plagued with both systematic (bias) and statistical errors. Here, we present a new 'balanced estimator' for entropy functionals Shannon,…

Statistical Mechanics · Physics 2008-04-30 Juan A. Bonachela , Haye Hinrichsen , Miguel A. Munoz

Acquiring accurate summarization and sentiment from user reviews is an essential component of modern e-commerce platforms. Review summarization aims at generating a concise summary that describes the key opinions and sentiment of a review,…

Computation and Language · Computer Science 2021-02-03 Hou Pong Chan , Wang Chen , Irwin King

Reasoning models often outperform smaller models but at 3--5$\times$ higher cost and added latency. We present entropy-guided refinement: a lightweight, test-time loop that uses token-level uncertainty to trigger a single, targeted…

Artificial Intelligence · Computer Science 2025-09-03 Andrew G. A. Correa , Ana C. H de Matos

We present an advanced approach to mobile app review analysis aimed at addressing limitations inherent in traditional star-rating systems. Star ratings, although intuitive and popular among users, often fail to capture the nuanced feedback…

Artificial Intelligence · Computer Science 2025-09-26 Najla Zuhir , Amna Mohammad Salim , Parvathy Premkumar , Moshiur Farazi

Explaining to users why some items are recommended is critical, as it can help users to make better decisions, increase their satisfaction, and gain their trust in recommender systems (RS). However, existing explainable RS usually consider…

Information Retrieval · Computer Science 2022-10-25 Lei Li , Yongfeng Zhang , Li Chen

Review score prediction of text reviews has recently gained a lot of attention in recommendation systems. A major problem in models for review score prediction is the presence of noise due to user-bias in review scores. We propose two…

Computation and Language · Computer Science 2017-05-15 Rahul Wadbude , Vivek Gupta , Dheeraj Mekala , Harish Karnick

Standard collaborative filtering approaches for top-N recommendation are biased toward popular items. As a result, they recommend items that users are likely aware of and under-represent long-tail items. This is inadequate, both for…

Information Retrieval · Computer Science 2018-03-02 Zainab Zolaktaf , Reza Babanezhad , Rachel Pottinger

The problem of Shannon entropy estimation in countable infinite alphabets is addressed from the study and use of convergence results of the entropy functional, which is known to be discontinuous with respect to the total variation distance…

Information Theory · Computer Science 2018-04-03 Jorge F. Silva

In the hospitality industry, understanding the factors that drive customer review ratings is critical for improving guest satisfaction and business performance. This work proposes ReviewGraph for Review Rating Prediction (RRP), a novel…

Computation and Language · Computer Science 2025-11-18 A. J. W. de Vink , Natalia Amat-Lefort , Lifeng Han