English
Related papers

Related papers: Shannon Entropy is better Feature than Category an…

200 papers

Modeling and prediction of review helpfulness has become more predominant due to proliferation of e-commerce websites and online shops. Since the functionality of a product cannot be tested before buying, people often rely on different…

Computation and Language · Computer Science 2020-04-29 Iyiola E. Olatunji , Xin Li , Wai Lam

The Shannon entropy, and related quantities such as mutual information, can be used to quantify uncertainty and relevance. However, in practice, it can be difficult to compute these quantities for arbitrary probability distributions,…

Computation · Statistics 2017-10-11 Brendon J. Brewer

Distributed systems, such as biological and artificial neural networks, process information via complex interactions engaging multiple subsystems, resulting in high-order patterns with distinct properties across scales. Investigating how…

Information Theory · Computer Science 2025-04-23 Aaron J. Gutknecht , Fernando E. Rosas , David A. Ehrlich , Abdullah Makkeh , Pedro A. M. Mediano , Michael Wibral

Wikipedia is a useful source of knowledge that has many applications in language processing and knowledge representation. The Wikipedia category graph can be compared with the class hierarchy in an ontology; it has some characteristics in…

Information Retrieval · Computer Science 2007-11-20 James A. Thom , Jovan Pehcevski , Anne-Marie Vercoustre

App store mining has proven to be a promising technique for requirements elicitation as companies can gain valuable knowledge to maintain and evolve existing apps. However, despite first advancements in using mining techniques for…

Software Engineering · Computer Science 2019-09-26 Tahira Iqbal , Norbert Seyff , Daniel Mendez Fernández

We have presented a new axiomatic derivation of Shannon Entropy for a discrete probability distribution on the basis of the postulates of additivity and concavity of the entropy function.We have then modified shannon entropy to take account…

Quantum Physics · Physics 2007-05-23 C. G. Chakrabarti , Indranil Chakrabarty

As recommendation is essentially a comparative (or ranking) process, a good explanation should illustrate to users why an item is believed to be better than another, i.e., comparative explanations about the recommended items. Ideally, after…

Information Retrieval · Computer Science 2022-04-26 Aobo Yang , Nan Wang , Renqin Cai , Hongbo Deng , Hongning Wang

Large language models (LLMs) have been garnering increasing attention in the recommendation community. Some studies have observed that LLMs, when fine-tuned by the cross-entropy (CE) loss with a full softmax, could achieve…

Information Retrieval · Computer Science 2024-08-27 Cong Xu , Zhangchi Zhu , Mo Yu , Jun Wang , Jianyong Wang , Wei Zhang

Rankings are ubiquitous in the online world today. As we have transitioned from finding books in libraries to ranking products, jobs, job applicants, opinions and potential romantic partners, there is a substantial precedent that ranking…

Information Retrieval · Computer Science 2018-10-18 Ashudeep Singh , Thorsten Joachims

The concept of Shannon Entropy for probability distributions and associated Maximum Entropy Principle are extended here to the concepts of Relative Divergence of one Grading Function from another and Maximum Relative Divergence Principle…

Optimization and Control · Mathematics 2023-03-28 Alexander Dukhovny

Rankings on online platforms help their end-users find the relevant information -- people, news, media, and products -- quickly. Fair ranking tasks, which ask to rank a set of items to maximize utility subject to satisfying group-fairness…

Computers and Society · Computer Science 2023-06-22 Sruthi Gorantla , Anay Mehrotra , Amit Deshpande , Anand Louis

The large size and complex decision mechanisms of state-of-the-art text classifiers make it difficult for humans to understand their predictions, leading to a potential lack of trust by the users. These issues have led to the adoption of…

The competing nature of the app market motivates us to shift our focus on apps that provide similar functionalities and directly compete with each other (i.e., peer apps). In this work, we study the ratings and the review text of 100…

Software Engineering · Computer Science 2022-04-11 Safwat Hassan , Heng Li , Ahmed E. Hassan

Most accurate predictions are typically obtained by learning machines with complex feature spaces (as e.g. induced by kernels). Unfortunately, such decision rules are hardly accessible to humans and cannot easily be used to gain insights…

Machine Learning · Statistics 2010-08-13 Alexander Zien , Nicole Kraemer , Soeren Sonnenburg , Gunnar Raetsch

Online learning to rank is a sequential decision-making problem where in each round the learning agent chooses a list of items and receives feedback in the form of clicks from the user. Many sample-efficient algorithms have been proposed…

Machine Learning · Statistics 2019-03-20 Tor Lattimore , Branislav Kveton , Shuai Li , Csaba Szepesvari

Writing review for a purchased item is a unique channel to express a user's opinion in E-Commerce. Recently, many deep learning based solutions have been proposed by exploiting user reviews for rating prediction. In contrast, there has been…

Information Retrieval · Computer Science 2019-07-02 Chenliang Li , Xichuan Niu , Xiangyang Luo , Zhenzhong Chen , Cong Quan

Nearly all practical neural models for classification are trained using cross-entropy loss. Yet this ubiquitous choice is supported by little theoretical or empirical evidence. Recent work (Hui & Belkin, 2020) suggests that training using…

Machine Learning · Computer Science 2023-02-09 Like Hui , Mikhail Belkin , Stephen Wright

Data partitioning that maximizes/minimizes the Shannon entropy, or more generally the R\'enyi entropy is a crucial subroutine in data compression, columnar storage, and cardinality estimation algorithms. These partition algorithms can be…

Data Structures and Algorithms · Computer Science 2025-11-05 Aryan Esmailpour , Sanjay Krishnan , Stavros Sintos

Graph neural networks (GNNs) extend convolutional neural networks (CNNs) to graph-based data. A question that arises is how much performance improvement does the underlying graph structure in the GNN provide over the CNN (that ignores this…

Machine Learning · Computer Science 2020-12-17 Lavender Yao Jiang , John Shi , Mark Cheung , Oren Wright , José M. F. Moura

Assessors make preference judgments faster and more consistently than graded judgments. Preference judgments can also recognize distinctions between items that appear equivalent under graded judgments. Unfortunately, preference judgments…

Information Retrieval · Computer Science 2021-02-15 Charles L. A. Clarke , Alexandra Vtyurina , Mark D. Smucker