English
Related papers

Related papers: Improving Pointwise Mutual Information (PMI) by In…

200 papers

The problem of how to properly quantify redundant information is an open question that has been the subject of much recent research. Redundant information refers to information about a target variable S that is common to two or more…

Information Theory · Computer Science 2017-07-14 Robin A. A. Ince

Measuring Mutual Information (MI) between high-dimensional, continuous, random variables from observed samples has wide theoretical and practical applications. Recent work, MINE (Belghazi et al. 2018), focused on estimating tight…

Machine Learning · Computer Science 2019-05-28 Xiao Lin , Indranil Sur , Samuel A. Nastase , Ajay Divakaran , Uri Hasson , Mohamed R. Amer

Event classification at sentence level is an important Information Extraction task with applications in several NLP, IR, and personalization systems. Multi-label binary relevance (BR) are the state-of-art methods. In this work, we explored…

Computation and Language · Computer Science 2014-03-26 Luís Marujo , Anatole Gershman , Jaime Carbonell , João P. Neto , David Martins de Matos

Across many data domains, co-occurrence statistics about the joint appearance of objects are powerfully informative. By transforming unsupervised learning problems into decompositions of co-occurrence statistics, spectral algorithms provide…

Computation and Language · Computer Science 2021-11-15 Moontae Lee , Sungjun Cho , Kun Dong , David Mimno , David Bindel

Feature extraction and description is an important topic of computer vision, as it is the starting point of a number of tasks such as image reconstruction, stitching, registration, and recognition among many others. In this paper, two new…

Computer Vision and Pattern Recognition · Computer Science 2020-05-15 Ali Khajegili Mirabadi , Stefano Rini

Estimating mutual information (MI) is a fundamental task in data science and machine learning. Existing estimators mainly rely on either highly flexible models (e.g., neural networks), which require large amounts of data, or overly…

Machine Learning · Computer Science 2025-10-27 Yanzhi Chen , Zijing Ou , Adrian Weller , Michael U. Gutmann

Cross-lingual topic models have been prevalent for cross-lingual text analysis by revealing aligned latent topics. However, most existing methods suffer from producing repetitive topics that hinder further analysis and performance decline…

Computation and Language · Computer Science 2024-03-28 Xiaobao Wu , Xinshuai Dong , Thong Nguyen , Chaoqun Liu , Liangming Pan , Anh Tuan Luu

Nowadays, according to the increasingly increasing information, the importance of its presentation is also increasing. The internet has become one of the main sources of information for users and their favorite topics. It also provides…

Information Retrieval · Computer Science 2020-04-27 Mohammad Moradi , Elham Ghanbari , Mehrdad Maeen , Sasan Harifi

We propose a novel estimator of the mutual information between two ordinal vectors $x$ and $y$. Our approach is inductive (as opposed to deductive) in that it depends on the data generating distribution solely through some nonparametric…

Machine Learning · Statistics 2022-04-12 Yves-Laurent Kom Samo

Mutual information is a widely-used information theoretic measure to quantify the amount of association between variables. It is used extensively in many applications such as image registration, diagnosis of failures in electrical machines,…

Computation · Statistics 2021-08-21 Luai Al-Labadi , Forough Fazeli-Asl , Zahra Saberi

Determining semantic similarity between academic documents is crucial to many tasks such as plagiarism detection, automatic technical survey and semantic search. Current studies mostly focus on semantic similarity between concepts,…

Computation and Language · Computer Science 2017-12-01 Ming Liu , Bo Lang , Zepeng Gu

This article proposes a new method to estimate an existing mutual information based dependence measure using histogram density estimates. Finding a suitable bin length for histogram is an open problem. We propose a new way of computing the…

Information Theory · Computer Science 2015-09-15 Namita Jain , C. A. Murthy

Frequent itemset mining has emerged as a fundamental problem in data mining and plays an important role in many data mining tasks, such as association analysis, classification, etc. In the framework of frequent itemset mining, the results…

Databases · Computer Science 2015-12-25 Zhi-Hong Deng

Propensity score matching (PSM) has been widely used to mitigate confounding in observational studies, although complications arise when the covariates used to estimate the PS are only partially observed. Multiple imputation (MI) is a…

Applications · Statistics 2021-07-22 Albee Y. Ling , Maria E. Montez-Rath , Maya B. Mathur , Kris Kapphahn , Manisha Desai

This paper shows that characterizing co-occurrence between events is an important but non-trivial and neglected aspect of discovering potential causal relationships in multimedia event streams. First an introduction to the notion of event…

Multimedia · Computer Science 2016-03-31 Laleh Jalali , Ramesh Jain

Re-ranking is a process of rearranging ranking list to more effectively meet user demands by accounting for the interrelationships between items. Existing methods predominantly enhance the precision of search results, often at the expense…

Information Retrieval · Computer Science 2024-05-27 Huimu Wang , Mingming Li , Dadong Miao , Songlin Wang , Guoyu Tang , Lin Liu , Sulong Xu , Jinghe Hu

Coherence is a linguistic term that refers to the relations between small textual units (sentences, propositions), which make the text logically consistent and meaningful to the reader. With the advances of generative foundational models in…

Computation and Language · Computer Science 2023-10-26 Aviya Maimon , Reut Tsarfaty

This paper presents a novel research problem on joint discovery of commonalities and differences between two individual documents (or document sets), called Comparative Document Analysis (CDA). Given any pair of documents from a document…

Information Retrieval · Computer Science 2015-10-27 Xiang Ren , Yuanhua Lv , Kuansan Wang , Jiawei Han

Purpose: The purpose of this paper is to investigate the impact of cooperative principle on the information quality (IQ) by making objects more relevant for consumer needs, in particular case Wikipedia articles for students.…

Computers and Society · Computer Science 2018-07-11 Miloš Fidler , Dejan Lavbič

Relational data augmentation is a powerful technique for enhancing data analytics and improving machine learning models by incorporating columns from external datasets. However, it is challenging to efficiently discover relevant external…

Databases · Computer Science 2025-03-06 Aécio Santos , Flip Korn , Juliana Freire