English
Related papers

Related papers: An improved semantic similarity measure for docume…

200 papers

Assessing the degree of semantic relatedness between words is an important task with a variety of semantic applications, such as ontology learning for the Semantic Web, semantic search or query expansion. To accomplish this in an automated…

Computation and Language · Computer Science 2017-05-25 Thomas Niebler , Martin Becker , Christian Pölitz , Andreas Hotho

Similarity is a comparative-subjective measure that varies with the domain within which it is considered. In several NLP applications such as document classification, pattern recognition, chatbot question-answering, sentiment analysis,…

Machine Learning · Computer Science 2021-11-11 Manuela Nayantara Jeyaraj , Dharshana Kasthurirathna

We present a novel model for the problem of ranking a collection of documents according to their semantic similarity to a source (query) document. While the problem of document-to-document similarity ranking has been studied, most modern…

Computation and Language · Computer Science 2021-12-15 Dvir Ginzburg , Itzik Malkiel , Oren Barkan , Avi Caciularu , Noam Koenigstein

This paper presents a procedure for and evaluation of using a semantic similarity metric as a loss function for neural source code summarization. Code summarization is the task of writing natural language descriptions of source code. Neural…

Software Engineering · Computer Science 2024-06-13 Chia-Yi Su , Collin McMillan

We propose in this paper a new, hybrid document embedding approach in order to address the problem of document similarities with respect to the technical content. To do so, we employ a state-of-the-art graph techniques to first extract the…

Computation and Language · Computer Science 2019-07-02 Hamid Mirisaee , Eric Gaussier , Cedric Lagnier , Agnes Guerraz

Embedding-based similarity metrics between text sequences can be influenced not just by the content dimensions we most care about, but can also be biased by spurious attributes like the text's source or language. These document confounders…

Computation and Language · Computer Science 2025-09-25 Yu Fan , Yang Tian , Shauli Ravfogel , Mrinmaya Sachan , Elliott Ash , Alexander Hoyle

Word embedding maps words into a low-dimensional continuous embedding space by exploiting the local word collocation patterns in a small context window. On the other hand, topic modeling maps documents onto a low-dimensional topic space, by…

Computation and Language · Computer Science 2016-08-09 Shaohua Li , Tat-Seng Chua , Jun Zhu , Chunyan Miao

Modelling semantic similarity plays a fundamental role in lexical semantic applications. A natural way of calculating semantic similarity is to access handcrafted semantic networks, but similarity prediction can also be anticipated in a…

Computation and Language · Computer Science 2022-10-03 Dongqiang Yang , Yanqin Yin

Querying over XML elements using keyword search is steadily gaining popularity. The traditional similarity measure is widely employed in order to effectively retrieve various XML documents. A number of authors have already proposed…

Information Retrieval · Computer Science 2010-12-20 Yang Wang , Zhikui Chen , Xiaodi Huang

Manually determining concepts present in a group of questions is a challenging and time-consuming process. However, the process is an essential step while modeling a virtual learning environment since a mapping between concepts and…

Machine Learning · Computer Science 2021-04-23 Laura O. Moraes , Carlos Eduardo Pedreira

Topic models provide a useful tool to organize and understand the structure of large corpora of text documents, in particular, to discover hidden thematic structure. Clustering documents from big unstructured corpora into topics is an…

Statistics Theory · Mathematics 2021-07-09 Olga Klopp , Maxim Panov , Suzanne Sigalla , Alexandre Tsybakov

The inclusion of semantic information in any similarity measures improves the efficiency of the similarity measure and provides human interpretable results for further analysis. The similarity calculation method that focuses on features…

Information Retrieval · Computer Science 2019-11-01 Pinky Sitikhu , Kritish Pahi , Pujan Thapa , Subarna Shakya

The paper introduces a new method for discrimination of documents given in different scripts. The document is mapped into a uniformly coded text of numerical values. It is derived from the position of the letters in the text line, based on…

Computer Vision and Pattern Recognition · Computer Science 2016-09-22 Darko Brodic , Alessia Amelio , Zoran N. Milivojevic , Milena Jevtic

Traditional document similarity measures provide a coarse-grained distinction between similar and dissimilar documents. Typically, they do not consider in what aspects two documents are similar. This limits the granularity of applications…

Computation and Language · Computer Science 2020-10-14 Malte Ostendorff , Terry Ruas , Till Blume , Bela Gipp , Georg Rehm

This paper presents a novel research problem on joint discovery of commonalities and differences between two individual documents (or document sets), called Comparative Document Analysis (CDA). Given any pair of documents from a document…

Information Retrieval · Computer Science 2015-10-27 Xiang Ren , Yuanhua Lv , Kuansan Wang , Jiawei Han

The rapid development of such natural language processing tasks as style transfer, paraphrase, and machine translation often calls for the use of semantic similarity metrics. In recent years a lot of methods to measure the semantic…

Computation and Language · Computer Science 2022-11-15 Ivan P. Yamshchikov , Viacheslav Shibaev , Nikolay Khlebnikov , Alexey Tikhonov

Businesses, governmental bodies and NGO's have an ever-increasing amount of data at their disposal from which they try to extract valuable information. Often, this needs to be done not only accurately but also within a short time frame.…

Machine Learning · Computer Science 2021-09-16 Pim Verschuuren , Serena Palazzo , Tom Powell , Steve Sutton , Alfred Pilgrim , Michele Faucci Giannelli

The computation of relatedness between two fragments of text in an automated manner requires taking into account a wide range of factors pertaining to the meaning the two fragments convey, and the pairwise relations between their words.…

Computation and Language · Computer Science 2014-01-23 George Tsatsaronis , Iraklis Varlamis , Michalis Vazirgiannis

Automatic measurement of semantic text similarity is an important task in natural language processing. In this paper, we evaluate the performance of different vector space models to perform this task. We address the real-world problem of…

Computation and Language · Computer Science 2018-10-02 Omid Shahmirzadi , Adam Lugowski , Kenneth Younge

Vector comparison in high dimensions is a fundamental task in NLP, yet it is dominated by two baselines: the raw dot product, which is unbounded and sensitive to vector norms, and the cosine similarity, which discards magnitude information…

Computation and Language · Computer Science 2025-09-25 V. S. Raghu Parupudi