English
Related papers

Related papers: Using Information Content to Evaluate Semantic Sim…

200 papers

Cosine similarity has become a standard metric for comparing embeddings in modern machine learning. Its scale-invariance and alignment with model training objectives have contributed to its widespread adoption. However, recent studies have…

Machine Learning · Computer Science 2025-05-21 Kisung You

We define a notion of information that an individual sample provides to the training of a neural network, and we specialize it to measure both how much a sample informs the final weights and how much it informs the function computed by the…

The modern geographic information retrieval technology is based on quantitative models and methods. The semantic information in web documents and queries cannot be effectively represented, leading to information lost or misunderstanding so…

Information Retrieval · Computer Science 2013-11-20 Yong Gao , Lei Liu , Xing Lin , Yu Liu

Recognizing semantically similar sentences or paragraphs across languages is beneficial for many tasks, ranging from cross-lingual information retrieval and plagiarism detection to machine translation. Recently proposed methods for…

Computation and Language · Computer Science 2018-01-22 Goran Glavaš , Marc Franco-Salvador , Simone Paolo Ponzetto , Paolo Rosso

Semantic communication initiates a new direction for future communication. In this paper, we aim to establish a systematic framework of semantic information theory (SIT). First, we propose a semantic communication model and define the…

Information Theory · Computer Science 2024-01-26 Kai Niu , Ping Zhang

Systematically discovering semantic relationships in text is an important and extensively studied area in Natural Language Processing, with various tasks such as entailment, semantic similarity, etc. Decomposability of sentence-level scores…

Computation and Language · Computer Science 2020-07-16 Subhadeep Maji , Rohan Kumar , Manish Bansal , Kalyani Roy , Pawan Goyal

Capturing the similarities between human language units is crucial for explaining how humans associate different objects, and therefore its computation has received extensive attention, research, and applications. With the ever-increasing…

Computation and Language · Computer Science 2025-09-04 Wenchuan Mu

One major problem in Natural Language Processing is the automatic analysis and representation of human language. Human language is ambiguous and deeper understanding of semantics and creating human-to-machine interaction have required an…

Computation and Language · Computer Science 2022-06-01 Neslihan Suzen , Alexander N. Gorban , Jeremy Levesley , Evgeny M. Mirkes

A large body of research into semantic textual similarity has focused on constructing state-of-the-art embeddings using sophisticated modelling, careful choice of learning signals and many clever tricks. By contrast, little attention has…

Computation and Language · Computer Science 2019-05-21 Vitalii Zhelezniak , Aleksandar Savkov , April Shen , Nils Y. Hammerla

Document similarity is the problem of estimating the degree to which a given pair of documents has similar semantic content. An accurate document similarity measure can improve several enterprise relevant tasks such as document clustering,…

Computation and Language · Computer Science 2017-11-15 Gaurav Maheshwari , Priyansh Trivedi , Harshita Sahijwani , Kunal Jha , Sourish Dasgupta , Jens Lehmann

Not identical but similar objects are ubiquitous in our world, ranging from four-legged animals such as dogs and cats to cars of different models and flowers of various colors. This study addresses a novel task of matching such…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yusuke Marumo , Kazuhiko Kawamoto , Satomi Tanaka , Shigenobu Hirano , Hiroshi Kera

We introduce a novel metric for measuring semantic continuity in Explainable AI methods and machine learning models. We posit that for models to be truly interpretable and trustworthy, similar inputs should yield similar explanations,…

Artificial Intelligence · Computer Science 2025-01-31 Qi Huang , Emanuele Mezzi , Osman Mutlu , Miltiadis Kofinas , Vidya Prasad , Shadnan Azwad Khan , Elena Ranguelova , Niki van Stein

The rapid development of such natural language processing tasks as style transfer, paraphrase, and machine translation often calls for the use of semantic similarity metrics. In recent years a lot of methods to measure the semantic…

Computation and Language · Computer Science 2022-11-15 Ivan P. Yamshchikov , Viacheslav Shibaev , Nikolay Khlebnikov , Alexey Tikhonov

Information exchange among many sources in Internet is more autonomous, dynamic and free. The situation drive difference view of concepts among sources. For example, word 'bank' has meaning as economic institution for economy domain, but…

Information Retrieval · Computer Science 2011-05-10 I Wayan Simri Wicaksana , Bambang Wahyudi

The ability to mimic human notions of semantic distance has widespread applications. Some measures rely only on raw text (distributional measures) and some rely on knowledge sources such as WordNet. Although extensive studies have been…

Computation and Language · Computer Science 2012-03-09 Saif M. Mohammad , Graeme Hirst

One of the main problems that emerges in the classic approach to semantics is the difficulty in acquisition and maintenance of ontologies and semantic annotations. On the other hand, the Internet explosion and the massive diffusion of…

Artificial Intelligence · Computer Science 2017-01-12 Valentina Franzoni

Machine Translation (MT) Quality Estimation (QE) assesses translation reliability without reference texts. This study introduces "textual similarity" as a new metric for QE, using sentence transformers and cosine similarity to measure…

Computation and Language · Computer Science 2024-07-02 Kun Sun , Rong Wang

We present some variations affecting the association measure and thresholding on a technique for learning Selectional Restrictions from on-line corpora. It uses a wide-coverage noun taxonomy and a statistical measure to generalize the…

cmp-lg · Computer Science 2016-08-31 Francesc Ribas

The increasing amount of available Linked Data resources is laying the foundations for more advanced Semantic Web applications. One of their main limitations, however, remains the general low level of data quality. In this paper we focus on…

Artificial Intelligence · Computer Science 2016-03-08 Paolo Pareti , Ewan Klein , Adam Barker

Human creativity generates novel ideas to solve real-world problems. This thereby grants us the power to transform the surrounding world and extend our human attributes beyond what is currently possible. Creative ideas are not just new and…

Computation and Language · Computer Science 2021-06-21 Georgi V. Georgiev , Danko D. Georgiev