English
Related papers

Related papers: Interpretable Semantic Textual Similarity: Finding…

200 papers

Sentence embedding is a significant research topic in the field of natural language processing (NLP). Generating sentence embedding vectors reflecting the intrinsic meaning of a sentence is a key factor to achieve an enhanced performance in…

Computation and Language · Computer Science 2019-01-17 Myeongjun Jang , Pilsung Kang

In order for machine learning to garner widespread public adoption, models must be able to provide interpretable and robust explanations for their decisions, as well as learn from human-provided explanations at train time. In this work, we…

Computation and Language · Computer Science 2018-12-07 Oana-Maria Camburu , Tim Rocktäschel , Thomas Lukasiewicz , Phil Blunsom

Measuring Sentence Textual Similarity (STS) is a classic task that can be applied to many downstream NLP applications such as text generation and retrieval. In this paper, we focus on unsupervised STS that works on various domains but only…

Computation and Language · Computer Science 2022-10-06 Zihao Wang , Jiaheng Dou , Yong Zhang

This paper describes a neural-network model which performed competitively (top 6) at the SemEval 2017 cross-lingual Semantic Textual Similarity (STS) task. Our system employs an attention-based recurrent neural network model that optimizes…

Computation and Language · Computer Science 2017-03-17 Wenli Zhuang , Ernie Chang

Learning to construct text representations in end-to-end systems can be difficult, as natural languages are highly compositional and task-specific annotated datasets are often limited in size. Methods for directly supervising language…

Computation and Language · Computer Science 2018-11-15 Marek Rei , Anders Søgaard

Interpretability provides a means for humans to verify aspects of machine learning (ML) models and empower human+ML teaming in situations where the task cannot be fully automated. Different contexts require explanations with different…

Machine Learning · Computer Science 2024-07-15 Zixi Chen , Varshini Subhash , Marton Havasi , Weiwei Pan , Finale Doshi-Velez

A semantic equivalence assessment is defined as a task that assesses semantic equivalence in a sentence pair by binary judgment (i.e., paraphrase identification) or grading (i.e., semantic textual similarity measurement). It constitutes a…

Computation and Language · Computer Science 2022-10-24 Yuki Arase , Junichi Tsujii

Recently, finetuning a pretrained language model to capture the similarity between sentence embeddings has shown the state-of-the-art performance on the semantic textual similarity (STS) task. However, the absence of an interpretation…

Artificial Intelligence · Computer Science 2022-04-15 Seonghyeon Lee , Dongha Lee , Seongbo Jang , Hwanjo Yu

This article presents a measure of semantic similarity in an IS-A taxonomy based on the notion of shared information content. Experimental evaluation against a benchmark set of human similarity judgments demonstrates that the measure…

Artificial Intelligence · Computer Science 2011-05-30 P. Resnik

Assessing the performance of interpreting services is a complex task, given the nuanced nature of spoken language translation, the strategies that interpreters apply, and the diverse expectations of users. The complexity of this task become…

Computation and Language · Computer Science 2024-06-17 Xiaoman Wang , Claudio Fantinuoli

Cross-lingual semantic textual similarity systems estimate the degree of the meaning similarity between two sentences, each in a different language. State-of-the-art algorithms usually employ machine translation and combine vast amount of…

Computation and Language · Computer Science 2018-07-12 Tomáš Brychcín

There are different ways to define similarity for grouping similar texts into clusters, as the concept of similarity may depend on the purpose of the task. For instance, in topic extraction similar texts mean those within the same semantic…

Computation and Language · Computer Science 2013-03-05 Diego R. Amancio , Osvaldo N. Oliveira , Luciano da F. Costa

Recent success in Artificial Intelligence (AI) and Machine Learning (ML) allow problem solving automatically without any human intervention. Autonomous approaches can be very convenient. However, in certain domains, e.g., in the medical…

Artificial Intelligence · Computer Science 2021-03-03 Andreas Holzinger , André Carrington , Heimo Müller

Recent developments in machine learning have introduced models that approach human performance at the cost of increased architectural complexity. Efforts to make the rationales behind the models' predictions transparent have inspired an…

Computation and Language · Computer Science 2020-09-29 Pepa Atanasova , Jakob Grue Simonsen , Christina Lioma , Isabelle Augenstein

Semantic similarity between natural language texts is typically measured either by looking at the overlap between subsequences (e.g., BLEU) or by using embeddings (e.g., BERTScore, S-BERT). Within this paper, we argue that when we are only…

Computation and Language · Computer Science 2024-01-18 Steffen Herbold

In this paper, we introduce the Financial-STS task, a financial domain-specific NLP task designed to measure the nuanced semantic similarity between pairs of financial narratives. These narratives originate from the financial statements of…

Computation and Language · Computer Science 2024-03-22 Jiaxin Liu , Yi Yang , Kar Yan Tam

In this article, we explore the potential of using sentence-level discourse structure for machine translation evaluation. We first design discourse-aware similarity measures, which use all-subtree kernels to compare discourse parse trees in…

Computation and Language · Computer Science 2017-10-05 Shafiq Joty , Francisco Guzmán , Lluís Màrquez , Preslav Nakov

The majority of research in computational psycholinguistics has concentrated on the processing of words. This study introduces innovative methods for computing sentence-level metrics using multilingual large language models. The metrics…

Computation and Language · Computer Science 2024-04-17 Kun Sun , Rong Wang

The visual representation of a pre-trained model prioritizes the classifiability on downstream tasks, while the widespread applications for pre-trained visual models have posed new requirements for representation interpretability. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Shufan Shen , Zhaobo Qi , Junshu Sun , Qingming Huang , Qi Tian , Shuhui Wang

Recent state-of-the-art authorship attribution methods learn authorship representations of texts in a latent, non-interpretable space, hindering their usability in real-world applications. Our work proposes a novel approach to interpreting…

Computation and Language · Computer Science 2024-09-12 Milad Alshomary , Narutatsu Ri , Marianna Apidianaki , Ajay Patel , Smaranda Muresan , Kathleen McKeown