English
Related papers

Related papers: Methods for Quantifying Dataset Similarity: a Revi…

200 papers

Although the notion of task similarity is potentially interesting in a wide range of areas such as curriculum learning or automated planning, it has mostly been tied to transfer learning. Transfer is based on the idea of reusing the…

Machine Learning · Computer Science 2021-03-09 Álvaro Visús , Javier García , Fernando Fernández

Quantification represents the problem of estimating the distribution of class labels on unseen data. It also represents a growing research field in supervised machine learning, for which a large variety of different algorithms has been…

Machine Learning · Computer Science 2025-04-17 Tobias Schumacher , Markus Strohmaier , Florian Lemmerich

We introduce a conceptually simple and effective method to quantify the similarity between relations in knowledge bases. Specifically, our approach is based on the divergence between the conditional probability distributions over entity…

Artificial Intelligence · Computer Science 2019-07-23 Weize Chen , Hao Zhu , Xu Han , Zhiyuan Liu , Maosong Sun

The Web today has millions of datasets, and the number of datasets continues to grow at a rapid pace. These datasets are not standalone entities; rather, they are intricately connected through complex relationships. Semantic relationships…

Information Retrieval · Computer Science 2024-08-28 Kate Lin , Tarfah Alrashed , Natasha Noy

Synthesizing relational data has started to receive more attention from researchers, practitioners, and industry. The task is more difficult than synthesizing a single table due to the added complexity of relationships between tables. For…

Databases · Computer Science 2024-10-07 Valter Hudovernik , Martin Jurkovič , Erik Štrumbelj

In this paper, we propose an innovative approach to thoroughly explore dataset features that introduce bias in downstream machine-learning tasks. Depending on the data format, we use different techniques to map instances into a similarity…

Machine Learning · Computer Science 2024-11-11 Samira Maghool , Paolo Ceravolo

The rapid development of such natural language processing tasks as style transfer, paraphrase, and machine translation often calls for the use of semantic similarity metrics. In recent years a lot of methods to measure the semantic…

Computation and Language · Computer Science 2022-11-15 Ivan P. Yamshchikov , Viacheslav Shibaev , Nikolay Khlebnikov , Alexey Tikhonov

Measuring the similarity of short written contexts is a fundamental problem in Natural Language Processing. This article provides a unifying framework by which short context problems can be categorized both by their intended application and…

Computation and Language · Computer Science 2010-10-19 Ted Pedersen

The Jaccard similarity index has often been employed in science and technology as a means to quantify the similarity between two sets. When modified to operate on real-valued values, the Jaccard similarity index can be applied to compare…

Data Analysis, Statistics and Probability · Physics 2024-10-23 Gonzalo Travieso , Alexandre Benatti , Luciano da F. Costa

Deep learning image classifiers usually rely on huge training sets and their training process can be described as learning the similarities and differences among training images. But, images in large training sets are not usually studied…

Image and Video Processing · Electrical Eng. & Systems 2020-05-19 Roozbeh Yousefzadeh

Similarity-based method gives rise to a new class of methods for multi-label learning and also achieves promising performance. In this paper, we generalize this method, resulting in a new framework for classification task. Specifically, we…

Machine Learning · Computer Science 2022-03-08 Zhongchen Ma , Songcan Chen

Similarity functions measure how comparable pairs of elements are, and play a key role in a wide variety of applications, e.g., notions of Individual Fairness abiding by the seminal paradigm of Dwork et al., as well as Clustering problems.…

Machine Learning · Computer Science 2023-10-24 Leonidas Tsepenekas , Ivan Brugere , Freddy Lecue , Daniele Magazzeni

Federated Learning is increasingly used in domains such as healthcare to facilitate collaborative model training without data-sharing. However, datasets located in different sites are often non-identically distributed, leading to…

Machine Learning · Computer Science 2025-10-08 Ahmed Elhussein , Gamze Gursoy

We provide a definition for class density that can be used to measure the aggregate similarity of the samples within each of the classes in a high-dimensional, unstructured dataset. We then put forth several candidate methods for…

Machine Learning · Computer Science 2022-02-09 Adam Byerly , Tatiana Kalganova

In many applications involving multi-media data, the definition of similarity between items is integral to several key tasks, e.g., nearest-neighbor retrieval, classification, and recommendation. Data in such regimes typically exhibits…

Artificial Intelligence · Computer Science 2010-09-01 Brian McFee , Gert Lanckriet

In this paper, we address the problem of searching for semantically similar images from a large database. We present a compact coding approach, supervised quantization. Our approach simultaneously learns feature selection that linearly…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Xiaojuan Wang , Ting Zhang , Guo-Jun Q , Jinhui Tang , Jingdong Wang

Nine popular clustering methods are applied to 42 real data sets. The aim is to give a detailed characterisation of the methods by means of several cluster validation indexes that measure various individual aspects of the resulting clusters…

Methodology · Statistics 2021-02-09 Christian Hennig

The notion of task similarity is at the core of various machine learning paradigms, such as domain adaptation and meta-learning. Current methods to quantify it are often heuristic, make strong assumptions on the label sets across the tasks,…

Machine Learning · Computer Science 2020-02-10 David Alvarez-Melis , Nicolò Fusi

Dataset summarisation is a fruitful approach to dataset inspection. However, when applied to a single dataset the discovery of visual concepts is restricted to those most prominent. We argue that a comparative approach can expand upon this…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Nanne van Noord

In recent years, semantic similarity measure has a great interest in Semantic Web and Natural Language Processing (NLP). Several similarity measures have been developed, being given the existence of a structured knowledge representation…

Computation and Language · Computer Science 2013-10-31 Thabet Slimani