English
Related papers

Related papers: Understanding partition comparison indices based o…

200 papers

Many complex networks show signs of modular structure, uncovered by community detection. Although many methods succeed in revealing various partitions, it remains difficult to detect at what scale some partition is significant. This problem…

Physics and Society · Physics 2013-10-15 V. A. Traag , G. Krings , P. Van Dooren

Efficient indexing is fundamental for multi-dimensional data management and analytics. An emerging tendency is to directly learn the storage layout of multi-dimensional data by simple machine learning models, yielding the concept of Learned…

Databases · Computer Science 2024-05-10 Qiyu Liu , Maocheng Li , Yuxiang Zeng , Yanyan Shen , Lei Chen

Alongside consistency, completeness of information is one of the key factors influencing data quality. The objective of this paper is to define ways of treating missing entries in pairwise comparisons (PC) method with respect to…

Discrete Mathematics · Computer Science 2019-11-25 Konrad Kułakowski , Anna Prusak , Jacek Szybowski

The ratio between the probability that two distributions $R$ and $P$ give to points $x$ are known as importance weights or propensity scores and play a fundamental role in many different fields, most notably, statistics and machine…

Machine Learning · Computer Science 2021-03-11 Parikshit Gopalan , Omer Reingold , Vatsal Sharan , Udi Wieder

Images can be segmented by first using a classifier to predict an affinity graph that reflects the degree to which image pixels must be grouped together and then partitioning the graph to yield a segmentation. Machine learning has been…

Computer Vision and Pattern Recognition · Computer Science 2009-12-01 Srinivas C. Turaga , Kevin L. Briggman , Moritz Helmstaedter , Winfried Denk , H. Sebastian Seung

Given a set of pairwise comparisons, the classical ranking problem computes a single ranking that best represents the preferences of all users. In this paper, we study the problem of inferring individual preferences, arising in the context…

Machine Learning · Statistics 2015-12-18 Rui Wu , Jiaming Xu , R. Srikant , Laurent Massoulié , Marc Lelarge , Bruce Hajek

Imbalance in classification tasks is commonly quantified by the cardinalities of examples across classes. This, however, disregards the presence of redundant examples and inherent differences in the learning difficulties of classes.…

Machine Learning · Computer Science 2026-01-22 Çağrı Eser , Zeynep Sonat Baltacı , Emre Akbaş , Sinan Kalkan

We consider the problem of learning an unknown partition of an $n$ element universe using rank queries. Such queries take as input a subset of the universe and return the number of parts of the partition it intersects. We give a simple…

Data Structures and Algorithms · Computer Science 2024-09-23 Deeparnab Chakrabarty , Hang Liao

A good deal of science and technology concepts and methods rely on comparing and relating entities in quantitative terms. Among the several possible approaches, similarity indices allow some interesting features, especially the ability to…

Physics and Society · Physics 2024-10-24 Alexandre Benatti , Luciano da F. Costa

We study the problem of learning to partition users into groups, where one must learn the compatibilities between the users to achieve optimal groupings. We define four natural objectives that optimize for average and worst case…

Machine Learning · Computer Science 2017-03-24 Arun Rajkumar , Koyel Mukherjee , Theja Tulabandhula

Community detection methods attempt to divide a network into groups of nodes that share similar properties, thus revealing its large-scale structure. A major challenge when employing such methods is that they are often degenerate, typically…

Physics and Society · Physics 2021-04-23 Tiago P. Peixoto

The question of aggregating pair-wise comparisons to obtain a global ranking over a collection of objects has been of interest for a very long time: be it ranking of online gamers (e.g. MSR's TrueSkill system) and chess players, aggregating…

Machine Learning · Computer Science 2015-11-13 Sahand Negahban , Sewoong Oh , Devavrat Shah

Rankings, representing preferences over a set of candidates, are widely used in many information systems, e.g., group decision making and information retrieval. It is of great importance to evaluate the consensus of the obtained rankings…

Artificial Intelligence · Computer Science 2019-07-29 Zhengui Xue , Zhiwei Lin , Hui Wang , Sally McClean

A new cluster validity index is proposed for fuzzy clusters obtained from fuzzy c-means algorithm. The proposed validity index exploits inter-cluster proximity between fuzzy clusters. Inter-cluster proximity is used to measure the degree of…

Artificial Intelligence · Computer Science 2024-07-10 Dae-Won Kim , Kwang H. Lee

In a standard cluster analysis, such as k-means, in addition to clusters locations and distances between them, it's important to know if they are connected or well separated from each other. The main focus of this paper is discovering the…

Machine Learning · Statistics 2017-05-22 Evgeny Bauman , Konstantin Bauman

Robust validation of Machine Learning (ML) models is essential, but traditional data partitioning approaches often ignore the intrinsic quality of each instance. This study proposes the use of Item Response Theory (IRT) parameters to…

Machine Learning · Computer Science 2025-08-15 Lucas Cardoso , Vitor Santos , José Ribeiro Filho , Ricardo Prudêncio , Regiane Kawasaki , Ronnie Alves

Graded labels are ubiquitous in real-world learning-to-rank applications, especially in human rated relevance data. Traditional learning-to-rank techniques aim to optimize the ranked order of documents. They typically, however, ignore…

Information Retrieval · Computer Science 2023-06-21 Le Yan , Zhen Qin , Gil Shamir , Dong Lin , Xuanhui Wang , Mike Bendersky

Deep clustering, a method for partitioning complex, high-dimensional data using deep neural networks, presents unique evaluation challenges. Traditional clustering validation measures, designed for low-dimensional spaces, are problematic…

Machine Learning · Statistics 2024-03-25 Zeya Wang , Chenglong Ye

Network clustering requires making many decisions manually, such as the number of groups and a statistical model to be used. Even after filtering using an information criterion or regularizing with a nonparametric framework, we are commonly…

Social and Information Networks · Computer Science 2019-06-05 Chihiro Noguchi , Tatsuro Kawamoto

A first step when fitting multilevel models to continuous responses is to explore the degree of clustering in the data. Researchers fit variance-component models and then report the proportion of variation in the response that is due to…

Methodology · Statistics 2020-02-17 George Leckie , William Browne , Harvey Goldstein , Juan Merlo , Peter Austin