English
Related papers

Related papers: reval: a Python package to determine best clusteri…

200 papers

Partial label learning is a type of weakly supervised learning, where each training instance corresponds to a set of candidate labels, among which only one is true. In this paper, we introduce ProPaLL, a novel probabilistic approach to this…

Machine Learning · Computer Science 2022-08-23 Łukasz Struski , Jacek Tabor , Bartosz Zieliński

We address the problem of cluster identity estimation in a personalized federated learning (PFL) setting in which users aim to learn different personal models. The backbone of effective learning in such a setting is to cluster users into…

Machine Learning · Computer Science 2025-03-26 Abdulmoneam Ali , Ahmed Arafa

A key issue in cluster analysis is the choice of an appropriate clustering method and the determination of the best number of clusters. Different clusterings are optimal on the same data set according to different criteria, and the choice…

Methodology · Statistics 2020-06-24 Serhat Emre Akhanli , Christian Hennig

The identification of groups' prototypes, i.e. elements of a dataset that represent different groups of data points, may be relevant to the tasks of clustering, classification and mixture modeling. The R package pivmet presented in this…

Computation · Statistics 2021-04-01 Leonardo Egidi , Roberta Pappadà , Francesco Pauli , Nicola Torelli

Both in the domains of Feature Selection and Interpretable AI, there exists a desire to `rank' features based on their importance. Such feature importance rankings can then be used to either: (1) reduce the dataset size or (2) interpret the…

Machine Learning · Computer Science 2022-07-12 Jeroen G. S. Overschie

Sample quantiles, such as the median, are often better suited than the sample mean for summarising location characteristics of a data set. Similarly, linear combinations of sample quantiles and ratios of such linear combinations, e.g. the…

Methodology · Statistics 2024-10-16 Luke A. Prendergast , Shenal Dedduwakumara , Robert G. Staudte

In this paper, we present a new R package COREclust dedicated to the detection of representative variables in high dimensional spaces with a potentially limited number of observations. Variable sets detection is based on an original graph…

Mathematical Software · Computer Science 2018-05-28 Camille Champion , Anne-Claire Brunet , Jean-Michel Loubes , Laurent Risser

Partial label learning (PLL) is a significant weakly supervised learning framework, where each training example corresponds to a set of candidate labels and only one label is the ground-truth label. For the first time, this paper…

Machine Learning · Computer Science 2025-05-07 Yutong Xie , Fuchao Yang , Yuheng Jia

Classical inference methods notoriously fail when applied to data-driven test hypotheses or inference targets. Instead, dedicated methodologies are required to obtain statistical guarantees for these selective inference problems. Selective…

Methodology · Statistics 2025-11-11 François Bachoc , Cathy Maugis-Rabusseau , Pierre Neuvial

Improving data utilization efficiency is critical for scaling reinforcement learning (RL) for long-horizon tasks where generating trajectories is expensive. However, the dominant RL methods for LLMs are largely on-policy: they update each…

A recent developing trend in clustering is the advancement of algorithms that not only identify clusters within data, but also express and capture the uncertainty of cluster membership. Evidential clustering addresses this by using the…

Software Engineering · Computer Science 2025-02-11 Armel Soubeiga , Violaine Antoine

Due to their flexibility and superior performance, machine learning models frequently complement and outperform traditional statistical survival models. However, their widespread adoption is hindered by a lack of user-friendly tools to…

When probability predictions are too cautious for decision making, boldness-recalibration enables responsible emboldening while maintaining the probability of calibration required by the user. We formulate boldness-recalibration as a…

Methodology · Statistics 2025-07-21 Adeline P. Guthrie , Christopher T. Franck

partycls is a Python framework for cluster analysis of systems of interacting particles. By grouping particles that share similar structural or dynamical properties, partycls enables rapid and unsupervised exploration of the system's…

Computational Physics · Physics 2021-11-22 Joris Paret , Daniele Coslovich

Unsupervised image clustering methods often introduce alternative objectives to indirectly train the model and are subject to faulty predictions and overconfident results. To overcome these challenges, the current research proposes an…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sungwon Park , Sungwon Han , Sundong Kim , Danu Kim , Sungkyu Park , Seunghoon Hong , Meeyoung Cha

We address the problem of validating the ouput of clustering algorithms. Given data $\mathcal{D}$ and a partition $\mathcal{C}$ of these data into $K$ clusters, when can we say that the clusters obtained are correct or meaningful for the…

Machine Learning · Statistics 2023-02-02 Marina Meilă , Hanyu Zhang

A vast number of different methods are available for unsupervised classification. Since no algorithm and parameter setting performs best in all types of data, there is a need for cluster validation to select the actually best-performing…

Machine Learning · Computer Science 2023-08-09 Zoltán Botta-Dukát

As the data size in Machine Learning fields grows exponentially, it is inevitable to accelerate the computation by utilizing the ever-growing large number of available cores provided by high-performance computing hardware. However, existing…

Machine Learning · Computer Science 2021-04-23 Kun Li , Liang Yuan , Yunquan Zhang , Gongwei Chen

Data clustering involves identifying latent similarities within a dataset and organizing them into clusters or groups. The outcomes of various clustering algorithms differ as they are susceptible to the intrinsic characteristics of the…

Machine Learning · Computer Science 2024-07-31 Bryar A. Hassan , Noor Bahjat Tayfor , Alla A. Hassan , Aram M. Ahmed , Tarik A. Rashid , Naz N. Abdalla

Checking data quality against domain knowledge is a common activity that pervades statistical analysis from raw data to output. The R package 'validate' facilitates this task by capturing and applying expert knowledge in the form of…

Computation · Statistics 2021-04-01 Mark P. J. van der Loo , Edwin de Jonge