English
Related papers

Related papers: Clubmark: a Parallel Isolation Framework for Bench…

200 papers

Jailbreak attacks designed to bypass safety mechanisms pose a serious threat by prompting LLMs to generate harmful or inappropriate content, despite alignment with ethical guidelines. Crafting universal filtering rules remains difficult due…

Cryptography and Security · Computer Science 2025-12-01 Lama Sleem , Jerome Francois , Lujun Li , Nathan Foucher , Niccolo Gentile , Radu State

Large Language Models (LLMs) hold immense potential for revolutionizing Customer Experience Management (CXM), particularly in contact center operations. However, evaluating their practical utility in complex operational environments is…

Machine Learning · Computer Science 2025-05-20 Raghav Garg , Kapil Sharma , Karan Gupta

As quantum computing systems continue to mature, there is an increasing need for benchmarking methodologies that capture performance in terms of meaningful, application-level metrics. In this work, we present a scalable framework for…

Despite the ubiquity of kernel-based clustering, surprisingly few statistical guarantees exist beyond settings that consider strong structural assumptions on the data generation process. In this work, we take a step towards bridging this…

Machine Learning · Computer Science 2021-10-19 Leena Chennuru Vankadara , Sebastian Bordt , Ulrike von Luxburg , Debarghya Ghoshdastidar

Clustering techniques are often validated using benchmark datasets where class labels are used as ground-truth clusters. However, depending on the datasets, class labels may not align with the actual data clusters, and such misalignment…

Machine Learning · Computer Science 2025-03-04 Hyeon Jeon , Michaël Aupetit , DongHwa Shin , Aeri Cho , Seokhyeon Park , Jinwook Seo

Clustering algorithms aim to organize data into groups or clusters based on the inherent patterns and similarities within the data. They play an important role in today's life, such as in marketing and e-commerce, healthcare, data…

Machine Learning · Computer Science 2024-01-17 Hui Yin , Amir Aryani , Stephen Petrie , Aishwarya Nambissan , Aland Astudillo , Shengyuan Cao

The superior spectral efficiency (SE) and user fairness feature of non-orthogonal multiple access (NOMA) systems are achieved by exploiting user clustering (UC) more efficiently. However, a random UC certainly results in a suboptimal…

Signal Processing · Electrical Eng. & Systems 2020-11-17 Quang Nhat Le , Van-Dinh Nguyen , Nam-Phong Nguyen , Symeon Chatzinotas , Octavia A. Dobre , Ruiqin Zhao

Benchmarking has long served as a foundational practice in machine learning and, increasingly, in modern AI systems such as large language models, where shared tasks, metrics, and leaderboards offer a common basis for measuring progress and…

Artificial Intelligence · Computer Science 2026-02-16 Philip Waggoner

Clustering mixed-type data remains a major challenge in biomedical research to uncover clinically meaningful subgroups within heterogeneous patient populations. Most existing clustering methods impose restrictive assumptions like local…

Applications · Statistics 2026-04-23 Yueting Wang , Shu Wang , Jonathan G. Yabes , Chung-Chou H. Chang

Reranking is a critical component in recommender systems, playing an essential role in refining the output of recommendation algorithms. Traditional reranking models have focused predominantly on accuracy, but modern applications demand…

Information Retrieval · Computer Science 2025-02-04 Jingtong Gao , Bo Chen , Weiwen Liu , Xiangyang Li , Yichao Wang , Wanyu Wang , Huifeng Guo , Ruiming Tang , Xiangyu Zhao

Clustering is a fundamental tool in unsupervised learning, used to group objects by distinguishing between similar and dissimilar features of a given data set. One of the most common clustering algorithms is k-means. Unfortunately, when…

Machine Learning · Statistics 2021-08-17 Olga Dorabiala , J. Nathan Kutz , Aleksandr Aravkin

Spectral clustering is a popular method for community detection in network graphs: starting from a matrix representation of the graph, the nodes are clustered on a low dimensional projection obtained from a truncated spectral decomposition…

Machine Learning · Statistics 2022-08-10 Francesco Sanna Passino , Nicholas A. Heard , Patrick Rubin-Delanchy

Detecting communities in networks and graphs is an important task across many disciplines such as statistics, social science and engineering. There are generally three different kinds of mixing patterns for the case of two communities:…

Methodology · Statistics 2023-10-10 Xiancheng Lin , Hao Chen

Benchmarking in cloud environments suffers from performance variability from multi-tenant resource contention. Duet benchmarking mitigates this by running two workload versions concurrently on the same VM, exposing them to identical…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-06 Nils Japke , Furat Hamdan , Diana Baumann , David Bermbach

The ability to transfer coherent quantum information between systems is a fundamental component of quantum technologies and leads to coherent correlations within the global quantum process. However correlation structures in quantum channels…

Quantum Physics · Physics 2022-05-03 Matthew Girling , Cristina Cirstoiu , David Jennings

Financial institutions have massive computations to carry out overnight which are very demanding in terms of the consumed CPU. The challenge is to price many different products on a cluster-like architecture. We have used the Premia…

Computational Engineering, Finance, and Science · Computer Science 2012-05-23 Jean-Philippe Chancelier , Jérôme Lelong , Bernard Lapeyre

Entity resolution (record linkage, microclustering) systems are notoriously difficult to evaluate. Looking for a needle in a haystack, traditional evaluation methods use sophisticated, application-specific sampling schemes to find matching…

Computation and Language · Computer Science 2024-04-09 Olivier Binette , Youngsoo Baek , Siddharth Engineer , Christina Jones , Abel Dasylva , Jerome P. Reiter

Given its ability to analyse stochastic models ranging from discrete and continuous-time Markov chains to Markov decision processes and stochastic games, probabilistic model checking (PMC) is widely used to verify system dependability and…

Logic in Computer Science · Computer Science 2025-03-26 Radu Calinescu , Sinem Getir Yaman , Simos Gerasimou , Gricel Vázquez , Micah Bassett

The goal of fair clustering is to find clusters such that the proportion of sensitive attributes (e.g., gender, race, etc.) in each cluster is similar to that of the entire dataset. Various fair clustering algorithms have been proposed that…

Machine Learning · Statistics 2026-02-26 Jinwon Park , Kunwoong Kim , Jihu Lee , Yongdai Kim

Many fields, such as neuroscience, are experiencing the vast proliferation of cellular data, underscoring the need for organizing and interpreting large datasets. A popular approach partitions data into manageable subsets via hierarchical…

Quantitative Methods · Quantitative Biology 2024-03-07 Diek W. Wheeler , Giorgio A. Ascoli