English
Related papers

Related papers: Non-deterministic Behavior of Ranking-based Metric…

200 papers

Predicting unobserved entries of a partially observed matrix has found wide applicability in several areas, such as recommender systems, computational biology, and computer vision. Many scalable methods with rigorous theoretical guarantees…

Machine Learning · Statistics 2018-02-15 Vatsal Shah , Nikhil Rao , Weicong Ding

A useful capability is that of classifying some agent's behavior using data from a sequence, or trace, of sensor measurements. The sensor selection problem involves choosing a subset of available sensors to ensure that, when generated,…

Robotics · Computer Science 2023-08-02 Rishi Phatak , Dylan A. Shell

Embedding spaces contain interpretable dimensions indicating gender, formality in style, or even object properties. This has been observed multiple times. Such interpretable dimensions are becoming valuable tools in different areas of…

Computation and Language · Computer Science 2024-04-04 Katrin Erk , Marianna Apidianaki

Machine learning models are often evaluated using point estimates of performance metrics such as accuracy, F1 score, or mean squared error. Such summaries fail to capture the inherent variability induced by stochastic elements of the…

Machine Learning · Computer Science 2026-05-13 Christoph Lehmann , Yahor Paromau

Performance measurement in competitive domains is frequently confounded by shared environmental factors that obscure true performance differences. For instance, absolute metrics can be heavily influenced by factors as varied as weather…

Data Analysis, Statistics and Probability · Physics 2025-04-29 M. R. Brown , G. Scott , L. Kilduff

The ability to identify and control different kinds of linguistic information encoded in vector representations of words has many use cases, especially for explainability and bias removal. This is usually done via a set of simple…

Computation and Language · Computer Science 2023-10-25 Tal Levy , Omer Goldman , Reut Tsarfaty

The performance of a quantum information processing protocol is ultimately judged by distinguishability measures that quantify how distinguishable the actual result of the protocol is from the ideal case. The most prominent…

Quantum Physics · Physics 2023-07-13 Soorya Rethinasamy , Rochisha Agarwal , Kunal Sharma , Mark M. Wilde

We introduce a pattern mining framework that operates on semi-structured datasets and exploits the dichotomy between outcomes. Our approach takes advantage of constraint reasoning to find sequential patterns that occur frequently and…

Artificial Intelligence · Computer Science 2022-01-25 Xin Wang , Serdar Kadioglu

Machine learning (ML) systems are increasingly deployed in high-stakes domains where reliability is paramount. This thesis investigates how uncertainty estimation can enhance the safety and trustworthiness of ML, focusing on selective…

Machine Learning · Computer Science 2025-09-09 Stephan Rabanser

Clinical researchers often select among and evaluate risk prediction models using standard machine learning metrics based on confusion matrices. However, if these models are used to allocate interventions to patients, standard metrics…

Machine Learning · Statistics 2020-06-03 Alejandro Schuler , Aashish Bhardwaj , Vincent Liu

Heterogeneous datasets emerge in various machine learning and optimization applications that feature different input sources, types or formats. Most models or methods do not natively tackle heterogeneity. Hence, such datasets are often…

Machine Learning · Statistics 2025-08-25 Edward Hallé-Hannan , Charles Audet , Youssef Diouane , Sébastien Le Digabel , Paul Saves

Hyperbolic space is a natural setting for mining and visualizing data with hierarchical structure. In order to compute a hyperbolic embedding from comparison or similarity information, one has to solve a hyperbolic distance geometry…

Machine Learning · Computer Science 2020-09-14 Puoya Tabaghi , Ivan Dokmanić

Network embedding is a general-purpose machine learning technique that encodes network structure in vector spaces with tunable dimension. Choosing an appropriate embedding dimension -- small enough to be efficient and large enough to be…

Physics and Society · Physics 2021-06-22 Weiwei Gu , Aditya Tandon , Yong-Yeol Ahn , Filippo Radicchi

Our world is ambiguous and this is reflected in the data we use to train our algorithms. This is particularly true when we try to model natural processes where collected data is affected by noisy measurements and differences in measurement…

Machine Learning · Computer Science 2023-07-19 Jörg K. H. Franke , Frederic Runge , Frank Hutter

Word embeddings have become a staple of several natural language processing tasks, yet much remains to be understood about their properties. In this work, we analyze word embeddings in terms of their principal components and arrive at a…

Computation and Language · Computer Science 2020-05-22 Vikas Raunak , Vaibhav Kumar , Vivek Gupta , Florian Metze

Parameter identification problems are formulated in a probabilistic language, where the randomness reflects the uncertainty about the knowledge of the true values. This setting allows conceptually easily to incorporate new information, e.g.…

Numerical Analysis · Computer Science 2013-03-19 Bojana V. Rosić , Anna Kučerová , Jan Sýkora , Oliver Pajonk , Alexander Litvinenko , Hermann G. Matthies

In recent years, manifold methods have moved into focus as tools for dimension reduction. Assuming that the high-dimensional data actually lie on or close to a low-dimensional nonlinear manifold, these methods have shown convincing results…

Machine Learning · Statistics 2020-12-23 Moritz Herrmann , Fabian Scheipl

The rank metric measures the distance between two matrices by the rank of their difference. Codes designed for the rank metric have attracted considerable attention in recent years, reinforced by network coding and further motivated by a…

Information Theory · Computer Science 2022-03-24 Hannes Bartz , Lukas Holzbaur , Hedongliang Liu , Sven Puchinger , Julian Renner , Antonia Wachter-Zeh

We consider the problem of ranking a set of objects based on their performance when the measurement of said performance is subject to noise. In this scenario, the performance is measured repeatedly, resulting in a range of measurements for…

Performance · Computer Science 2025-02-04 Aravind Sankaran , Lars Karlsson , Paolo Bientinesi

Ranking metrics are a family of metrics largely used to evaluate recommender systems. However they typically suffer from the fact the reward is affected by the order in which recommended items are displayed to the user. A classical way to…

Machine Learning · Statistics 2019-09-18 Alexandre Gilotte