English
Related papers

Related papers: scores: A Python package for verifying and evaluat…

200 papers

In the domain of vehicle telematics the automated recognition of driving maneuvers is used to classify and evaluate driving behaviour. This not only serves as a component to enhance the personalization of insurance policies, but also to…

Machine Learning · Computer Science 2025-07-01 Jonathan Schuster , Fabian Transchel

Asteroseismology is an exceptional tool for studying stars by using the properties of observed modes of oscillation. So far the process of performing an asteroseismic analysis of a star has remained somewhat esoteric and inaccessible to…

I present a fast Python tool, SpectRes, for carrying out the resampling of spectral flux densities and their associated uncertainties onto different wavelength grids. The function works with any grid of wavelength values, including…

Instrumentation and Methods for Astrophysics · Physics 2017-05-16 A. C. Carnall

Systems that rely on forecasts to make decisions, e.g. control or energy trading systems, require frequent updates of the forecasts. Usually, the forecasts are updated whenever new observations become available, hence in an online setting.…

Pyserini is an easy-to-use Python toolkit that supports replicable IR research by providing effective first-stage retrieval in a multi-stage ranking architecture. Our toolkit is self-contained as a standard Python package and comes with…

Information Retrieval · Computer Science 2021-02-22 Jimmy Lin , Xueguang Ma , Sheng-Chieh Lin , Jheng-Hong Yang , Ronak Pradeep , Rodrigo Nogueira

Subseasonal forecasting of the weather two to six weeks in advance is critical for resource allocation and advance disaster notice but poses many challenges for the forecasting community. At this forecast horizon, physics-based dynamical…

Generalized autoregressive score (GAS) models are a class of observation-driven time series models that employ the score to dynamically update time-varying parameters of the underlying probability distribution. GAS models have been…

Computation · Statistics 2024-05-09 Vladimír Holý

Machine learning is more and more applied in critical application areas like health and driver assistance. To minimize the risk of wrong decisions, in such applications it is necessary to consider the certainty of a classification to reject…

Machine Learning · Computer Science 2024-06-26 Stephan Hasler , Lydia Fischer

QuaPy is an open-source framework for performing quantification (a.k.a. supervised prevalence estimation), written in Python. Quantification is the task of training quantifiers via supervised learning, where a quantifier is a predictor that…

Machine Learning · Computer Science 2021-06-22 Alejandro Moreo , Andrea Esuli , Fabrizio Sebastiani

Dealing with uncertainty in applications of machine learning to real-life data critically depends on the knowledge of intrinsic dimensionality (ID). A number of methods have been suggested for the purpose of estimating ID, but no standard…

Machine Learning · Computer Science 2023-12-07 Jonathan Bac , Evgeny M. Mirkes , Alexander N. Gorban , Ivan Tyukin , Andrei Zinovyev

We present Paicos, a new object-oriented Python package for analyzing simulations performed with Arepo. Paicos strives to reduce the learning curve for students and researchers getting started with Arepo simulations. As such, Paicos…

Instrumentation and Methods for Astrophysics · Physics 2024-04-24 Thomas Berlok , Léna Jlassi , Ewald Puchwein , Troels Haugbølle

Multivariate probabilistic time series forecasts are commonly evaluated via proper scoring rules, i.e., functions that are minimal in expectation for the ground-truth distribution. However, this property is not sufficient to guarantee good…

Machine Learning · Computer Science 2023-06-07 Étienne Marcotte , Valentina Zantedeschi , Alexandre Drouin , Nicolas Chapados

Predictive models make mistakes. Hence, there is a need to quantify the uncertainty associated with their predictions. Conformal inference has emerged as a powerful tool to create statistically valid prediction regions around point…

Machine Learning · Statistics 2024-02-14 Luben M. C. Cabezas , Mateus P. Otto , Rafael Izbicki , Rafael B. Stern

Score matching is a recently developed parameter learning method that is particularly effective to complicated high dimensional density models with intractable partition functions. In this paper, we study two issues that have not been…

Machine Learning · Computer Science 2012-05-14 Siwei Lyu

For any forecasting application, evaluation of forecasts is an important task. For example, in the field of renewable energy sources there is high variability and uncertainty of power production, which makes forecasting and the evaluation…

Computational materials science produces large quantities of data, both in terms of high-throughput calculations and individual studies. Extracting knowledge from this large and heterogeneous pool of data is challenging due to the wide…

Materials Science · Physics 2024-10-23 Martin Kuban , Santiago Rigamonti , Claudia Draxl

ConsumerCheck is an open source data analysis software tailored for analysis of sensory and consumer data. Since some of the implemented methods are generic, such as PCA, PLSR and PCR, other data from other domains may also be analysed with…

Human-Computer Interaction · Computer Science 2022-01-12 Oliver Tomic , Alexandra Kuznetsova , Per Bruun Brockhoff , Thomas Graff , Tormod Næs

This work proposes a framework of benchmark functions designed to facilitate the creation of test cases for numerical optimisation techniques. The framework, written in Python 3, is designed to be easy to install, use, and expand. The…

Numerical Analysis · Mathematics 2024-06-25 Luca Baronti , Marco Castellani

We provide a pipeline for calculating, managing and visualising correlations and other pairwise association scores for numerical and categorical data. We present a uniform interface for calculating a plethora of pairwise scores and propose…

Computation · Statistics 2025-11-17 Amit Chinwan , Catherine B. Hurley

Neuroscience has recently made much progress, expanding the complexity of both neural-activity measurements and brain-computational models. However, we lack robust methods for connecting theory and experiment by evaluating our new big…

Quantitative Methods · Quantitative Biology 2023-07-06 Heiko H. Schütt , Alexander D. Kipnis , Jörn Diedrichsen , Nikolaus Kriegeskorte