English
Related papers

Related papers: ForeComp: An R Package for Comparing Predictive Ac…

200 papers

There are many different ways in which change point analysis can be performed, from purely parametric methods to those that are distribution free. The ecp package is designed to perform multiple change point analysis while making as few…

Computation · Statistics 2013-11-26 Nicholas A. James , David S. Matteson

Recent studies extend the autoregression paradigm to text-to-image generation, achieving performance comparable to diffusion models. However, our new PairComp benchmark -- featuring test cases of paired prompts with similar syntax but…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Kaihang Pan , Wendong Bu , Yuruo Wu , Yang Wu , Kai Shen , Yunfei Li , Hang Zhao , Juncheng Li , Siliang Tang , Yueting Zhuang

Science and engineering problems subject to uncertainty are frequently both computationally expensive and feature nonsmooth parameter dependence, making standard Monte Carlo too slow, and excluding efficient use of accelerated uncertainty…

Numerical Analysis · Mathematics 2021-10-01 Per Pettersson , Sebastian Krumscheid

This paper describes the R package imputeTestbench that provides a testbench for comparing imputation methods for missing data in univariate time series. The imputeTestbench package can be used to simulate the amount and type of missing…

Methodology · Statistics 2020-05-20 Neeraj Bokde , Kishore Kulat , Marcus W Beck , Gualberto Asencio-Cortés

The adoption of machine learning in applications where it is crucial to ensure fairness and accountability has led to a large number of model proposals in the literature, largely formulated as optimisation problems with constraints reducing…

Machine Learning · Statistics 2023-05-04 Marco Scutari

Conformal prediction is an uncertainty quantification method that constructs a prediction set for a previously unseen datum, ensuring the true label is included with a predetermined coverage probability. Adaptive conformal prediction has…

Machine Learning · Computer Science 2024-11-07 Erfan Hajihashemi , Yanning Shen

An R package SpatialPack that implements routines to compute point estimators and perform hypothesis testing of the spatial association between two stochastic sequences is introduced. These methods address the spatial association between…

Applications · Statistics 2016-11-17 Felipe Osorio , Ronny Vallejos , Francisco Cuevas

Fairness is a growing area of machine learning (ML) that focuses on ensuring models do not produce systematically biased outcomes for specific groups, particularly those defined by protected attributes such as race, gender, or age.…

Computation · Statistics 2025-10-14 Benjamin Smith , Jianhui Gao , Jessica Gronsbell

The R package stochvol provides a fully Bayesian implementation of heteroskedasticity modeling within the framework of stochastic volatility. It utilizes Markov chain Monte Carlo (MCMC) samplers to conduct inference by obtaining draws from…

Computation · Statistics 2019-07-01 Gregor Kastner

To improve the efficiency of Monte Carlo estimation, practitioners are turning to biased Markov chain Monte Carlo procedures that trade off asymptotic exactness for computational speed. The reasoning is sound: a reduction in variance due to…

Machine Learning · Statistics 2019-01-03 Jackson Gorham , Lester Mackey

Two fundamental research tasks in science and engineering are forward predictions and data inversion. This article introduces a recent R package RobustCalibration for Bayesian data inversion and model calibration by experiments and field…

Computation · Statistics 2024-02-20 Mengyang Gu

Integrating multiple observational studies for meta-analysis has sparked much interest. The presented R package WMAP (Weighted Meta-Analysis with Pseudo-Population) addresses a critical gap in the implementation of integrative weighting…

Methodology · Statistics 2025-07-01 Subharup Guha , Mengqi Xu , Kashish Priyam , Yi Li

When probability predictions are too cautious for decision making, boldness-recalibration enables responsible emboldening while maintaining the probability of calibration required by the user. We formulate boldness-recalibration as a…

Methodology · Statistics 2025-07-21 Adeline P. Guthrie , Christopher T. Franck

Zero-shot text classification typically relies on prompt engineering, but the inherent prompt brittleness of large language models undermines its reliability. Minor changes in prompt can cause significant discrepancies in model performance.…

Computation and Language · Computer Science 2025-04-07 Junlang Qian , Zixiao Zhu , Hanzhang Zhou , Zijian Feng , Zepeng Zhai , Kezhi Mao

We introduce a new approach for comparing the predictive accuracy of two nested models that bypasses the difficulties caused by the degeneracy of the asymptotic variance of forecast error loss differentials used in the construction of…

Econometrics · Economics 2023-10-17 Jean-Yves Pitarakis

For any black-box model, conformal prediction (CP) returns prediction sets guaranteed to include the true label with high adjustable probability. Robust CP (RCP) extends the guarantee to the worst case noise up to a pre-defined magnitude.…

Machine Learning · Computer Science 2025-12-09 Soroush H. Zargarbashi , Mohammad Sadegh Akhondzadeh , Aleksandar Bojchevski

We develop a novel continuous-time asymptotic framework for inference on whether the predictive ability of a given forecast model remains stable over time. We formally define forecast instability from the economic forecaster's perspective…

Econometrics · Economics 2018-12-04 Alessandro Casini

Predictions of uncertainty-aware models are diverse, ranging from single point estimates (often averaged over prediction samples) to predictive distributions, to set-valued or credal-set representations. We propose a novel unified…

Machine Learning · Computer Science 2025-02-18 Shireen Kudukkil Manchingal , Muhammad Mubashar , Kaizheng Wang , Fabio Cuzzolin

Background: Mathematical models based on ordinary differential equations (ODEs) are essential tools across various scientific disciplines, including biology, ecology, and healthcare informatics. They are used to simulate complex dynamic…

Quantitative Methods · Quantitative Biology 2025-09-03 Hamed Karami , Amanda Bleichrodt , Ruiyan Luo , Gerardo Chowell

`scores` is a Python package containing mathematical functions for the verification, evaluation and optimisation of forecasts, predictions or models. It supports labelled n-dimensional (multidimensional) data, which is used in many…