English
Related papers

Related papers: Predictability Analysis of Regression Problems via…

200 papers

Machine learning algorithms have grown in sophistication over the years and are increasingly deployed for real-life applications. However, when using machine learning techniques in practical settings, particularly in high-risk applications…

Machine Learning · Computer Science 2023-10-06 Sukrita Singh , Neeraj Sarna , Yuanyuan Li , Yang Li , Agni Orfanoudaki , Michael Berger

Uncertainty in optimization is often represented as stochastic parameters in the optimization model. In Predict-Then-Optimize approaches, predictions of a machine learning model are used as values for such parameters, effectively…

Machine Learning · Computer Science 2025-12-03 Pieter Smet

Prediction, where observed data is used to quantify uncertainty about a future observation, is a fundamental problem in statistics. Prediction sets with coverage probability guarantees are a common solution, but these do not provide…

Statistics Theory · Mathematics 2022-11-22 Leonardo Cella , Ryan Martin

Understanding socio-academic and economic factors influencing students' performance is crucial for effective educational interventions. This study employs several machine learning techniques and causal analysis to predict and elucidate the…

Machine Learning · Computer Science 2025-06-17 Md. Biplob Hosen , Sabbir Ahmed , Bushra Akter , Mehrin Anannya

Prediction models are often employed in estimating parameters of optimization models. Despite the fact that in an end-to-end view, the real goal is to achieve good optimization performance, the prediction performance is measured on its own.…

Optimization and Control · Mathematics 2021-01-01 Nam Ho-Nguyen , Fatma Kılınç-Karzan

Machine learning and statistics typically focus on building models that capture the vast majority of the data, possibly ignoring a small subset of data as "noise" or "outliers." By contrast, here we consider the problem of jointly…

Machine Learning · Computer Science 2016-08-19 Brendan Juba

In many scientific and data-driven applications, machine learning models are increasingly used as measurement instruments, rather than merely as predictors of predefined labels. When the measurement function is learned from data, the…

Machine Learning · Computer Science 2026-01-27 Indrė Žliobaitė

The most important part of model selection and hyperparameter tuning is the evaluation of model performance. The most popular measures, such as AUC, F1, ACC for binary classification, or RMSE, MAD for regression, or cross-entropy for…

Machine Learning · Computer Science 2019-08-27 Alicja Gosiewska , Mateusz Bakala , Katarzyna Woznica , Maciej Zwolinski , Przemyslaw Biecek

Predictability is an emerging metric that quantifies the highest possible prediction accuracy for a given time series, being widely utilized in assessing known prediction algorithms and characterizing intrinsic regularities in human…

Information Theory · Computer Science 2023-03-29 En Xu , Tao Zhou , Zhiwen Yu , Zhuo Sun , Bin Guo

We present a deep transformation model for probabilistic regression. Deep learning is known for outstandingly accurate predictions on complex data but in regression tasks, it is predominantly used to just predict a single number. This…

Machine Learning · Statistics 2020-04-02 Beate Sick , Torsten Hothorn , Oliver Dürr

Machine learning classification tasks often benefit from predicting a set of possible labels with confidence scores to capture uncertainty. However, existing methods struggle with the high-dimensional nature of the data and the lack of…

Machine Learning · Computer Science 2024-07-08 Rui Luo , Zhixin Zhou

Current evaluation metrics for language modeling and generation rely heavily on the accuracy of predicted (or generated) words as compared to a reference ground truth. While important, token-level accuracy only captures one aspect of a…

Computation and Language · Computer Science 2020-10-15 Shiran Dudy , Steven Bedrick

We provide a unified approach to a method of estimation of the regression parameter in balanced linear models with a structured covariance matrix that combines a high breakdown point and bounded influence with high asymptotic efficiency at…

Statistics Theory · Mathematics 2023-03-22 Hendrik Paul Lopuhaä

Evaluating conditional coverage remains one of the most persistent challenges in assessing the reliability of predictive systems. Although conformal methods can give guarantees on marginal coverage, no method can guarantee to produce sets…

Machine Learning · Statistics 2025-12-15 Sacha Braun , David Holzmüller , Michael I. Jordan , Francis Bach

Obtaining high-quality labels is costly, whereas unlabeled covariates are often abundant, motivating semi-supervised inference methods with reliable uncertainty quantification. Prediction-powered inference (PPI) leverages a machine-learning…

Machine Learning · Statistics 2026-05-29 Se Yoon Lee , Jae Kwang Kim

This work introduces a formulation of model predictive control (MPC) which adaptively reasons about the complexity of the model based on the task while maintaining feasibility and stability guarantees. Existing MPC implementations often…

Robotics · Computer Science 2024-11-07 Joseph Norby , Ardalan Tajbakhsh , Yanhao Yang , Aaron M. Johnson

Forming a reliable judgement of a machine learning (ML) model's appropriateness for an application ecosystem is critical for its responsible use, and requires considering a broad range of factors including harms, benefits, and…

Machine Learning · Computer Science 2022-05-12 Ben Hutchinson , Negar Rostamzadeh , Christina Greer , Katherine Heller , Vinodkumar Prabhakaran

We study the well known difficult problem of prediction in measurement error models. By targeting directly at the prediction interval instead of the point prediction, we construct a prediction interval by providing estimators of both the…

Methodology · Statistics 2024-05-20 Fei Jiang , Yanyuan Ma

Modern predictive analytics underpinned by machine learning techniques has become a key enabler to the automation of data-driven decision making. In the context of business process management, predictive analytics has been applied to making…

Machine Learning · Computer Science 2020-06-09 Renuka Sindhgatta , Chun Ouyang , Catarina Moreira

A powerful and flexible approach to structured prediction consists in embedding the structured objects to be predicted into a feature space of possibly infinite dimension by means of output kernels, and then, solving a regression problem in…

Machine Learning · Statistics 2020-11-03 Luc Brogat-Motte , Alessandro Rudi , Céline Brouard , Juho Rousu , Florence d'Alché-Buc