English
Related papers

Related papers: Beyond Surrogates: A Quantitative Analysis for Int…

200 papers

We study the rates of convergence from empirical surrogate risk minimizers to the Bayes optimal classifier. Specifically, we introduce the notion of \emph{consistency intensity} to characterize a surrogate loss function and exploit this…

Machine Learning · Statistics 2021-02-26 Jingwei Zhang , Tongliang Liu , Dacheng Tao

We present surrogate regret bounds for arbitrary surrogate losses in the context of binary classification with label-dependent costs. Such bounds relate a classifier's risk, assessed with respect to a surrogate loss, to its cost-sensitive…

Machine Learning · Statistics 2010-09-15 Clayton Scott

Robot decision-making increasingly relies on data-driven human prediction models when operating around people. While these models are known to mispredict in out-of-distribution interactions, only a subset of prediction errors impact…

Robotics · Computer Science 2024-11-12 Kensuke Nakamura , Ran Tian , Andrea Bajcsy

Offline model-based optimization (MBO) aims to identify a design that maximizes a black-box function using only a fixed, pre-collected dataset of designs and their corresponding scores. A common approach in offline MBO is to train a…

Machine Learning · Computer Science 2025-05-05 Rong-Xi Tan , Ke Xue , Shen-Huan Lyu , Haopu Shang , Yao Wang , Yaoyuan Wang , Sheng Fu , Chao Qian

Surrogate models are statistical or conceptual approximations for more complex simulation models. In this context, it is crucial to propagate the uncertainty induced by limited simulation budget and surrogate approximation error to…

Machine Learning · Statistics 2026-01-27 Philipp Reiser , Javier Enrique Aguilar , Anneli Guthke , Paul-Christian Bürkner

Decision-making in manufacturing often involves optimizing key process parameters using data collected from simulation experiments. Gaussian processes are widely used to surrogate the underlying system and guide optimization. Uncertainty…

Applications · Statistics 2025-07-30 Yezhuo Li , Qiong Zhang , Madhura Limaye , Gang Li

We study the problem of online multiclass classification in a setting where the learner's feedback is determined by an arbitrary directed graph. While including bandit feedback as a special case, feedback graphs allow a much richer set of…

Machine Learning · Computer Science 2024-02-20 Dirk van der Hoeven , Federico Fusco , Nicolò Cesa-Bianchi

Surrogate markers are often used in clinical trials to evaluate treatment effects when primary outcomes are costly, invasive, or take a long time to observe. However, reliance on surrogates can lead to the surrogate paradox, where a…

Methodology · Statistics 2025-06-17 Emily Hsiao , Lu Tian , Layla Parast

Reference-based metrics such as ROUGE or BERTScore evaluate the content quality of a summary by comparing the summary to a reference. Ideally, this comparison should measure the summary's information quality by calculating how much…

Computation and Language · Computer Science 2020-10-26 Daniel Deutsch , Dan Roth

Confronted with the challenge of identifying the most suitable metric to validate the merits of newly proposed models, the decision-making process is anything but straightforward. Given that comparing rankings introduces its own set of…

Information Retrieval · Computer Science 2024-08-30 Chiara Balestra , Andreas Mayr , Emmanuel Müller

We study the interplay between surrogate methods for structured prediction and techniques from multitask learning designed to leverage relationships between surrogate outputs. We propose an efficient algorithm based on trace norm…

Machine Learning · Computer Science 2019-03-05 Giulia Luise , Dimitris Stamos , Massimiliano Pontil , Carlo Ciliberto

This paper defines a new pseudometric for binary relations between finite sets that measures consensus among subsets. The main results are (1) a concise restatement of this pseudometric with an intuitively appealing interpretation via a…

Geometric Topology · Mathematics 2021-09-28 Kenneth P. Ewing , Michael Robinson

In applications with significant class imbalance or asymmetric costs, metrics such as the $F_\beta$-measure, AM measure, Jaccard similarity coefficient, and weighted accuracy offer more suitable evaluation criteria than standard binary…

Machine Learning · Computer Science 2025-12-30 Anqi Mao , Mehryar Mohri , Yutao Zhong

The growing use of permanent monitoring systems has increased data availability, offering new opportunities for structural assessment but also posing scalability challenges, especially across large bridge networks. Managing multiple…

Machine Learning · Computer Science 2025-09-24 Elisa Tomassini , Enrique García-Macías , Filippo Ubertini

The use of transfer learning within Bayesian optimization addresses the disadvantages of the so-called \textit{cold start} problem by using source data to aid in the optimization of a target problem. We present a method that leverages an…

Optimization and Control · Mathematics 2026-04-01 Ali Tfaily , Youssef Diouane , Nathalie Bartoli , Michael Kokkolaras

One fundamental statistical question for research areas such as precision medicine and health disparity is about discovering effect modification of treatment or exposure by observed covariates. We propose a semiparametric framework for…

Methodology · Statistics 2020-08-04 Muxuan Liang , Menggang Yu

The quantification of uncertainties of computer simulations due to input parameter uncertainties is paramount to assess a model's credibility. For computationally expensive simulations, this is often feasible only via surrogate models that…

Methodology · Statistics 2021-08-30 Sascha Ranftl , Wolfgang von der Linden

Accurate comparisons between theoretical models and experimental data are critical for scientific progress. However, inferred physical model parameters can vary significantly with the chosen physics model, highlighting the importance of…

High Energy Physics - Phenomenology · Physics 2025-10-27 Sunil Jaiswal , Chun Shen , Richard J. Furnstahl , Ulrich Heinz , Matthew T. Pratola

We present an information-theoretic framework for understanding overfitting and underfitting in machine learning and prove the formal undecidability of determining whether an arbitrary classification algorithm will overfit a dataset.…

Machine Learning · Computer Science 2020-11-10 Daniel Bashir , George D. Montanez , Sonia Sehra , Pedro Sandoval Segura , Julius Lauw

This paper presents a methodological framework for training, self-optimising, and self-organising surrogate models to approximate and speed up multiobjective optimisation of technical systems based on multiphysics simulations. At the hand…

Machine Learning · Computer Science 2024-04-04 Diego Botache , Jens Decke , Winfried Ripken , Abhinay Dornipati , Franz Götz-Hahn , Mohamed Ayeb , Bernhard Sick