English
Related papers

Related papers: Prediction Aided by Surrogate Training

200 papers

Stepped-wedge designs are increasingly used in randomized experiments to accommodate logistical and ethical constraints by staggering treatment roll-out over time. Despite their popularity, existing analytical methods largely rely on…

Methodology · Statistics 2026-02-12 Liangbo Lyu , Bingkai Wang

We introduce a statistical physics inspired supervised machine learning algorithm for classification and regression problems. The method is based on the invariances or stability of predicted results when known data is represented as…

Machine Learning · Statistics 2018-11-19 Patrick Chao , Tahereh Mazaheri , Bo Sun , Nicholas B. Weingartner , Zohar Nussinov

We propose a simple, statistically principled, and theoretically justified method to improve supervised learning when the training set is not representative, a situation known as covariate shift. We build upon a well-established methodology…

Machine Learning · Statistics 2025-03-12 Maximilian Autenrieth , David A. van Dyk , Roberto Trotta , David C. Stenning

This paper presents a methodological framework for training, self-optimising, and self-organising surrogate models to approximate and speed up multiobjective optimisation of technical systems based on multiphysics simulations. At the hand…

Machine Learning · Computer Science 2024-04-04 Diego Botache , Jens Decke , Winfried Ripken , Abhinay Dornipati , Franz Götz-Hahn , Mohamed Ayeb , Bernhard Sick

Modern AI agents such as large language models are trained on diverse tasks -- translation, code generation, mathematical reasoning, and text prediction -- simultaneously. A key question is how to quantify the influence of each individual…

Machine Learning · Computer Science 2026-05-12 Zhenshuo Zhang , Minxuan Duan , Hongyang R. Zhang

Estimating long-term causal effects based on short-term surrogates is a significant but challenging problem in many real-world applications, e.g., marketing and medicine. Despite its success in certain domains, most existing methods…

Machine Learning · Computer Science 2023-11-22 Ruichu Cai , Weilin Chen , Zeqin Yang , Shu Wan , Chen Zheng , Xiaoqing Yang , Jiecheng Guo

Sample average approximation (SAA), a popular method for tractably solving stochastic optimization problems, enjoys strong asymptotic performance guarantees in settings with independent training samples. However, these guarantees are not…

Optimization and Control · Mathematics 2021-12-13 Yafei Wang , Bo Pan , Wei Tu , Peng Liu , Bei Jiang , Chao Gao , Wei Lu , Shangling Jui , Linglong Kong

Randomized controlled trials (RCTs) with binary primary endpoints introduce novel challenges for inferring the causal effects of treatments. The most significant challenge is non-collapsibility, in which the conditional odds ratio estimand…

Methodology · Statistics 2024-03-01 Yunfan Li , Arman Sabbaghi , Jonathan R. Walsh , Charles K. Fisher

Explainable AI is a crucial component for edge services, as it ensures reliable decision making based on complex AI models. Surrogate models are a prominent approach of XAI where human-interpretable models, such as a linear regression…

Machine Learning · Computer Science 2025-03-12 Foivos Charalampakos , Thomas Tsouparopoulos , Iordanis Koutsopoulos

Reliable uncertainty estimates are an important tool for helping autonomous agents or human decision makers understand and leverage predictive models. However, existing approaches to estimating uncertainty largely ignore the possibility of…

Machine Learning · Computer Science 2020-05-22 Sangdon Park , Osbert Bastani , James Weimer , Insup Lee

Surrogate-assisted evolutionary algorithms (SAEAs) have been proposed to solve expensive optimization problems. Although SAEAs use surrogate models that approximate the evaluations of solutions using machine learning techniques, prior…

Neural and Evolutionary Computing · Computer Science 2026-01-21 Yuki Hanawa , Tomohiro Harada , Yukiya Miura

In various approaches to learning, notably in domain adaptation, active learning, learning under covariate shift, semi-supervised learning, learning with concept drift, and the like, one often wants to compare a baseline classifier to one…

Machine Learning · Computer Science 2017-07-14 Marco Loog , Jesse H. Krijthe , Are C. Jensen

Building a surrogate model of an objective function has shown to be effective to assist evolutionary algorithms (EAs) to solve real-world complex optimisation problems which involve either computationally expensive numerical simulations or…

Neural and Evolutionary Computing · Computer Science 2020-02-11 Xiaoran Ruan , Ke Li , Bilel Derbel , Arnaud Liefooghe

In the context of uncertainty quantification, computational models are required to be repeatedly evaluated. This task is intractable for costly numerical models. Such a problem turns out to be even more severe for stochastic simulators, the…

Computation · Statistics 2022-11-29 X. Zhu , B. Sudret

Robust estimation of heterogeneous treatment effects is a fundamental challenge for optimal decision-making in domains ranging from personalized medicine to educational policy. In recent years, predictive machine learning has emerged as a…

Machine Learning · Statistics 2025-06-23 Maximilian Schuessler , Erik Sverdrup , Robert Tibshirani

In this paper, we propose a surrogate-assisted evolutionary algorithm (EA) for hyperparameter optimization of machine learning (ML) models. The proposed STEADE model initially estimates the objective function landscape using RadialBasis…

Neural and Evolutionary Computing · Computer Science 2020-12-14 Subhodip Biswas , Adam D Cobb , Andreea Sistrunk , Naren Ramakrishnan , Brian Jalaian

A world model creates a surrogate world to train a controller and predict safety violations by learning the internal dynamic model of systems. However, the existing world models rely solely on statistical learning of how observations change…

Machine Learning · Computer Science 2024-05-06 Zhenjiang Mao , Siqi Dai , Yuang Geng , Ivan Ruchkin

Selective prediction aims to learn a reliable model that abstains from making predictions when uncertain. These predictions can then be deferred to humans for further evaluation. As an everlasting challenge for machine learning, in many…

Machine Learning · Computer Science 2024-03-04 Jiefeng Chen , Jinsung Yoon , Sayna Ebrahimi , Sercan Arik , Somesh Jha , Tomas Pfister

This paper presents a novel concept to support physically impaired humans in daily object manipulation tasks with a robot. Given a user's manipulation sequence, we propose a predictive model that uniquely casts the user's sequential…

Robotics · Computer Science 2023-09-11 Theodoros Stouraitis , Michael Gienger

This paper is motivated by the analysis of a survey study of college student wellbeing before and after the outbreak of the COVID-19 pandemic. A statistical challenge in well-being survey studies lies in that outcome variables are often…

Methodology · Statistics 2023-06-09 Shaobo Li , Zhaohu Fan , Ivy Liu , Philip S. Morrison , Dungang Liu