English
Related papers

Related papers: Assessing the Performance of an Adaptive Multi-Fid…

200 papers

Satellite-based positioning system such as GPS often suffers from large amount of noise that degrades the positioning accuracy dramatically especially in real-time applications. In this work, we consider a data-mining approach to enhance…

Machine Learning · Statistics 2019-06-05 Ming Lin , Xiaomin Song , Qi Qian , Hao Li , Liang Sun , Shenghuo Zhu , Rong Jin

Challenges in multi-fidelity modeling relate to accuracy, uncertainty estimation and high-dimensionality. A novel additive structure is introduced in which the highest fidelity solution is written as a sum of the lowest fidelity solution…

Machine Learning · Computer Science 2021-04-09 Wei W. Xing , Akeel A. Shah , Peng Wang , Shandian Zhe Qian Fu , Robert. M. Kirby

This paper proposes a new class of real-time optimization schemes to overcome system-model mismatch of uncertain processes. This work's novelty lies in integrating derivative-free optimization schemes and multi-fidelity Gaussian processes…

Machine Learning · Computer Science 2021-11-11 Panagiotis Petsagkourakis , Benoit Chachuat , Ehecatl Antonio del Rio-Chanona

Bayesian optimization is popular for optimizing time-consuming black-box objectives. Nonetheless, for hyperparameter tuning in deep neural networks, the time required to evaluate the validation error for even a few hyperparameter settings…

Machine Learning · Computer Science 2019-03-13 Jian Wu , Saul Toscano-Palmerin , Peter I. Frazier , Andrew Gordon Wilson

We study the Gaussian Process regression model in the context of training data with noise in both input and output. The presence of two sources of noise makes the task of learning accurate predictive models extremely challenging. However,…

Machine Learning · Statistics 2015-07-03 Cuong Tran , Vladimir Pavlovic , Robert Kopp

In many fields of science and engineering, models with different fidelities are available. Physical experiments or detailed simulations that accurately capture the behavior of the system are regarded as high-fidelity models with low model…

Machine Learning · Computer Science 2021-09-22 Chi Zhang , Chaolin Song , Abdollah Shafieezadeh

In statistical modeling with Gaussian Process regression, it has been shown that combining (few) high-fidelity data with (many) low-fidelity data can enhance prediction accuracy, compared to prediction based on the few high-fidelity data…

Machine Learning · Statistics 2019-04-23 Seungjoon Lee , Felix Dietrich , George E. Karniadakis , Ioannis G. Kevrekidis

Reinforcement learning from human feedback (RLHF) or verifiable rewards (RLVR), the standard paradigm for aligning LLMs or building recent SOTA reasoning models, is highly sensitive to noise from inconsistent or erroneous rewards. Yet, the…

Machine Learning · Computer Science 2026-05-20 Omar El Mansouri , Fathinah Asma Izzati , Mohamed El Amine Seddik , Salem Lahlou

We consider the problem of multi-fidelity zeroth-order optimization, where one can evaluate a function $f$ at various approximation levels (of varying costs), and the goal is to optimize $f$ with the cheapest evaluations possible. In this…

Machine Learning · Computer Science 2024-10-14 Étienne de Montbrun , Sébastien Gerchinovitz

Throughput optimization of optical communication systems is a key challenge for current optical networks. The use of gain-flattening filters (GFFs) simplifies the problem at the cost of insertion loss, higher power consumption and…

Machine Learning · Computer Science 2021-10-01 Metodi Plamenov Yankov , Pawel Marcin Kaminski , Henrik Enggaard Hansen , Francesco Da Ros

Bayesian optimization (BO) is a popular framework to optimize black-box functions. In many applications, the objective function can be evaluated at multiple fidelities to enable a trade-off between the cost and accuracy. To reduce the…

Machine Learning · Computer Science 2020-12-11 Shibo Li , Wei Xing , Mike Kirby , Shandian Zhe

This study presents a novel mixed-precision iterative refinement algorithm, GADI-IR, within the general alternating-direction implicit (GADI) framework, designed for efficiently solving large-scale sparse linear systems. By employing…

Numerical Analysis · Mathematics 2025-03-24 Jifeng Ge , Juan Zhang

We propose a data fusion method based on multi-fidelity Gaussian process regression (GPR) framework. This method combines available data of the quantity of interest (QoI) and its gradients with different fidelity levels, namely, it is a…

Computational Engineering, Finance, and Science · Computer Science 2020-12-30 Yixiang Deng , Guang Lin , Xiu Yang

The trimming scheme with a prefixed cutoff portion is known as a method of improving the robustness of statistical models such as multivariate Gaussian mixture models (MG- MMs) in small scale tests by alleviating the impacts of outliers.…

Computation and Language · Computer Science 2014-05-20 Dalei Wu , Haiqing Wu

We study the problem of black-box optimization of a noisy function in the presence of low-cost approximations or fidelities, which is motivated by problems like hyper-parameter tuning. In hyper-parameter tuning evaluating the black-box…

Machine Learning · Statistics 2018-10-25 Rajat Sen , Kirthevasan Kandasamy , Sanjay Shakkottai

Reliability analysis aims at estimating the failure probability of an engineering system. It often requires multiple runs of a limit-state function, which usually relies on computationally intensive simulations. Traditionally, these…

Computation · Statistics 2024-01-22 Anderson V. Pires , Maliki Moustapha , Stefano Marelli , Bruno Sudret

In recent years, federated learning (FL) has made significant advance in privacy-sensitive applications. However, it can be hard to ensure that FL participants provide well-annotated data for training. The corresponding annotations from…

Machine Learning · Computer Science 2025-06-04 Xuefeng Jiang , Tian Wen , Zhiqin Yang , Lvhua Wu , Yufeng Chen , Sheng Sun , Yuwei Wang , Min Liu

We aim to redefine robust ego-motion estimation and photorealistic 3D reconstruction by addressing a critical limitation: the reliance on noise-free data in existing models. While such sanitized conditions simplify evaluation, they fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Xiaohao Xu , Tianyi Zhang , Shibo Zhao , Xiang Li , Sibo Wang , Yongqi Chen , Ye Li , Bhiksha Raj , Matthew Johnson-Roberson , Sebastian Scherer , Xiaonan Huang

Gaussian processes are employed for non-parametric regression in a Bayesian setting. They generalize linear regression, embedding the inputs in a latent manifold inside an infinite-dimensional reproducing kernel Hilbert space. We can…

Numerical Analysis · Mathematics 2021-07-13 Francesco Romor , Marco Tezzele , Gianluigi Rozza

Modern engineering and scientific workflows often require simultaneous predictions across related tasks and fidelity levels, where high-fidelity data is scarce and expensive, while low-fidelity data is more abundant. This paper introduces…