English
Related papers

Related papers: Learning Instance-Specific Parameters of Black-Box…

200 papers

We propose a novel method for gradient-based optimization of black-box simulators using differentiable local surrogate models. In fields such as physics and engineering, many processes are modeled with non-differentiable simulators with…

Machine Learning · Computer Science 2020-09-30 Sergey Shirobokov , Vladislav Belavin , Michael Kagan , Andrey Ustyuzhanin , Atılım Güneş Baydin

Gradient-based optimization is now ubiquitous across graphics, but unfortunately can not be applied to problems with undefined or zero gradients. To circumvent this issue, the loss function can be manually replaced by a ``surrogate'' that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Michael Fischer , Tobias Ritschel

The success of deep denoisers on real-world color photographs usually relies on the modeling of sensor noise and in-camera signal processing (ISP) pipeline. Performance drop will inevitably happen when the sensor and ISP pipeline of test…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Yue Cao , Xiaohe Wu , Shuran Qi , Xiao Liu , Zhongqin Wu , Wangmeng Zuo

Black box discrete optimization (BBDO) appears in wide range of engineering tasks. Evolutionary or other BBDO approaches have been applied, aiming at automating necessary tuning of system parameters, such as hyper parameter tuning of…

Machine Learning · Computer Science 2018-09-19 Kouhei Nishida , Hernan Aguirre , Shota Saito , Shinichi Shirakawa , Youhei Akimoto

In physics and engineering, many processes are modeled using non-differentiable black-box simulators, making the optimization of such functions particularly challenging. To address such cases, inspired by the Gradient Theorem, we propose…

Offline design optimization problem arises in numerous science and engineering applications including material and chemical design, where expensive online experimentation necessitates the use of in silico surrogate functions to predict and…

Machine Learning · Computer Science 2025-03-05 Minh Hoang , Azza Fadhel , Aryan Deshwal , Janardhan Rao Doppa , Trong Nghia Hoang

This paper describes a simple, but effective sampling method for optimizing and learning a discrete approximation (or surrogate) of a multi-dimensional function along a one-dimensional line segment of interest. The method does not rely on…

Optimization and Control · Mathematics 2023-07-21 Dimitri J. Papageorgiou , Jan Kronqvist , Krishnan Kumaran

Deep learning algorithms have recently shown to be a successful tool in estimating parameters of statistical models for which simulation is easy, but likelihood computation is challenging. But the success of these approaches depends on…

Machine Learning · Statistics 2024-02-20 Amanda Lenzi , Haavard Rue

Numerical solutions of partial differential equations (PDEs) require expensive simulations, limiting their application in design optimization, model-based control, and large-scale inverse problems. Surrogate modeling techniques seek to…

Computational Physics · Physics 2022-05-18 James Duvall , Karthik Duraisamy , Shaowu Pan

Parameter inference for stochastic differential equations is challenging due to the presence of a latent diffusion process. Working with an Euler-Maruyama discretisation for the diffusion, we use variational inference to jointly learn the…

Computation · Statistics 2018-05-15 Thomas Ryder , Andrew Golightly , A. Stephen McGough , Dennis Prangle

Under certain statistical assumptions of noise, recent self-supervised approaches for denoising have been introduced to learn network parameters without true clean images, and these methods can restore an image by exploiting information…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Seunghwan Lee , Donghyeon Cho , Jiwon Kim , Tae Hyun Kim

An established way to improve the transferability of black-box evasion attacks is to craft the adversarial examples on an ensemble-based surrogate to increase diversity. We argue that transferability is fundamentally related to uncertainty.…

Machine Learning · Computer Science 2022-06-22 Martin Gubri , Maxime Cordy , Mike Papadakis , Yves Le Traon , Koushik Sen

We introduce a surrogate-based black-box optimization method, termed Polynomial-model-based optimization (PMBO). The algorithm alternates polynomial approximation with Bayesian optimization steps, using Gaussian processes to model the error…

Optimization and Control · Mathematics 2024-03-13 Janina Schreiber , Pau Batlle , Damar Wicaksono , Michael Hecht

Recently, several optimization methods have been successfully applied to the hyperparameter optimization of deep neural networks (DNNs). The methods work by modeling the joint distribution of hyperparameter values and corresponding error.…

Machine Learning · Computer Science 2016-08-02 Ilija Ilievski , Jiashi Feng

The use of deep learning has successfully solved several problems in the field of medical imaging. Deep learning has been applied to the CT denoising problem successfully. However, the use of deep learning requires large amounts of data to…

Image and Video Processing · Electrical Eng. & Systems 2022-04-04 Mayank Patwari , Ralf Gutjahr , Rainer Raupach , Andreas Maier

We address the problem of training models with black-box and hard-to-optimize metrics by expressing the metric as a monotonic function of a small number of easy-to-optimize surrogates. We pose the training problem as an optimization over a…

Machine Learning · Computer Science 2020-02-21 Qijia Jiang , Olaoluwa Adigun , Harikrishna Narasimhan , Mahdi Milani Fard , Maya Gupta

Recent deep learning-based image denoising methods have shown impressive performance; however, many lack the flexibility to adjust the denoising strength based on the noise levels, camera settings, and user preferences. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Youngjin Oh , Junhyeong Kwon , Keuntek Lee , Nam Ik Cho

Offline optimization has recently emerged as an increasingly popular approach to mitigate the prohibitively expensive cost of online experimentation. The key idea is to learn a surrogate of the black-box function that underlines the target…

Machine Learning · Computer Science 2025-03-07 Manh Cuong Dao , Phi Le Nguyen , Thao Nguyen Truong , Trong Nghia Hoang

For stochastic process models, parameter inference is often severely bottlenecked by computationally expensive likelihood functions. Simulation-based inference (SBI) bypasses this restriction by constructing amortized surrogate likelihoods,…

Machine Learning · Statistics 2026-05-26 Alexander Shen , Mikael Kuusela

Spectroscopic photoacoustic (sPA) imaging uses multiple wavelengths to differentiate chromophores based on their unique optical absorption spectra. This technique has been widely applied in areas such as vascular mapping, tumor detection,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Fangzhou Lin , Shang Gao , Yichuan Tang , Xihan Ma , Ryo Murakami , Ziming Zhang , John D. Obayemi , Winston W. Soboyejo , Haichong K. Zhang
‹ Prev 1 2 3 10 Next ›