English
Related papers

Related papers: A "black-box" re-weighting analysis can correct fl…

200 papers

Black-box optimization (BBO) can be used to optimize functions whose analytic form is unknown. A common approach to realising BBO is to learn a surrogate model which approximates the target black-box function which can then be solved via…

Machine Learning · Computer Science 2023-02-10 Jonas Nüßlein , Christoph Roch , Thomas Gabor , Jonas Stein , Claudia Linnhoff-Popien , Sebastian Feld

Subsampling algorithms for various parametric regression models with massive data have been extensively investigated in recent years. However, all existing studies on subsampling heavily rely on clean massive data. In practical…

Statistics Theory · Mathematics 2025-06-11 Jiangshan Ju , Mingqiu Wang , Shengli Zhao

Efficient sampling from the Boltzmann distribution given its energy function is a key challenge for modeling complex physical systems such as molecules. Boltzmann Generators address this problem by leveraging continuous normalizing flows to…

Machine Learning · Computer Science 2025-10-17 Rishal Aggarwal , Jacky Chen , Nicholas M. Boffi , David Ryan Koes

Black-box optimization is a powerful approach for discovering global optima in noisy and expensive black-box functions, a problem widely encountered in real-world scenarios. Recently, there has been a growing interest in leveraging domain…

Machine Learning · Computer Science 2024-02-06 Dat Phan-Trong , Hung The Tran , Alistair Shilton , Sunil Gupta

The performance of many algorithms in the fields of hard combinatorial problem solving, machine learning or AI in general depends on tuned hyperparameter configurations. Automated methods have been proposed to alleviate users from the…

Machine Learning · Computer Science 2019-08-23 André Biedenkapp , H. Furkan Bozkurt , Frank Hutter , Marius Lindauer

Aggregating multiple learners through an ensemble of models aim to make better predictions by capturing the underlying distribution of the data more accurately. Different ensembling methods, such as bagging, boosting, and stacking/blending,…

Machine Learning · Statistics 2020-11-03 Mohsen Shahhosseini , Guiping Hu , Hieu Pham

We present a fully probabilistic approach for solving binary optimization problems with black-box objective functions and with budget constraints. In the probabilistic approach, the optimization variable is viewed as a random variable and…

Optimization and Control · Mathematics 2024-06-11 Ahmed Attia

When solving optimization problems with black-box approaches, the algorithms gather valuable information about the problem instance during the optimization process. This information is used to adjust the distributions from which new…

Neural and Evolutionary Computing · Computer Science 2023-01-13 Dominik Schröder , Diederick Vermetten , Hao Wang , Carola Doerr , Thomas Bäck

We initiate the study of proper losses for evaluating generative models in the discrete setting. Unlike traditional proper losses, we treat both the generative model and the target distribution as black-boxes, only assuming ability to draw…

Machine Learning · Computer Science 2022-11-08 Rafael Frongillo , Dhamma Kimpara , Bo Waggoner

When gradient-based methods are impractical, black-box optimization (BBO) provides a valuable alternative. However, BBO often struggles with high-dimensional problems and limited trial budgets. In this work, we propose a novel approach…

Systems and Control · Electrical Eng. & Systems 2025-10-03 Riccardo Busetto , Manas Mejari , Marco Forgione , Alberto Bemporad , Dario Piga

Bayesian Optimization is a popular approach for optimizing expensive black-box functions. Its key idea is to use a surrogate model to approximate the objective and, importantly, quantify the associated uncertainty that allows a sequential…

Machine Learning · Statistics 2025-02-05 Haoxian Chen , Henry Lam

We propose a practical Bayesian optimization method over sets, to minimize a black-box function that takes a set as a single input. Because set inputs are permutation-invariant, traditional Gaussian process-based Bayesian optimization…

Machine Learning · Statistics 2021-01-26 Jungtaek Kim , Michael McCourt , Tackgeun You , Saehoon Kim , Seungjin Choi

Black-box optimization (BBO) algorithms are concerned with finding the best solutions for problems with missing analytical details. Most classical methods for such problems are based on strong and fixed a priori assumptions, such as…

Machine Learning · Computer Science 2023-02-01 Minfang Lu , Shuai Ning , Shuangrong Liu , Fengyang Sun , Bo Zhang , Bo Yang , Lin Wang

In molecular dynamics simulations under periodic boundary conditions, particle positions are typically wrapped into a reference box. For diffusion coefficient calculations using the Einstein relation, the particle positions need to be…

Computational Physics · Physics 2020-08-26 Sören von Bülow , Jakob Tómas Bullerjahn , Gerhard Hummer

Many machine learning algorithms and classifiers are available only via API queries as a ``black-box'' -- that is, the downstream user has no ability to change, re-train, or fine-tune the model on a particular target distribution. Indeed,…

Machine Learning · Computer Science 2025-03-05 Siddartha Devic , Nurendra Choudhary , Anirudh Srinivasan , Sahika Genc , Branislav Kveton , Gaurush Hiranandani

Matrix sketching is a recently developed data compression technique. An input matrix A is efficiently approximated with a smaller matrix B, so that B preserves most of the properties of A up to some guaranteed approximation ratio. In so…

Machine Learning · Statistics 2019-12-03 Roberta Falcone , Angela Montanari , Laura Anderlucci

This paper presents a theoretical analysis of sample selection bias correction. The sample bias correction technique commonly used in machine learning consists of reweighting the cost of an error on each training point of a biased sample to…

Machine Learning · Computer Science 2008-12-18 Corinna Cortes , Mehryar Mohri , Michael Riley , Afshin Rostamizadeh

Data-efficient learning algorithms are essential in many practical applications for which data collection is expensive, e.g., for the optimal deployment of wireless systems in unknown propagation scenarios. Meta-learning can address this…

Machine Learning · Computer Science 2022-05-25 Ivana Nikoloska , Osvaldo Simeone

Imbalanced class distribution is a common problem in a number of fields including medical diagnostics, fraud detection, and others. It causes bias in classification algorithms leading to poor performance on the minority class data. In this…

Machine Learning · Computer Science 2020-09-23 Firuz Kamalov , Dmitry Denisov

(Artificial) neural networks have become increasingly popular in mechanics to accelerate computations with model order reduction techniques and as universal models for a wide variety of materials. However, the major disadvantage of neural…

Machine Learning · Computer Science 2021-07-13 Arnd Koeppe , Franz Bamer , Michael Selzer , Britta Nestler , Bernd Markert