English
Related papers

Related papers: Probabilistic Approach to Black-Box Binary Optimiz…

200 papers

Bayesian optimization works effectively optimizing parameters in black-box problems. However, this method did not work for high-dimensional parameters in limited trials. Parameters can be efficiently explored by nonlinearly embedding them…

Machine Learning · Computer Science 2022-06-14 Shoki Miyagawa , Atsuyoshi Yano , Naoko Sawada , Isamu Ogawa

Black box optimization requires specifying a search space to explore for solutions, e.g. a d-dimensional compact space, and this choice is critical for getting the best results at a reasonable budget. Unfortunately, determining a high…

Machine Learning · Computer Science 2021-12-20 Setareh Ariafar , Justin Gilmer , Zachary Nado , Jasper Snoek , Rodolphe Jenatton , George E. Dahl

We present a novel probabilistic approach for optimal path experimental design. In this approach a discrete path optimization problem is defined on a static navigation mesh, and trajectories are modeled as random variables governed by a…

Optimization and Control · Mathematics 2026-01-19 Ahmed Attia

In this work we are interested in the construction of numerical methods for high dimensional constrained nonlinear optimization problems by particle-based gradient-free techniques. A consensus-based optimization (CBO) approach combined with…

Optimization and Control · Mathematics 2021-11-23 Giacomo Borghi , Michael Herty , Lorenzo Pareschi

In this paper, we propose a robust optimization-based heuristic algorithm for the chance-constrained binary knapsack problem (CKP). We assume that the weights of items are independent normally distributed. By utilizing the properties of the…

Optimization and Control · Mathematics 2018-11-06 Seulgi Joung , Kyungsik Lee

In this paper a class of optimization problems with uncertain linear constraints is discussed. It is assumed that the constraint coefficients are random vectors whose probability distributions are only partially known. Possibility theory is…

Optimization and Control · Mathematics 2021-11-30 Romain Guillaume , Adam Kasperski , Pawel Zielinski

Policymakers in resource-constrained settings require experimental designs that satisfy strict budget limits while ensuring precise estimation of treatment effects. We propose a framework that applies a dependent randomized rounding…

Machine Learning · Statistics 2025-06-17 Khurram Yamin , Edward Kennedy , Bryan Wilder

Binary optimisation tasks are ubiquitous in areas ranging from logistics to cryptography. The exponential complexity of such problems means that the performance of traditional computational methods decreases rapidly with increasing problem…

This paper considers the design of optimal resource allocation policies in wireless communication systems which are generically modeled as a functional optimization problem with stochastic constraints. These optimization problems have the…

Machine Learning · Computer Science 2022-02-08 Mark Eisen , Clark Zhang , Luiz F. O. Chamon , Daniel D. Lee , Alejandro Ribeiro

The \emph{sensor placement problem} for stochastic linear inverse problems consists of determining the optimal manner in which sensors can be employed to collect data. Specifically, one wishes to place a limited number of sensors over a…

Optimization and Control · Mathematics 2025-10-15 Christian Aarset

In this paper, an optimization problem with uncertain constraint coefficients is considered. Possibility theory is used to model the uncertainty. Namely, a joint possibility distribution in constraint coefficient realizations, called…

Optimization and Control · Mathematics 2023-09-07 Romain Guillaume , Adam Kasperski , Pawel Zielinski

We consider chance-constrained binary knapsack problems, where the weights of items are independent random variables with the means and standard deviations known. The chance constraint can be reformulated as a second-order cone constraint…

Optimization and Control · Mathematics 2021-05-26 Jaehyeon Ryu , Sungsoo Park

Optimization problems with uncertain black-box constraints, modeled by warped Gaussian processes, have recently been considered in the Bayesian optimization setting. This work introduces a new class of constraints in which the same…

Optimization and Control · Mathematics 2020-06-16 Johannes Wiebe , Inês Cecílio , Jonathan Dunlop , Ruth Misener

The F-measure, which has originally been introduced in information retrieval, is nowadays routinely used as a performance metric for problems such as binary classification, multi-label classification, and structured output prediction.…

Machine Learning · Statistics 2015-03-09 Willem Waegeman , Krzysztof Dembczynski , Arkadiusz Jachnik , Weiwei Cheng , Eyke Hullermeier

Identifying cause-effect relations among variables is a key step in the decision-making process. While causal inference requires randomized experiments, researchers and policymakers are increasingly using observational studies to test…

Optimization and Control · Mathematics 2021-11-22 Md Saiful Islam , Md Sarowar Morshed , Md. Noor-E-Alam

Probabilistic conditioning is concerned with the identification of a distribution of a random variable $X$ given a random variable $Y$. It is a cornerstone of scientific and engineering applications where modeling uncertainty is key. This…

Machine Learning · Statistics 2026-05-13 Panos Tsimpos , Edoardo Calvello , Ayoub Belhadji , Nicholas H. Nelsen

Probabilistic control design is founded on the principle that a rational agent attempts to match modelled with an arbitrary desired closed-loop system trajectory density. The framework was originally proposed as a tractable alternative to…

Machine Learning · Computer Science 2023-11-16 Tom Lefebvre

In this work, we study a new approach to optimizing the margin distribution realized by binary classifiers. The classical approach to this problem is simply maximization of the expected margin, while more recent proposals consider…

Machine Learning · Statistics 2018-10-12 Matthew J. Holland

We consider black-box optimization in which only an extremely limited number of function evaluations, on the order of around 100, are affordable and the function evaluations must be performed in even fewer batches of a limited number of…

Machine Learning · Computer Science 2021-03-19 Carlos Ansotegui , Meinolf Sellmann , Tapan Shah , Kevin Tierney

Binary optimization is a central problem in mathematical optimization and its applications are abundant. To solve this problem, we propose a new class of continuous optimization techniques which is based on Mathematical Programming with…

Optimization and Control · Mathematics 2017-12-07 Ganzhao Yuan , Bernard Ghanem