English
Related papers

Related papers: Lossy compression of matrices by black-box optimis…

200 papers

We propose a method to solve online mixed-integer optimization (MIO) problems at very high speed using machine learning. By exploiting the repetitive nature of online optimization, we are able to greatly speedup the solution time. Our…

Optimization and Control · Mathematics 2021-03-24 Dimitris Bertsimas , Bartolomeo Stellato

We introduce a method combining variational autoencoders (VAEs) and deep metric learning to perform Bayesian optimisation (BO) over high-dimensional and structured input spaces. By adapting ideas from deep metric learning, we use label…

Ising Machine is a promising computing approach for solving combinatorial optimization problems. It is naturally suited for energy-saving and compact in-memory computing implementations with emerging memories. A na\"ive in-memory computing…

Hardware Architecture · Computer Science 2024-01-30 George Higgins Hutchinson , Ethan Sifferman , Tinish Bhattacharya , Dmitri B. Strukov

Bayesian optimization (BO) provides a powerful framework for optimizing black-box, expensive-to-evaluate functions. It is therefore an attractive tool for engineering design problems, typically involving multiple objectives. Thanks to the…

Machine Learning · Computer Science 2024-09-06 Navid Ansari , Alireza Javanmardi , Eyke Hüllermeier , Hans-Peter Seidel , Vahid Babaei

The Internet of Things (IoT) generates vast amounts of heterogeneous data, ranging from sensor readings to log alerts and images, that pose challenges to storage and data transmission in resource-constrained environments. In this context,…

Information Theory · Computer Science 2025-08-13 Vatsala Upadhyay , J. Kokila , Abhishek Vaish

Bayesian optimization (BO) is well known to be sample-efficient for solving black-box problems. However, the BO algorithms can sometimes get stuck in suboptimal solutions even with plenty of samples. Intrinsically, such suboptimal problem…

Machine Learning · Computer Science 2025-01-24 Zhendong Guo , Yew-Soon Ong , Tiantian He , Haitao Liu

A new method is presented which allows time averaged density matrices of closed quantum systems to be computed via a constraint overlap maximization. Due to its simplicity, this method can be combined with algorithms based on tensor…

Quantum Physics · Physics 2015-03-06 Volckmar Nebendahl

Parameter settings profoundly impact the performance of machine learning algorithms and laboratory experiments. The classical grid search or trial-error methods are exponentially expensive in large parameter spaces, and Bayesian…

Machine Learning · Computer Science 2017-04-18 Vu Nguyen , Santu Rana , Sunil Gupta , Cheng Li , Svetha Venkatesh

Bayesian optimisation (BO) uses probabilistic surrogate models - usually Gaussian processes (GPs) - for the optimisation of expensive black-box functions. At each BO iteration, the GP hyperparameters are fit to previously-evaluated data by…

Machine Learning · Computer Science 2021-05-04 George De Ath , Richard Everson , Jonathan Fieldsend

Combinatorial optimization problems are crucial in industry. However, many COPs are NP-hard, causing the search space to grow exponentially with problem size and rendering large-scale instances computationally intractable. Conventional…

Emerging Technologies · Computer Science 2026-02-27 Eiji Kawase , Shuta Kikuchi , Hideaki Tamai , Shu Tanaka

Quantum algorithms have shown promise in solving Quadratic Unconstrained Binary Optimization (QUBO) problems, benefiting from their connection to the transverse field Ising model. Various Ising solvers, both classical and quantum, have…

Optimization and Control · Mathematics 2025-09-16 Zedong Peng , Daniel de Roux , David E. Bernal Neira

In recent years, solving optimization problems involving black-box simulators has become a point of focus for the machine learning community due to their ubiquity in science and engineering. The simulators describe a forward process…

Machine Learning · Computer Science 2024-06-07 Fabio Valerio Massoli , Tim Bakker , Thomas Hehn , Tribhuvanesh Orekondy , Arash Behboodi

This study proposes an approach for removing mislabeled instances from contaminated training datasets by combining surrogate model-based black-box optimization (BBO) with postprocessing and quantum annealing. Mislabeled training instances,…

Machine Learning · Computer Science 2025-10-13 Makoto Otsuka , Kento Kodama , Keisuke Morita , Masayuki Ohzeki

A randomized algorithm for computing a compressed representation of a given rank-structured matrix $A \in \mathbb{R}^{N\times N}$ is presented. The algorithm interacts with $A$ only through its action on vectors. Specifically, it draws two…

Numerical Analysis · Mathematics 2024-06-25 James Levitt , Per-Gunnar Martinsson

Black-box optimization methods play an important role in many fields of computational simulation. In particular, such methods are often used in the design and modelling of biological systems, including proteins and their complexes with…

Biomolecules · Quantitative Biology 2023-02-08 Dmitry Morozov , Artem Melnikov , Vishal Shete , Michael Perelshtein

Many real-world optimisation problems are defined over both categorical and continuous variables, yet efficient optimisation methods such asBayesian Optimisation (BO) are not designed tohandle such mixed-variable search spaces. Recent…

Machine Learning · Statistics 2022-02-18 Yan Zuo , Amir Dezfouli , Iadine Chades , David Alexander , Benjamin Ward Muir

As nowadays Machine Learning (ML) techniques are generating huge data collections, the problem of how to efficiently engineer their storage and operations is becoming of paramount importance. In this article we propose a new lossless…

Data Structures and Algorithms · Computer Science 2022-03-31 Paolo Ferragina , Travis Gagie , Dominik Köppl , Giovanni Manzini , Gonzalo Navarro , Manuel Striani , Francesco Tosoni

Model selection is an integral problem of model based optimization techniques such as Bayesian optimization (BO). Current approaches often treat model selection as an estimation problem, to be periodically updated with observations coming…

Machine Learning · Computer Science 2023-08-02 Manisha Senadeera , Santu Rana , Sunil Gupta , Svetha Venkatesh

Linear computation coding is concerned with the compression of multidimensional linear functions, i.e. with reducing the computational effort of multiplying an arbitrary vector to an arbitrary, but known, constant matrix. This paper…

Information Theory · Computer Science 2025-07-02 Hans Rosenberger , Johanna S. Fröhlich , Ali Bereyhi , Ralf R. Müller

Quantum computing and modern tensor-based computing have a strong connection, which is especially demonstrated by simulating quantum computations with tensor networks. The other direction is less studied: quantum computing is not often…

Quantum Physics · Physics 2025-09-03 Valter Uotila