English
Related papers

Related papers: Faster Black-Box Algorithms Through Higher Arity O…

200 papers

Despite significant empirical and theoretically supported evidence that non-static parameter choices can be strongly beneficial in evolutionary computation, the question how to best adjust parameter values plays only a marginal role in…

Neural and Evolutionary Computing · Computer Science 2018-03-06 Carola Doerr , Markus Wagner

A new class of test functions for black box optimization is introduced. Affine OneMax (AOM) functions are defined as compositions of OneMax and invertible affine maps on bit vectors. The black box complexity of the class is upper bounded by…

Neural and Evolutionary Computing · Computer Science 2021-06-15 Arnaud Berny

We present a self-stabilizing leader election algorithm for arbitrary networks, with space-complexity $O(\max\{\log \Delta, \log \log n\})$ bits per node in $n$-node networks with maximum degree~$\Delta$. This space complexity is…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-27 Lélia Blin , Sébastien Tixeuil

We consider the problem of black-box function optimization over the boolean hypercube. Despite the vast literature on black-box function optimization over continuous domains, not much attention has been paid to learning models for…

We present general methods for simulating black-box Hamiltonians using quantum walks. These techniques have two main applications: simulating sparse Hamiltonians and implementing black-box unitary operations. In particular, we give the best…

Quantum Physics · Physics 2018-08-02 Dominic W. Berry , Andrew M. Childs

The diverse world of machine learning applications has given rise to a plethora of algorithms and optimization methods, finely tuned to the specific regression or classification task at hand. We reduce the complexity of algorithm design for…

Optimization and Control · Mathematics 2016-05-23 Zeyuan Allen-Zhu , Elad Hazan

We consider the problem of testing the commutativity of a black-box group specified by its k generators. The complexity (in terms of k) of this problem was first considered by Pak, who gave a randomized algorithm involving O(k) group…

Quantum Physics · Physics 2018-03-22 Frederic Magniez , Ashwin Nayak

Balliu et al. (DISC 2020) classified the hardness of solving binary labeling problems with distributed graph algorithms; in these problems the task is to select a subset of edges in a $2$-colored tree in which white nodes of degree $d$ and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-20 Henrik Lievonen , Timothé Picavet , Jukka Suomela

Genetic algorithms have unique properties which are useful when applied to black box optimization. Using selection, crossover, and mutation operators, candidate solutions may be obtained without the need to calculate a gradient. In this…

Quantum Physics · Physics 2022-06-23 David Von Dollen , Sheir Yarkoni , Daniel Weimer , Florian Neukart , Thomas Bäck

We present an information-theoretic approach to lower bound the oracle complexity of nonsmooth black box convex optimization, unifying previous lower bounding techniques by identifying a combinatorial problem, namely string guessing, as a…

Optimization and Control · Mathematics 2023-07-10 Gábor Braun , Cristóbal Guzmán , Sebastian Pokutta

The zeta and Moebius transforms over the subset lattice of $n$ elements and the so-called subset convolution are examples of unary and binary operations on set functions. While their direct computation requires $O(3^n)$ arithmetic…

Data Structures and Algorithms · Computer Science 2020-09-02 Mikko Koivisto , Antti Röyskö

Quantum state preparation is an important ingredient for other higher-level quantum algorithms, such as Hamiltonian simulation, or for loading distributions into a quantum device to be used e.g. in the context of optimization tasks such as…

Quantum Physics · Physics 2022-08-10 Johannes Bausch

Large Language Models (LLMs) like BERT have gained significant prominence due to their remarkable performance in various natural language processing tasks. However, they come with substantial computational and memory costs. Additionally,…

Machine Learning · Computer Science 2025-04-22 Luis Balderas , Miguel Lastra , José M. Benítez

We study first-order algorithms that are uniformly stable for empirical risk minimization (ERM) problems that are convex and smooth with respect to $p$-norms, $p \geq 1$. We propose a black-box reduction method that, by employing properties…

Machine Learning · Computer Science 2024-12-23 Simon Vary , David Martínez-Rubio , Patrick Rebeschini

We consider the problem of learning a binary classifier from $n$ different data sources, among which at most an $\eta$ fraction are adversarial. The overhead is defined as the ratio between the sample complexity of learning in this setting…

Machine Learning · Computer Science 2018-05-15 Mingda Qiao

We show that any quantum algorithm deciding whether an input function $f$ from $[n]$ to $[n]$ is 2-to-1 or almost 2-to-1 requires $\Theta(n)$ queries to $f$. The same lower bound holds for determining whether or not a function $f$ from…

Computational Complexity · Computer Science 2012-02-01 Paul Beame , Widad Machmouchi

In this paper, we consider the problem of black box continuous submodular maximization where we only have access to the function values and no information about the derivatives is provided. For a monotone and continuous DR-submodular…

Machine Learning · Computer Science 2020-03-03 Lin Chen , Mingrui Zhang , Hamed Hassani , Amin Karbasi

This paper employs a powerful argument, called an algorithmic argument, to prove lower bounds of the quantum query complexity of a multiple-block ordered search problem in which, given a block number i, we are to find a location of a target…

Quantum Physics · Physics 2016-05-24 Harumichi Nishimura , Tomoyuki Yamakami

In the machine learning algorithms, the choice of the hyperparameter is often an art more than a science, requiring labor-intensive search with expert experience. Therefore, automation on hyperparameter optimization to exclude human…

Machine Learning · Computer Science 2020-12-08 Taehyeon Kim , Jaeyeon Ahn , Nakyil Kim , Seyoung Yun

We study black-box reductions from mechanism design to algorithm design for welfare maximization in settings of incomplete information. Given oracle access to an algorithm for an underlying optimization problem, the goal is to simulate an…

Computer Science and Game Theory · Computer Science 2019-06-27 Evangelia Gergatsouli , Brendan Lucier , Christos Tzamos