English
Related papers

Related papers: Faster Black-Box Algorithms Through Higher Arity O…

200 papers

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

Machine Learning · Statistics 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

The structure of data organization is widely recognized as having a substantial influence on the efficacy of machine learning algorithms, particularly in binary classification tasks. Our research provides a theoretical framework suggesting…

Machine Learning · Computer Science 2024-07-15 Fei Jing , Zi-Ke Zhang , Yi-Cheng Zhang , Qingpeng Zhang

We outline refined versions of two major quantum algorithms for performing principal component analysis and solving linear equations. Our methods are exponentially faster than their classical counterparts and even previous quantum…

Quantum Physics · Physics 2025-04-02 Nhat A. Nghiem

The worst-case complexity of group-theoretic algorithms has been studied for a long time. Generic-case complexity, or complexity on random inputs, was introduced and studied relatively recently. In this paper, we address the average-case…

Group Theory · Mathematics 2022-08-12 Vladimir Shpilrain

One way to reduce the time of conducting optimization studies is to evaluate designs in parallel rather than just one-at-a-time. For expensive-to-evaluate black-boxes, batch versions of Bayesian optimization have been proposed. They work by…

Optimization and Control · Mathematics 2023-04-04 Mickael Binois , Nicholson Collier , Jonathan Ozik

In this paper, we establish lower bounds for the oracle complexity of the first-order methods minimizing regularized convex functions. We consider the composite representation of the objective. The smooth part has H\"older continuous…

Optimization and Control · Mathematics 2022-02-10 Nikita Doikov

Submodular function minimization is a key problem in a wide variety of applications in machine learning, economics, game theory, computer vision, and many others. The general solver has a complexity of $O(n^3 \log^2 n . E +n^4 {\log}^{O(1)}…

Data Structures and Algorithms · Computer Science 2017-01-25 Srikumar Ramalingam , Chris Russell , Lubor Ladicky , Philip H. S. Torr

In many classification tasks there is a requirement of monotonicity. Concretely, if all else remains constant, increasing (resp. decreasing) the value of one or more features must not decrease (resp. increase) the value of the prediction.…

Machine Learning · Computer Science 2021-06-02 Joao Marques-Silva , Thomas Gerspacher , Martin Cooper , Alexey Ignatiev , Nina Narodytska

We consider the weakly supervised binary classification problem where the labels are randomly flipped with probability $1- {\alpha}$. Although there exist numerous algorithms for this problem, it remains theoretically unexplored how the…

Machine Learning · Computer Science 2019-07-16 Xinyang Yi , Zhaoran Wang , Zhuoran Yang , Constantine Caramanis , Han Liu

Hypothesis-pruning maximizes the hypothesis updates for active learning to find those desired unlabeled data. An inherent assumption is that this learning manner can derive those updates into the optimal hypothesis. However, its convergence…

Machine Learning · Computer Science 2023-09-21 Xiaofeng Cao , Yaming Guo , Ivor W. Tsang , James T. Kwok

In many optimization problems arising from scientific, engineering and artificial intelligence applications, objective and constraint functions are available only as the output of a black-box or simulation oracle that does not provide…

Optimization and Control · Mathematics 2019-08-15 Jeffrey Larson , Matt Menickelly , Stefan M. Wild

We investigate the computational complexity of several basic linear algebra primitives, including largest eigenvector computation and linear regression, in the computational model that allows access to the data via a matrix-vector product…

Machine Learning · Computer Science 2021-05-25 Mark Braverman , Elad Hazan , Max Simchowitz , Blake Woodworth

We observe that any $T(n)$ time algorithm (quantum or classical) for several central linear algebraic problems, such as computing $\det(A)$, $tr(A^3)$, or $tr(A^{-1})$ for an $n \times n$ integer matrix $A$, yields a $O(T(n)) + \tilde…

Data Structures and Algorithms · Computer Science 2025-09-25 Kyle Doney , Cameron Musco

We present numerical simulations of orbiting black holes for around twelve cycles, using a high-order multipatch approach. Unlike some other approaches, the computational speed scales almost perfectly for thousands of processors. Multipatch…

General Relativity and Quantum Cosmology · Physics 2013-05-29 Enrique Pazos , Manuel Tiglio , Matthew D. Duez , Lawrence E. Kidder , Saul A. Teukolsky

Generating 2-by-2 unitary matrices in floating-precision arithmetic is a delicate task. One way to reduce the accumulation error is to use less floating-point operations to compute each of the entries in the 2-by-2 unitary matrix. This…

Numerical Analysis · Mathematics 2022-11-09 Weslley da Silva Pereira , Ali Lotfi , Julien Langou

It may seem very intuitive that for the maximization of the OneMax problem $\OM(x):=\sum_{i=1}^n{x_i}$ the best that an elitist unary unbiased search algorithm can do is to store a best so far solution, and to modify it with the operator…

Neural and Evolutionary Computing · Computer Science 2021-01-18 Nathan Buskulic , Carola Doerr

We present a simple algorithm for computing higher-order Delaunay mosaics that works in Euclidean spaces of any finite dimensions. The algorithm selects the vertices of the order-$k$ mosaic from incrementally constructed lower-order mosaics…

Computational Geometry · Computer Science 2020-11-10 Herbert Edelsbrunner , Georg Osang

In [1], a new construction called red-black hierarchy characterizing Laman graphs and an algorithm for computing it were presented. For a Laman graph G=(V,E) with n vertices it runs in O(n^2) time assuming that a partition of (V,E+e) into…

Computational Geometry · Computer Science 2008-02-29 Sergey Bereg

We give practical, efficient algorithms that automatically determine the asymptotic distributed round complexity of a given locally checkable graph problem in the $[\Theta(\log n), \Theta(n)]$ region, in two settings. We present one…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-05 Alkida Balliu , Sebastian Brandt , Yi-Jun Chang , Dennis Olivetti , Jan Studený , Jukka Suomela

In this article, we completely determine the isomorphism classes of lattice vertex operator algebras and the vertex operator subalgebras fixed by a lift of the -1-isometry of the lattice. We also provide similar results for certain even…

Quantum Algebra · Mathematics 2011-04-06 Hiroki Shimakura