English
Related papers

Related papers: Bigger Is Not Better: The Fastest Static GPU Index…

200 papers

Neural Architecture Search (NAS) aims to facilitate the design of deep networks for new tasks. Existing techniques rely on two stages: searching over the architecture space and validating the best architecture. NAS algorithms are currently…

Machine Learning · Computer Science 2019-11-25 Kaicheng Yu , Christian Sciuto , Martin Jaggi , Claudiu Musat , Mathieu Salzmann

Neural Architecture Search (NAS) is a powerful tool for automating architecture design. One-Shot NAS techniques, such as DARTS, have gained substantial popularity due to their combination of search efficiency with simplicity of…

Machine Learning · Computer Science 2025-05-21 Pavel Rumiantsev , Mark Coates

This paper considers the task of performing binary search under noisy decisions, focusing on the application of target area localization. In the presence of noise, the classical partitioning approach of binary search is prone to error…

Information Theory · Computer Science 2025-05-01 Kaan Buyukkalayci , Merve Karakas , Xinlin Li , Christina Fragouli

Searching for geometric objects that are close in space is a fundamental component of many applications. The performance of search algorithms comes to the forefront as the size of a problem increases both in terms of total object count as…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-30 D. Lebrun-Grandié , A. Prokopenko , B. Turcksin , S. R. Slattery

Recently, several approaches successfully demonstrated that weight-sharing Neural Architecture Search (NAS) can effectively explore a search space of elastic low-rank adapters (LoRA), allowing the parameter-efficient fine-tuning (PEFT) and…

Machine Learning · Computer Science 2024-04-18 J. Pablo Muñoz , Jinjie Yuan , Nilesh Jain

Database query processing requires algorithms for duplicate removal, grouping, and aggregation. Three algorithms exist: in-stream aggregation is most efficient by far but requires sorted input; sort-based aggregation relies on external…

Databases · Computer Science 2022-09-27 Thanh Do , Goetz Graefe , Jeffrey Naughton

We revisit the classical algorithms for searching over sorted sets to introduce an algorithm refinement, called Adaptive Search, that combines the good features of Interpolation search and those of Binary search. W.r.t. Interpolation…

Data Structures and Algorithms · Computer Science 2015-02-16 Biagio Bonasera , Emilio Ferrara , Giacomo Fiumara , Francesco Pagano , Alessandro Provetti

Backbone architectures of most binary networks are well-known floating point architectures such as the ResNet family. Questioning that the architectures designed for floating point networks would not be the best for binary networks, we…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Dahyun Kim , Kunal Pratap Singh , Jonghyun Choi

Binarized Neural Networks (BNNs) significantly reduce the computation and memory demands with binarized weights and activations compared to full-precision NNs. Executing a layer in a BNN on different devices of a heterogeneous…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-13 Leonard David Bereholschi , Ching-Chi Lin , Mikail Yayla , Jian-Jia Chen

The rapid advancement of GPU technology has unlocked powerful parallel processing capabilities, creating new opportunities to enhance classic search algorithms. This hardware has been exploited in best-first search algorithms with neural…

Artificial Intelligence · Computer Science 2025-11-18 Ehsan Futuhi , Nathan R. Sturtevant

Recent years have witnessed the popularity of Graph Neural Networks (GNN) in various scenarios. To obtain optimal data-specific GNN architectures, researchers turn to neural architecture search (NAS) methods, which have made impressive…

Machine Learning · Computer Science 2020-09-08 Huan Zhao , Lanning Wei , Quanming Yao

Differentiable Architecture Search (DARTS) has attracted a lot of attention due to its simplicity and small search costs achieved by a continuous relaxation and an approximation of the resulting bi-level optimization problem. However, DARTS…

Machine Learning · Computer Science 2020-01-29 Arber Zela , Thomas Elsken , Tonmoy Saikia , Yassine Marrakchi , Thomas Brox , Frank Hutter

This paper reviews, analyzes, and proposes a new perspective on the bi-encoder architecture for neural search. While the bi-encoder architecture is widely used due to its simplicity and scalability at test time, it has some notable issues…

Machine Learning · Computer Science 2025-12-29 Hung-Nghiep Tran , Akiko Aizawa , Atsuhiro Takasu

Recently, graph based nearest neighbor search gets more and more popular on large-scale retrieval tasks. The attractiveness of this type of approaches lies in its superior performance over most of the known nearest neighbor search…

Information Retrieval · Computer Science 2019-06-19 Peng-Cheng Lin , Wan-Lei Zhao

While neural architecture search methods have been successful in previous years and led to new state-of-the-art performance on various problems, they have also been criticized for being unstable, being highly sensitive with respect to their…

Machine Learning · Computer Science 2021-07-09 Thomas Elsken , Benedikt Staffler , Arber Zela , Jan Hendrik Metzen , Frank Hutter

This paper has two results. The first is based on the surprising observation that the well-known ``least-recently-used'' paging algorithm and the ``balance'' algorithm for weighted caching are linear-programming primal-dual algorithms. This…

Data Structures and Algorithms · Computer Science 2015-06-02 Neal E. Young

Sorting is a primitive operation that is a building block for countless algorithms. As such, it is important to design sorting algorithms that approach peak performance on a range of hardware architectures. Graphics Processing Units (GPUs)…

Data Structures and Algorithms · Computer Science 2017-03-31 Henri Casanova , John Iacono , Ben Karsin , Nodari Sitchinava , Volker Weichert

Grover adaptive search (GAS) is a quantum exhaustive search algorithm designed to solve binary optimization problems. In this paper, we propose higher-order binary formulations that can simultaneously reduce the numbers of qubits and gates…

Quantum Physics · Physics 2024-05-14 Yuki Sano , Kosuke Mitarai , Naoki Yamamoto , Naoki Ishikawa

Binary search trees (BSTs) are one of the most basic and widely used data structures. The best static tree for serving a sequence of queries (searches) can be computed by dynamic programming. In contrast, when the BSTs are allowed to be…

Data Structures and Algorithms · Computer Science 2023-03-07 Yaniv Sadeh , Haim Kaplan

Approximate nearest neighbor search (ANNS) is a fundamental problem in databases and data mining. A scalable ANNS algorithm should be both memory-efficient and fast. Some early graph-based approaches have shown attractive theoretical…

Machine Learning · Computer Science 2025-07-08 Cong Fu , Chao Xiang , Changxu Wang , Deng Cai