English
Related papers

Related papers: Sublinear Maximum Inner Product Search using Conco…

200 papers

Retrieval finds a small number of relevant candidates from a large corpus for information retrieval and recommendation applications. A key component of retrieval is to model (user, item) similarity, which is commonly represented as the dot…

Machine Learning · Computer Science 2023-06-08 Jiaqi Zhai , Zhaojie Gong , Yueming Wang , Xiao Sun , Zheng Yan , Fu Li , Xing Liu

Bayesian optimization (BO) is a model-based approach to sequentially optimize expensive black-box functions, such as the validation error of a deep neural network with respect to its hyperparameters. In many real-world scenarios, the…

Machine Learning · Statistics 2019-10-17 Valerio Perrone , Iaroslav Shcherbatyi , Rodolphe Jenatton , Cedric Archambeau , Matthias Seeger

Subspace optimization methods have the attractive property of reducing large-scale optimization problems to a sequence of low-dimensional subspace optimization problems. However, existing subspace optimization frameworks adopt a fixed…

Optimization and Control · Mathematics 2022-03-03 Yoni Choukroun , Michael Katz

There exists a broad class of sequencing problems, for example, in proteins and polymers that can be formulated as a heuristic search algorithm that involve decision making akin to a computer game. AI gaming algorithms such as Monte Carlo…

Soft Condensed Matter · Physics 2020-06-08 Tarak K Patra , Troy D. Loeffler , Subramanian K R S Sankaranarayanan

The frequent elements problem, a key component in demanding stream-data analytics, involves selecting elements whose occurrence exceeds a user-specified threshold. Fast, memory-efficient $\epsilon$-approximate synopsis algorithms select all…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-04 Victor Jarlow , Charalampos Stylianopoulos , Marina Papatriantafilou

In this paper, we explore a general-purpose heuristic algorithm for finding high-quality solutions to continuous optimization problems. The method, called continuous extremal optimization(CEO), can be considered as an extension of extremal…

Materials Science · Physics 2009-11-10 Tao Zhou , Wen-Jie Bai , Long-Jiu Cheng , Bing-Hong Wang

Neyshabur and Srebro proposed Simple-LSH, which is the state-of-the-art hashing method for maximum inner product search (MIPS) with performance guarantee. We found that the performance of Simple-LSH, in both theory and practice, suffers…

Machine Learning · Computer Science 2018-10-23 Xiao Yan , Jinfeng Li , Xinyan Dai , Hongzhi Chen , James Cheng

Many emerging use cases of data mining and machine learning operate on large datasets with data from heterogeneous sources, specifically with both sparse and dense components. For example, dense deep neural network embedding vectors are…

Machine Learning · Computer Science 2019-03-22 Xiang Wu , Ruiqi Guo , David Simcha , Dave Dopson , Sanjiv Kumar

Database-search algorithms, that deduce peptides from Mass Spectrometry (MS) data, have tried to improve the computational efficiency to accomplish larger, and more complex systems biology studies. Existing serial, and high-performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-08 Muhammad Haseeb , Fahad Saeed

The problem of {\em efficiently} finding the best match for a query in a given set with respect to the Euclidean distance or the cosine similarity has been extensively studied in literature. However, a closely related problem of efficiently…

Computational Geometry · Computer Science 2021-06-24 Parikshit Ram , Alexander G. Gray

Black-box policy optimization is a class of reinforcement learning algorithms that explores and updates the policies at the parameter level. This class of algorithms is widely applied in robotics with movement primitives or…

Machine Learning · Computer Science 2022-03-22 Marius Memmel , Puze Liu , Davide Tateo , Jan Peters

Given multiple non-convex objective functions and objective-specific weights, Chebyshev scalarization (CS) is a well-known approach to obtain an Exact Pareto Optimal (EPO), i.e., a solution on the Pareto front (PF) that intersects the ray…

Machine Learning · Computer Science 2023-09-19 Debabrata Mahapatra , Vaibhav Rajan

Recently it was shown that the problem of Maximum Inner Product Search (MIPS) is efficient and it admits provably sub-linear hashing algorithms. Asymmetric transformations before hashing were the key in solving MIPS which was otherwise…

Machine Learning · Statistics 2014-11-14 Anshumali Shrivastava , Ping Li

This paper presents a novel extended dynamic programming approach for energy minimization (EDP) to solve the correspondence problem for stereo and motion. A significant speedup is achieved using a recursive minimum search strategy (RMS).…

Computer Vision and Pattern Recognition · Computer Science 2014-10-30 Mikhail G. Mozerov

We propose an extreme dimension reduction method extending the Extreme-PLS approach to the case where the covariate lies in a possibly infinite-dimensional Hilbert space. The ideas are partly borrowed from both Partial Least-Squares and…

Statistics Theory · Mathematics 2026-01-01 Stéphane Girard , Cambyse Pakzad

Extraordinary amounts of data are being produced in many branches of science. Proven statistical methods are no longer applicable with extraordinary large data sets due to computational limitations. A critical step in big data analysis is…

Methodology · Statistics 2019-06-27 HaiYing Wang , Min Yang , John Stufken

We formulate and optimally solve a new generalized Set Similarity Search problem, which assumes the size of the database and query sets are known in advance. By creating polylog copies of our data-structure, we optimally solve any symmetric…

Data Structures and Algorithms · Computer Science 2020-04-21 Thomas Dybdahl Ahle , Jakob Bæk Tejs Knudsen

High-dimensional design spaces underpin a wide range of physics-based modeling and computational design tasks in science and engineering. These problems are commonly formulated as constrained black-box searches over rugged objective…

Machine Learning · Computer Science 2026-01-13 Suvo Banik , Troy D. Loeffler , Henry Chan , Sukriti Manna , Orcun Yildiz , Tom Peterka , Subramanian Sankaranarayanan

Recommendation problems with large numbers of discrete items, such as products, webpages, or videos, are ubiquitous in the technology industry. Deep neural networks are being increasingly used for these recommendation problems. These models…

Machine Learning · Computer Science 2019-07-11 Manas R. Joglekar , Cong Li , Jay K. Adams , Pranav Khaitan , Quoc V. Le

Product recommendations inherently involve comparisons, yet traditional opinion summarization often fails to provide holistic comparative insights. We propose the novel task of generating Query-Focused Comparative Explainable Summaries…

Computation and Language · Computer Science 2025-07-08 Arnav Attri , Anuj Attri , Pushpak Bhattacharyya , Suman Banerjee , Amey Patil , Muthusamy Chelliah , Nikesh Garera