中文
相关论文

相关论文: Norm-Ranging LSH for Maximum Inner Product Search

200 篇论文

We show the existence of a Locality-Sensitive Hashing (LSH) family for the angular distance that yields an approximate Near Neighbor Search algorithm with the asymptotically optimal running time exponent. Unlike earlier algorithms with this…

数据结构与算法 · 计算机科学 2015-09-10 Alexandr Andoni , Piotr Indyk , Thijs Laarhoven , Ilya Razenshteyn , Ludwig Schmidt

With the rapid development of GPU (Graphics Processing Unit) technologies and neural networks, we can explore more appropriate data structures and algorithms. Recent progress shows that neural networks can partly replace traditional data…

信息检索 · 计算机科学 2023-10-17 Renyang Liu , Jun Zhao , Xing Chu , Yu Liang , Wei Zhou , Jing He

Locality-sensitive hashing (LSH) is an important tool for managing high-dimensional noisy or uncertain data, for example in connection with data cleaning (similarity join) and noise-robust search (similarity search). However, for a number…

数据结构与算法 · 计算机科学 2018-04-18 Martin Aumüller , Tobias Christiani , Rasmus Pagh , Francesco Silvestri

Retrieval-Augmented Generation (RAG) has revolutionized natural language processing by dynamically integrating external knowledge into Large Language Models (LLMs), addressing their limitation of static training datasets. Recent…

计算与语言 · 计算机科学 2024-09-05 Krish Goel , Mahek Chandak

With the growth of image on the web, research on hashing which enables high-speed image retrieval has been actively studied. In recent years, various hashing methods based on deep neural networks have been proposed and achieved higher…

计算机视觉与模式识别 · 计算机科学 2019-05-23 Yosuke Kaga , Masakazu Fujio , Kenta Takahashi , Tetsushi Ohki , Masakatsu Nishigaki

We propose a methodology at the nexus of operations research and machine learning (ML) leveraging generic approximators available from ML to accelerate the solution of mixed-integer linear two-stage stochastic programs. We aim at solving…

最优化与控制 · 数学 2022-06-14 Eric Larsen , Emma Frejinger , Bernard Gendron , Andrea Lodi

User queries in real-world recommendation systems often combine structured constraints (e.g., category, attributes) with unstructured preferences (e.g., product descriptions or reviews). We introduce HyST (Hybrid retrieval over…

信息检索 · 计算机科学 2025-08-26 Jiyoon Myung , Jihyeon Park , Joohyung Han

Recommendation problems with large numbers of discrete items, such as products, webpages, or videos, are ubiquitous in the technology industry. Deep neural networks are being increasingly used for these recommendation problems. These models…

机器学习 · 计算机科学 2019-07-11 Manas R. Joglekar , Cong Li , Jay K. Adams , Pranav Khaitan , Quoc V. Le

Conventional recommendation systems (RSs) are typically optimized to enhance performance metrics uniformly across all training samples. This makes it hard for data-driven RSs to cater to a diverse set of users due to the varying properties…

信息检索 · 计算机科学 2024-05-03 Kirandeep Kaur , Chirag Shah

The rapid proliferation of computing domains relying on Internet of Things (IoT) devices has created a pressing need for efficient and accurate deep-learning (DL) models that can run on low-power devices. However, traditional DL models tend…

Neural networks trained on real-world datasets with long-tailed label distributions are biased towards frequent classes and perform poorly on infrequent classes. The imbalance in the ratio of positive and negative samples for each class…

计算机视觉与模式识别 · 计算机科学 2021-05-25 Kevin Duarte , Yogesh S. Rawat , Mubarak Shah

Maximum Inner Product Search (MIPS) is a ubiquitous task in machine learning applications such as recommendation systems. Given a query vector and $n$ atom vectors in $d$-dimensional space, the goal of MIPS is to find the atom that has the…

机器学习 · 计算机科学 2023-06-28 Mo Tiwari , Ryan Kang , Je-Yong Lee , Donghyun Lee , Chris Piech , Sebastian Thrun , Ilan Shomorony , Martin Jinye Zhang

To effectively use large language models (LLMs) for real-world queries, it is imperative that they generalize to the long-tail distribution, i.e. rare examples where models exhibit low confidence. In this work, we take the first step…

计算与语言 · 计算机科学 2024-10-07 Huihan Li , Yuting Ning , Zeyi Liao , Siyuan Wang , Xiang Lorraine Li , Ximing Lu , Wenting Zhao , Faeze Brahman , Yejin Choi , Xiang Ren

Hashing has been widely researched to solve the large-scale approximate nearest neighbor search problem owing to its time and storage superiority. In recent years, a number of online hashing methods have emerged, which can update the hash…

数据库 · 计算机科学 2022-12-07 Wenzhe Jia , Yuan Cao , Junwei Liu , Jie Gui

The ability of fast similarity search at large scale is of great importance to many Information Retrieval (IR) applications. A promising way to accelerate similarity search is semantic hashing which designs compact binary codes for a large…

信息检索 · 计算机科学 2010-04-30 Dell Zhang , Jun Wang , Deng Cai , Jinsong Lu

Text-to-SQL prompt strategies based on Large Language Models (LLMs) achieve remarkable performance on well-known benchmarks. However, when applied to real-world databases, their performance is significantly less than for these benchmarks,…

Locality-Sensitive Hashing (LSH) is one of the most popular methods for $c$-Approximate Nearest Neighbor Search ($c$-ANNS) in high-dimensional spaces. In this paper, we propose a novel LSH scheme based on the Longest Circular Co-Substring…

数据库 · 计算机科学 2020-04-14 Yifan Lei , Qiang Huang , Mohan Kankanhalli , Anthony K. H. Tung

Approximate Nearest Neighbor Search (ANNS) is a fundamental algorithmic problem, with numerous applications in many areas of computer science. Locality-sensitive hashing (LSH) is one of the most popular solution approaches for ANNS. A…

数据库 · 计算机科学 2021-03-11 Huayi Wang , Jingfan Meng , Long Gong , Jun Xu , Mitsunori Ogihara

We propose a new class of data-independent locality-sensitive hashing (LSH) algorithms based on the fruit fly olfactory circuit. The fundamental difference of this approach is that, instead of assigning hashes as dense points in a low…

机器学习 · 计算机科学 2018-12-06 Jaiyam Sharma , Saket Navlakha

In large scale systems, approximate nearest neighbour search is a crucial algorithm to enable efficient data retrievals. Recently, deep learning-based hashing algorithms have been proposed as a promising paradigm to enable data dependent…

机器学习 · 计算机科学 2019-02-12 Jo Schlemper , Jose Caballero , Andy Aitken , Joost van Amersfoort