English
Related papers

Related papers: DiskJoin: Large-scale Vector Similarity Join with …

200 papers

We study an indexing architecture to store and search in a database of high-dimensional vectors from the perspective of statistical signal processing and decision theory. This architecture is composed of several memory units, each of which…

Computer Vision and Pattern Recognition · Computer Science 2017-03-03 Ahmet Iscen , Teddy Furon , Vincent Gripon , Michael Rabbat , Hervé Jégou

Background: Virtual Machine (VM) consolidation is an effective technique to improve resource utilization and reduce energy footprint in cloud data centers. It can be implemented in a centralized or a distributed fashion. Distributed VM…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-12 Adnan Ashraf , Benjamin Byholm , Ivan Porres

Graph-based approximate nearest neighbor search (ANNS) algorithms work effectively against large-scale vector retrieval. Among such methods, DiskANN achieves good recall-speed tradeoffs using both DRAM and storage. DiskANN adopts product…

Information Retrieval · Computer Science 2025-02-27 Kento Tatsuno , Daisuke Miyashita , Taiga Ikeda , Kiyoshi Ishiyama , Kazunari Sumiyoshi , Jun Deguchi

Businesses, governmental bodies and NGO's have an ever-increasing amount of data at their disposal from which they try to extract valuable information. Often, this needs to be done not only accurately but also within a short time frame.…

Machine Learning · Computer Science 2021-09-16 Pim Verschuuren , Serena Palazzo , Tom Powell , Steve Sutton , Alfred Pilgrim , Michele Faucci Giannelli

Sequence classification algorithms, such as SVM, require a definition of distance (similarity) measure between two sequences. A commonly used notion of similarity is the number of matches between $k$-mers ($k$-length subsequences) in the…

Data Structures and Algorithms · Computer Science 2017-12-13 Muhammad Farhan , Juvaria Tariq , Arif Zaman , Mudassir Shabbir , Imdad Ullah Khan

A wide variety of large-scale data has been produced in bioinformatics. In response, the need for efficient handling of biomedical big data has been partly met by parallel computing. However, the time demand of many bioinformatics programs…

Genomics · Quantitative Biology 2015-08-11 Sungmin Lee , Hyeyoung Min , Sungroh Yoon

Although support vector machines (SVMs) are theoretically well understood, their underlying optimization problem becomes very expensive, if, for example, hundreds of thousands of samples and a non-linear kernel are considered. Several…

Machine Learning · Statistics 2018-02-09 Philipp Thomann , Ingrid Blaschzyk , Mona Meister , Ingo Steinwart

Many real-world tasks such as recommending videos with the kids tag can be reduced to finding most similar vectors associated with hard predicates. This task, filtered vector search, is challenging as prior state-of-the-art graph-based…

Databases · Computer Science 2025-07-22 Zhaoheng Li , Silu Huang , Wei Ding , Yongjoo Park , Jianjun Chen

The support vector machines (SVM) algorithm is a popular classification technique in data mining and machine learning. In this paper, we propose a distributed SVM algorithm and demonstrate its use in a number of applications. The algorithm…

Machine Learning · Computer Science 2019-05-02 Taiping He , Tao Wang , Ralph Abbey , Joshua Griffin

Many big-data clusters store data in large partitions that support access at a coarse, partition-level granularity. As a result, approximate query processing via row-level sampling is inefficient, often requiring reads of many partitions.…

Databases · Computer Science 2020-08-25 Kexin Rong , Yao Lu , Peter Bailis , Srikanth Kandula , Philip Levis

Research on learned cardinality estimation has made significant progress in recent years. However, existing methods still face distinct challenges that hinder their practical deployment in production environments. We define these challenges…

Databases · Computer Science 2025-09-10 Kaixin Zhang , Hongzhi Wang , Ziqi Li , Yabin Lu , Yingze Li , Yu Yan , Yiming Guan

Multivector retrieval models achieve state-of-the-art effectiveness through fine-grained token-level representations, but their deployment incurs substantial computational and memory costs. Current solutions, based on the well-known k-means…

Information Retrieval · Computer Science 2026-05-01 Silvio Martinico , Franco Maria Nardini , Cosimo Rulli , Rossano Venturini

We design and implement two single-pass semi-streaming algorithms for the maximum weight $k$-disjoint matching ($k$-DM) problem. Given an integer $k$, the $k$-DM problem is to find $k$ pairwise edge-disjoint matchings such that the sum of…

Data Structures and Algorithms · Computer Science 2024-07-09 S M Ferdous , Bhargav Samineni , Alex Pothen , Mahantesh Halappanavar , Bala Krishnamoorthy

We present a new algorithm for the widely used density-based clustering method DBscan. Our algorithm computes the DBscan-clustering in $O(n\log n)$ time in $\mathbb{R}^2$, irrespective of the scale parameter $\varepsilon$ (and assuming the…

Computational Geometry · Computer Science 2017-03-01 Mark de Berg , Ade Gunawan , Marcel Roeloffzen

Although vision transformers (ViTs) have shown promising results in various computer vision tasks recently, their high computational cost limits their practical applications. Previous approaches that prune redundant tokens have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Siyuan Wei , Tianzhu Ye , Shen Zhang , Yao Tang , Jiajun Liang

Due to the significant increase in the size of spatial data, it is essential to use distributed parallel processing systems to efficiently analyze spatial data. In this paper, we first study learned spatial data partitioning, which…

Databases · Computer Science 2023-06-21 Keizo Hori , Yuya Sasaki , Daichi Amagata , Yuki Murosaki , Makoto Onizuka

The performance and capacity of solid-state drives (SSDs) are continuously improving to meet the increasing demands of modern data-intensive applications. Unfortunately, communication between the SSD controller and memory chips (e.g., 2D/3D…

Similarity search retrieves the nearest neighbors of a query vector from a dataset of high-dimensional vectors. As the size of the dataset grows, the cost of performing the distance computations needed to implement a query can become…

Machine Learning · Computer Science 2019-12-20 Soroosh Khoram , Stephen J Wright , Jing Li

Similarity search based on a distance function in metric spaces is a fundamental problem for many applications. Queries for similar objects lead to the well-known machine learning task of nearest-neighbours identification. Many data…

Information Retrieval · Computer Science 2022-08-05 Felipe Ortega , Maria Jesus Algar , Isaac Martín de Diego , Javier M. Moguerza

In the recent decade companies started collecting of large amount of data. Without a proper analyse, the data are usually useless. The field of analysing the data is called data mining. Unfortunately, the amount of data is quite large: the…

Databases · Computer Science 2021-08-12 Robert Kessl
‹ Prev 1 8 9 10 Next ›