English
Related papers

Related papers: Frequent-Itemset Mining using Locality-Sensitive H…

200 papers

We show an optimal data-dependent hashing scheme for the approximate near neighbor problem. For an $n$-point data set in a $d$-dimensional space our data structure achieves query time $O(d n^{\rho+o(1)})$ and space $O(n^{1+\rho+o(1)} +…

Data Structures and Algorithms · Computer Science 2015-07-17 Alexandr Andoni , Ilya Razenshteyn

This paper presents a study of the characteristics of transactional databases used in frequent itemset mining. Such characterizations have typically been used to benchmark and understand the data mining algorithms working on these…

Databases · Computer Science 2020-11-10 Christian Lezcano , Marta Arias

Mixture models and topic models generate each observation from a single cluster, but standard variational posteriors for each observation assign positive probability to all possible clusters. This requires dense storage and runtime costs…

Machine Learning · Statistics 2017-11-15 Michael C. Hughes , Erik B. Sudderth

Mining association rules is a task of data mining, which extracts knowledge in the form of significant implication relation of useful items (objects) from a database. Mining multilevel association rules uses concept hierarchies, also called…

Databases · Computer Science 2010-12-30 Mohamed Salah Gouider , Amine Farhat

Root cause analysis in a large-scale production environment is challenging due to the complexity of services running across global data centers. Due to the distributed nature of a large-scale system, the various hardware, software, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-30 Fred Lin , Keyur Muzumdar , Nikolay Pavlovich Laptev , Mihai-Valentin Curelea , Seunghak Lee , Sriram Sankar

Recognition tasks, such as object recognition and keypoint estimation, have seen widespread adoption in recent years. Most state-of-the-art methods for these tasks use deep networks that are computationally expensive and have huge memory…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Sharath Girish , Shishira R. Maiya , Kamal Gupta , Hao Chen , Larry Davis , Abhinav Shrivastava

The indexing algorithms for the high-dimensional nearest neighbor search (NNS) with the best worst-case guarantees are based on the randomized Locality Sensitive Hashing (LSH), and its derivatives. In practice, many heuristic approaches…

Data Structures and Algorithms · Computer Science 2022-07-08 Alexandr Andoni , Daniel Beaglehole

In supervised binary hashing, one wants to learn a function that maps a high-dimensional feature vector to a vector of binary codes, for application to fast image retrieval. This typically results in a difficult optimization problem,…

Machine Learning · Computer Science 2016-02-08 Ramin Raziperchikolaei , Miguel Á. Carreira-Perpiñán

Large-scale Hierarchical Classification (HC) involves datasets consisting of thousands of classes and millions of training instances with high-dimensional features posing several big data challenges. Feature selection that aims to select…

Machine Learning · Computer Science 2017-06-07 Azad Naik , Huzefa Rangwala

In this paper, we propose a new practical association rule mining algorithm for anomaly detection in Intrusion Detection System (IDS). First, with a view of anomaly cases being relatively rarely occurred in network packet database, we…

Cryptography and Security · Computer Science 2016-10-17 Hyeok Kong , Cholyong Jong , Unhyok Ryang

Locality-sensitive hashing (LSH), introduced by Indyk and Motwani in STOC '98, has been an extremely influential framework for nearest neighbor search in high-dimensional data sets. While theoretical work has focused on the approximate…

Data Structures and Algorithms · Computer Science 2018-12-07 Tobias Christiani , Rasmus Pagh , Mikkel Thorup

We present a new algorithm for the approximate near neighbor problem that combines classical ideas from group testing with locality-sensitive hashing (LSH). We reduce the near neighbor search problem to a group testing problem by…

Data Structures and Algorithms · Computer Science 2021-06-23 Joshua Engels , Benjamin Coleman , Anshumali Shrivastava

We present a simple but powerful reinterpretation of kernelized locality-sensitive hashing (KLSH), a general and popular method developed in the vision community for performing approximate nearest-neighbor searches in an arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2014-11-18 Ke Jiang , Qichao Que , Brian Kulis

We propose an asymmetric affinity score for representing the complexity of utilizing the knowledge of one task for learning another one. Our method is based on the maximum bipartite matching algorithm and utilizes the Fisher Information…

Machine Learning · Computer Science 2022-01-25 Cat P. Le , Juncheng Dong , Mohammadreza Soltani , Vahid Tarokh

Finding high-importance patterns in data is an emerging data mining task known as High-utility itemset mining (HUIM). Given a minimum utility threshold, a HUIM algorithm extracts all the high-utility itemsets (HUIs) whose utility values are…

Databases · Computer Science 2023-03-28 Shan Huang , Wensheng Gan , Jinbao Miao , Xuming Han , Philippe Fournier-Viger

Due to the superiority in similarity computation and database storage for large-scale multiple modalities data, cross-modal hashing methods have attracted extensive attention in similarity retrieval across the heterogeneous modalities.…

Information Retrieval · Computer Science 2020-01-15 Lu Wang , Jie Yang

We present Sampled Weighted Min-Hashing (SWMH), a randomized approach to automatically mine topics from large-scale corpora. SWMH generates multiple random partitions of the corpus vocabulary based on term co-occurrence and agglomerates…

Machine Learning · Computer Science 2015-09-09 Gibran Fuentes-Pineda , Ivan Vladimir Meza-Ruiz

The gradual patterns that model the complex co-variations of attributes of the form "The more/less X, The more/less Y" play a crucial role in many real world applications where the amount of numerical data to manage is important, this is…

Machine Learning · Computer Science 2020-05-25 Michaël Chirmeni Boujike , Jerry Lonlac , Norbert Tsopze , Engelbert Mephu Nguifo

The increasing nature of World Wide Web has imposed great challenges for researchers in improving the search efficiency over the internet. Now days web document clustering has become an important research topic to provide most relevant…

Databases · Computer Science 2012-07-13 P. Rajesh , G. Narasimha , N. Saisumanth

As advances in technology allow for the collection, storage, and analysis of vast amounts of data, the task of screening and assessing the significance of discovered patterns is becoming a major challenge in data mining applications. In…

Databases · Computer Science 2010-02-08 Adam Kirsch , Michael Mitzenmacher , Andrea Pietracaprina , Geppino Pucci , Eli Upfal , Fabio Vandin