中文
相关论文

相关论文: Training Logistic Regression and SVM on 200GB Data…

200 篇论文

In this paper, we first demonstrate that b-bit minwise hashing, whose estimators are positive definite kernels, can be naturally integrated with learning algorithms such as SVM and logistic regression. We adopt a simple scheme to transform…

机器学习 · 统计学 2011-06-07 Ping Li , Anshumali Shrivastava , Joshua Moore , Arnd Christian Konig

In this paper, we study several critical issues which must be tackled before one can apply b-bit minwise hashing to the volumes of data often used industrial applications, especially in the context of search. 1. (b-bit) Minwise hashing…

信息检索 · 计算机科学 2012-05-15 Ping Li , Anshumali Shrivastava , Arnd Christian Konig

In this paper, we propose to (seamlessly) integrate b-bit minwise hashing with linear SVM to substantially improve the training (and testing) efficiency using much smaller memory, with essentially no loss of accuracy. Theoretically, we…

机器学习 · 计算机科学 2015-03-19 Ping Li , Joshua Moore , Christian Konig

Recently, the method of b-bit minwise hashing has been applied to large-scale linear learning and sublinear time near-neighbor search. The major drawback of minwise hashing is the expensive preprocessing cost, as the method requires…

机器学习 · 计算机科学 2012-08-08 Ping Li , Art Owen , Cun-Hui Zhang

Minwise hashing is the standard technique in the context of search and databases for efficiently estimating set (e.g., high-dimensional 0/1 vector) similarities. Recently, b-bit minwise hashing was proposed which significantly improves upon…

机器学习 · 统计学 2011-08-04 Ping Li , Christian Konig

This paper establishes the theoretical framework of b-bit minwise hashing. The original minwise hashing method has become a standard technique for estimating set similarity (e.g., resemblance) with applications in information retrieval,…

数据结构与算法 · 计算机科学 2009-10-20 Ping Li , Arnd Christian Konig

Many hashing algorithms including minwise hashing (MinHash), one permutation hashing (OPH), and consistent weighted sampling (CWS) generate integers of $B$ bits. With $k$ hashes for each data vector, the storage would be $B\times k$ bits;…

机器学习 · 计算机科学 2023-06-29 Ping Li , Weijie Zhao

Large-scale regression problems where both the number of variables, $p$, and the number of observations, $n$, may be large and in the order of millions or more, are becoming increasingly more common. Typically the data are sparse: only a…

统计理论 · 数学 2018-02-27 Rajen D. Shah , Nicolai Meinshausen

Weighted minwise hashing (WMH) is one of the fundamental subroutine, required by many celebrated approximation algorithms, commonly adopted in industrial practice for large scale-search and learning. The resource bottleneck of the…

数据结构与算法 · 计算机科学 2016-02-29 Anshumali Shrivastava

Minwise hashing is a fundamental and one of the most successful hashing algorithm in the literature. Recent advances based on the idea of densification~\cite{Proc:OneHashLSH_ICML14,Proc:Shrivastava_UAI14} have shown that it is possible to…

数据结构与算法 · 计算机科学 2017-03-16 Anshumali Shrivastava

Weighted minwise hashing is a standard dimensionality reduction technique with applications to similarity search and large-scale kernel machines. We introduce a simple algorithm that takes a weighted set $x \in \mathbb{R}_{\geq 0}^{d}$ and…

数据结构与算法 · 计算机科学 2020-05-26 Tobias Christiani

Deep convolutional neural networks (CNNs) have shown appealing performance on various computer vision tasks in recent years. This motivates people to deploy CNNs to realworld applications. However, most of state-of-art CNNs require large…

计算机视觉与模式识别 · 计算机科学 2018-02-09 Qinghao Hu , Peisong Wang , Jian Cheng

Binary codes have been widely used in vision problems as a compact feature representation to achieve both space and time advantages. Various methods have been proposed to learn data-dependent hash functions which map a feature vector to a…

计算机视觉与模式识别 · 计算机科学 2014-10-22 Jie Feng , Wei Liu , Yan Wang

The Min-Hashing approach to sketching has become an important tool in data analysis, information retrial, and classification. To apply it to real-valued datasets, the ICWS algorithm has become a seminal approach that is widely used, and…

机器学习 · 统计学 2018-10-24 Edward Raff , Jared Sylvester , Charles Nicholas

Deep supervised hashing has emerged as an influential solution to large-scale semantic image retrieval problems in computer vision. In the light of recent progress, convolutional neural network based hashing methods typically seek pair-wise…

计算机视觉与模式识别 · 计算机科学 2018-03-13 Xuefei Zhe , Shifeng Chen , Hong Yan

Minwise hashing has become a standard tool to calculate signatures which allow direct estimation of Jaccard similarities. While very efficient algorithms already exist for the unweighted case, the calculation of signatures for weighted sets…

数据结构与算法 · 计算机科学 2018-07-24 Otmar Ertl

Image similarity measures play an important role in nearest neighbor search and duplicate detection for large-scale image datasets. Recently, Minwise Hashing (or Minhash) and its related hashing algorithms have achieved great performances…

多媒体 · 计算机科学 2018-07-11 Jun Long , Qunfeng Liu , Xinpan Yuan , Chengyuan Zhang , Junfeng Liu

Perfect hash functions can potentially be used to compress data in connection with a variety of data management tasks. Though there has been considerable work on how to construct good perfect hash functions, there is a gap between theory…

数据结构与算法 · 计算机科学 2007-05-23 Fabiano C. Botelho , Rasmus Pagh , Nivio Ziviani

Hashing has emerged as a popular technique for large-scale similarity search. Most learning-based hashing methods generate compact yet correlated hash codes. However, this redundancy is storage-inefficient. Hence we propose a lossless…

计算机视觉与模式识别 · 计算机科学 2016-03-18 Honghai Yu , Pierre Moulin , Hong Wei Ng , Xiaoli Li

The min-max kernel is a generalization of the popular resemblance kernel (which is designed for binary data). In this paper, we demonstrate, through an extensive classification study using kernel machines, that the min-max kernel often…

机器学习 · 统计学 2015-03-06 Ping Li
‹ 上一页 1 2 3 10 下一页 ›