English
Related papers

Related papers: Computing n-Gram Statistics in MapReduce

200 papers

Distributed data aggregation is an important task, allowing the decentralized determination of meaningful global properties, that can then be used to direct the execution of other applications. The resulting values result from the…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-10-05 Paulo Jesus , Carlos Baquero , Paulo Sérgio Almeida

Recently proposed Skip-gram model is a powerful method for learning high-dimensional word representations that capture rich semantic relationships between words. However, Skip-gram as well as most prior work on learning word representations…

Computation and Language · Computer Science 2015-11-17 Sergey Bartunov , Dmitry Kondrashkin , Anton Osokin , Dmitry Vetrov

Retrieving the most similar objects in a large-scale database for a given query is a fundamental building block in many application domains, ranging from web searches, visual, cross media, and document retrievals. State-of-the-art…

Machine Learning · Computer Science 2018-03-15 Muge Li , Liangyue Li , Feiping Nie

This article presents effective (dynamic) algorithm for solving a problem of counting the number of substrings of given string which are also substrings of second string. Presented algorithm can be used for example for quick calculation of…

Data Structures and Algorithms · Computer Science 2012-09-24 Stanisław Goldstein , Piotr Beling

Subgraph counting is a fundamental problem in understanding and analyzing graph structured data, yet computationally challenging. This calls for an accurate and efficient algorithm for Subgraph Cardinality Estimation, which is to estimate…

Databases · Computer Science 2024-04-16 Wonseok Shin , Siwoo Song , Kunsoo Park , Wook-Shin Han

Sampling technique has become one of the recent research focuses in the graph-related fields. Most of the existing graph sampling algorithms tend to sample the high degree or low degree nodes in the complex networks because of the…

Social and Information Networks · Computer Science 2018-02-02 Junpeng Zhu , Hui Li , Mei Chen , Zhenyu Dai , Ming Zhu

Automatic text summarization aims to cut down readers time and cognitive effort by reducing the content of a text document without compromising on its essence. Ergo, informativeness is the prime attribute of document summary generated by an…

Information Retrieval · Computer Science 2021-10-01 Alka Khurana , Vasudha Bhatnagar

We improve on random sampling techniques for approximately solving problems that involve cuts and flows in graphs. We give a near-linear-time construction that transforms any graph on n vertices into an O(n\log n)-edge graph on the same…

Data Structures and Algorithms · Computer Science 2007-05-23 Andras Benczur , David R. Karger

Inferring the correct answers to binary tasks based on multiple noisy answers in an unsupervised manner has emerged as the canonical question for micro-task crowdsourcing or more generally aggregating opinions. In graphon estimation, one is…

Machine Learning · Statistics 2019-07-29 Devavrat Shah , Christina Lee Yu

We consider the problem of graph generation guided by network statistics, i.e., the generation of graphs which have given values of various numerical measures that characterize networks, such as the clustering coefficient and the number of…

Social and Information Networks · Computer Science 2023-03-02 Jérôme Kunegis , Jun Sun , Eiko Yoneki

Speech processing requires very efficient methods and algorithms. Finite-state transducers have been shown recently both to constitute a very useful abstract model and to lead to highly efficient time and space algorithms in this field. We…

cmp-lg · Computer Science 2008-02-03 Mehryar Mohri , Michael Riley , Richard Sproat

Neighborhood graphs are gaining popularity as a concise data representation in machine learning. However, naive graph construction by pairwise distance calculation takes $O(n^2)$ runtime for $n$ data points and this is prohibitively slow…

Data Structures and Algorithms · Computer Science 2009-04-22 Takeaki Uno , Masashi Sugiyama , Koji Tsuda

In this paper, we present the concept of Approximate grammar and how it can be used to extract information from a documemt. As the structure of informational strings cannot be defined well in a document, we cannot use the conventional…

Computation and Language · Computer Science 2007-05-23 V. Sriram , B. Ravi Sekar Reddy , R. Sangal

The positive effect of adding subword information to word embeddings has been demonstrated for predictive models. In this paper we investigate whether similar benefits can also be derived from incorporating subwords into counting models. We…

Computation and Language · Computer Science 2018-05-11 Alexandre Salle , Aline Villavicencio

Given a dataset of points in a metric space and an integer $k$, a diversity maximization problem requires determining a subset of $k$ points maximizing some diversity objective measure, e.g., the minimum or the average distance between two…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-24 Matteo Ceccarello , Andrea Pietracaprina , Geppino Pucci , Eli Upfal

Summarizing large-scaled directed graphs into small-scale representations is a useful but less studied problem setting. Conventional clustering approaches, which based on "Min-Cut"-style criteria, compress both the vertices and edges of the…

Machine Learning · Statistics 2019-07-24 Wenkai Xu , Gang Niu , Aapo Hyvärinen , Masashi Sugiyama

Text preprocessing is an essential step in text mining. Removing words that can negatively impact the quality of prediction algorithms or are not informative enough is a crucial storage-saving technique in text indexing and results in…

Information Retrieval · Computer Science 2020-12-07 Farah Alshanik , Amy Apon , Alexander Herzog , Ilya Safro , Justin Sybrandt

Document listing on string collections is the task of finding all documents where a pattern appears. It is regarded as the most fundamental document retrieval problem, and is useful in various applications. Many of the fastest-growing…

Data Structures and Algorithms · Computer Science 2019-02-21 Dustin Cobas , Gonzalo Navarro

Many NLP datasets have been found to contain shortcuts: simple decision rules that achieve surprisingly high accuracy. However, it is difficult to discover shortcuts automatically. Prior work on automatic shortcut detection has focused on…

Computation and Language · Computer Science 2022-10-24 Dan Friedman , Alexander Wettig , Danqi Chen

A method of {\it topological grammars} is proposed for multidimensional data approximation. For data with complex topology we define a {\it principal cubic complex} of low dimension and given complexity that gives the best approximation for…

Neural and Evolutionary Computing · Computer Science 2007-05-23 A. N. Gorban , N. R. Sumner , A. Y. Zinovyev