English
Related papers

Related papers: Efficient estimation of the cardinality of large d…

200 papers

TThe problem is to identify a probability associated with a set of natural numbers, given an infinite data sequence of elements from the set. If the given sequence is drawn i.i.d. and the probability mass function involved (the target)…

Machine Learning · Computer Science 2014-07-14 Paul M. B. Vitanyi , Nick Chater

Word sense disambiguation improves many Natural Language Processing (NLP) applications such as Information Retrieval, Information Extraction, Machine Translation, or Lexical Simplification. Roughly speaking, the aim is to choose for each…

Computation and Language · Computer Science 2017-03-01 Mokhtar Billami

In this paper we study algorithms to find a Gaussian approximation to a target measure defined on a Hilbert space of functions; the target measure itself is defined via its density with respect to a reference Gaussian measure. We employ the…

Numerical Analysis · Mathematics 2014-08-11 Frank J. Pinski , Gideon Simpson , Andrew M. Stuart , Hendrik Weber

Ranking, and inferences based on ranking of a set of entities, are important problems in numerous contexts. This is especially true in small area statistics where there may be only a limited amount of directly observed data from each entity…

Methodology · Statistics 2025-11-26 Snigdhansu Chatterjee , Gauri Sankar Datta , Yiren Hou , Abhyuday Mandal

Various grammar compression algorithms have been proposed in the last decade. A grammar compression is a restricted CFG deriving the string deterministically. An efficient grammar compression develops a smaller CFG by finding duplicated…

Data Structures and Algorithms · Computer Science 2016-09-01 Shouhei Fukunaga , Yoshimasa Takabatake , I Tomohiro , Hiroshi Sakamoto

We consider estimating the predictive density under Kullback-Leibler loss in a high-dimensional Gaussian model. Decision theoretic properties of the within-family prediction error -- the minimal risk among estimates in the class…

Statistics Theory · Mathematics 2012-12-04 Gourab Mukherjee , Iain M. Johnstone

Accurate cardinality estimates are a key ingredient to achieve optimal query plans. For RDF engines, specifically under common knowledge graph processing workloads, the lack of schema, correlated predicates, and various types of queries…

Databases · Computer Science 2021-02-23 Angjela Davitkova , Damjan Gjurovski , Sebastian Michel

Kernel methods represent one of the most powerful tools in machine learning to tackle problems expressed in terms of function values and derivatives due to their capability to represent and model complex relations. While these methods show…

Statistics Theory · Mathematics 2015-11-06 Bharath K. Sriperumbudur , Zoltan Szabo

With an ever growing number of extractive summarization techniques being proposed, there is less clarity then ever about how good each system is compared to the rest. Several studies highlight the variance in performance of these systems…

Information Retrieval · Computer Science 2018-09-10 Parth Mehta , Prasenjit Majumder

As data volume grows extensively, data profiling helps to extract metadata of large-scale data. However, one kind of metadata, order statistics, is difficult to be computed because they are not mergeable or incremental. Thus, the limitation…

Data Structures and Algorithms · Computer Science 2020-06-29 Zhiwei Chen , Aoqian Zhang

Score-based causal discovery methods can effectively identify causal relationships by evaluating candidate graphs and selecting the one with the highest score. One popular class of scores is kernel-based generalized score functions, which…

Machine Learning · Computer Science 2025-06-10 Yixin Ren , Haocheng Zhang , Yewei Xia , Hao Zhang , Jihong Guan , Shuigeng Zhou

This paper develops new combinatorial approaches to analyze and compute special set partitions, called complementary set partitions, which are fundamental in the study of generalized cumulants. Moving away from traditional graph-based and…

Statistics Theory · Mathematics 2025-05-20 Elvira Di Nardo , Giuseppe Guarino

We study Gaussian approximations to the distribution of a diffusion. The approximations are easy to compute: they are defined by two simple ordinary differential equations for the mean and the covariance. Time correlations can also be…

Probability · Mathematics 2016-05-20 Daniel Sanz-Alonso , Andrew M. Stuart

Article discusses the application of Kullback-Leibler divergence to the recognition of speech signals and suggests three algorithms implementing this divergence criterion: correlation algorithm, spectral algorithm and filter algorithm.…

Artificial Intelligence · Computer Science 2007-05-23 Igor Bocharov , Pavel Lukin

Research into the automatic acquisition of lexical information from corpora is starting to produce large-scale computational lexicons containing data on the relative frequencies of subcategorisation alternatives for individual verbal…

cmp-lg · Computer Science 2007-05-23 John Carroll , Guido Minnen , Ted Briscoe

Many statistical studies are concerned with the analysis of observations organized in a matrix form whose elements are count data. When these observations are assumed to follow a Poisson or a multinomial distribution, it is of interest to…

Statistics Theory · Mathematics 2022-01-04 Jérémie Bigot , Charles Deledalle

Many applications, including natural language processing, sensor networks, collaborative filtering, and federated learning, call for estimating discrete distributions from data collected in batches, some of which may be untrustworthy,…

Machine Learning · Computer Science 2020-02-26 Ayush Jain , Alon Orlitsky

We proposed a learning algorithm for nonparametric estimation and on-line prediction for general stationary ergodic sources. We prepare histograms each of which estimates the probability as a finite distribution, and mixture them with…

Information Theory · Computer Science 2010-06-29 Joe Suzuki

We present arguments for the formulation of unified approach to different standard continuous inference methods from partial information. It is claimed that an explicit partition of information into a priori (prior knowledge) and a…

Machine Learning · Statistics 2012-12-07 Mark A. Kon , Leszek Plaskota

In the information-based paradigm of inference, model selection is performed by selecting the candidate model with the best estimated predictive performance. The success of this approach depends on the accuracy of the estimate of the…

Machine Learning · Statistics 2018-06-11 Colin H. LaMont , Paul A. Wiggins