English
Related papers

Related papers: Probabilistic Models for Query Approximation with …

200 papers

Discovering statistically significant patterns from databases is an important challenging problem. The main obstacle of this problem is in the difficulty of taking into account the selection bias, i.e., the bias arising from the fact that…

Machine Learning · Statistics 2016-03-10 Shinya Suzumura , Kazuya Nakagawa , Mahito Sugiyama , Koji Tsuda , Ichiro Takeuchi

Probabilistic inference in pairwise Markov Random Fields (MRFs), i.e. computing the partition function or computing a MAP estimate of the variables, is a foundational problem in probabilistic graphical models. Semidefinite programming…

Machine Learning · Computer Science 2021-05-04 Chirag Pabbaraju , Po-Wei Wang , J. Zico Kolter

Likelihood-free Bayesian inference algorithms are popular methods for calibrating the parameters of complex, stochastic models, required when the likelihood of the observed data is intractable. These algorithms characteristically rely…

Computation · Statistics 2021-12-23 Thomas P Prescott , David J Warne , Ruth E Baker

We propose an algebraic framework for studying efficient algorithms for query evaluation, aggregation, enumeration, and maintenance under updates, on sparse databases. Our framework allows to treat those problems in a unified way, by…

Logic in Computer Science · Computer Science 2020-01-01 Szymon Toruńczyk

Motivated by the problem of determining the atomic structure of macromolecules using single-particle cryo-electron microscopy (cryo-EM), we study the sample and computational complexities of the sparse multi-reference alignment (MRA) model:…

Information Theory · Computer Science 2021-09-27 Tamir Bendory , Oscar Mickelin , Amit Singer

We consider the problem of sparse matrix multiplication by the column row method in a distributed setting where the matrix product is not necessarily sparse. We present a surprisingly simple method for "consistent" parallel processing of…

Data Structures and Algorithms · Computer Science 2012-11-20 Andrea Campagna , Konstantin Kutzkov , Rasmus Pagh

An important aspect of Bayesian model selection is how to deal with huge model spaces, since exhaustive enumeration of all the models entertained is unfeasible and inferences have to be based on the very small proportion of models visited.…

Methodology · Statistics 2011-01-25 Gonzalo Garcia-Donato , Miguel Angel Martinez-Beneito

Most existing work in online stochastic combinatorial optimization assumes that inputs are drawn from independent distributions -- a strong assumption that often fails in practice. At the other extreme, arbitrary correlations are equivalent…

Data Structures and Algorithms · Computer Science 2025-11-11 Zhimeng Gao , Evangelia Gergatsouli , Kalen Patton , Sahil Singla

Large Language Models have undoubtedly revolutionized the Natural Language Processing field, the current trend being to promote one-model-for-all tasks (sentiment analysis, translation, etc.). However, the statistical mechanisms at work in…

Computation and Language · Computer Science 2024-08-26 Célia D'Cruz , Jean-Marc Bereder , Frédéric Precioso , Michel Riveill

Sparse Conditional Random Field (CRF) is a powerful technique in computer vision and natural language processing for structured prediction. However, solving sparse CRFs in large-scale applications remains challenging. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Weizhong Zhang , Shuang Qiu

Despite the advances in probabilistic model checking, the scalability of the verification methods remains limited. In particular, the state space often becomes extremely large when instantiating parameterized Markov decision processes…

Current query expansion models use pseudo-relevance feedback to improve first-pass retrieval effectiveness; however, this fails when the initial results are not relevant. Instead of building a language model from retrieved results, we…

Information Retrieval · Computer Science 2023-04-27 Iain Mackie , Shubham Chatterjee , Jeffrey Dalton

In this paper we address the problem of performing statistical inference for large scale data sets i.e., Big Data. The volume and dimensionality of the data may be so high that it cannot be processed or stored in a single computing node. We…

Methodology · Statistics 2016-04-20 Shahab Basiri , Esa Ollila , Visa Koivunen

Many natural signals exhibit a sparse representation, whenever a suitable describing model is given. Here, a linear generative model is considered, where many sparsity-based signal processing techniques rely on such a simplified model. As…

Machine Learning · Computer Science 2013-06-11 Mehrdad Yaghoobi , Laurent Daudet , Michael E. Davies

We take an information theoretic perspective on a classical sparse-sampling noisy linear model and present an analytical expression for the mutual information, which plays central role in a variety of communications/processing problems.…

Information Theory · Computer Science 2014-03-25 Wasim Huleihel , Neri Merhav , Shlomo Shamai

We study and develop the stochastic Markov reward model (sMRM), which extends the Markov chain where transition time/reward as modelled as random variables. Techniques are presented to enable computing first-passage time distributions (or…

Numerical Analysis · Mathematics 2022-08-16 Irfan Muhammad

Genomics has revolutionized biology, enabling the interrogation of whole transcriptomes, genome-wide binding sites for proteins, and many other molecular processes. However, individual genomic assays measure elements that interact in vivo…

Machine Learning · Statistics 2022-06-08 Sumanta Basu , Karl Kumbier , James B. Brown , Bin Yu

Neural networks are among the state-of-the-art techniques for language modeling. Existing neural language models typically map discrete words to distributed, dense vector representations. After information processing of the preceding…

Computation and Language · Computer Science 2016-10-14 Yunchuan Chen , Lili Mou , Yan Xu , Ge Li , Zhi Jin

We present a novel preference learning framework to capture participant preferences efficiently within limited interaction rounds. It involves three main contributions. First, we develop a variational Bayesian approach to infer the…

Machine Learning · Computer Science 2025-03-20 Yan Wang , Jiapeng Liu , Milosz Kadziński , Xiuwu Liao

Belief Propagation (BP) is a widely used approximation for exact probabilistic inference in graphical models, such as Markov Random Fields (MRFs). In graphs with cycles, however, no exact convergence guarantees for BP are known, in general.…

Artificial Intelligence · Computer Science 2016-12-28 Wolfgang Gatterbauer