English
Related papers

Related papers: List-Level Distribution Coupling with Applications…

200 papers

We consider the problem of inference in discrete probabilistic models, that is, distributions over subsets of a finite ground set. These encompass a range of well-known models in machine learning, such as determinantal point processes and…

Machine Learning · Computer Science 2018-07-10 Alkis Gotovos , Hamed Hassani , Andreas Krause , Stefanie Jegelka

Traditionally, data compression deals with the problem of concisely representing a data source, e.g. a sequence of letters, for the purpose of eventual reproduction (either exact or approximate). In this work we are interested in the case…

Information Theory · Computer Science 2013-12-10 Amir Ingber , Tsachy Weissman

The shrinking rank method is a variation of slice sampling that is efficient at sampling from multivariate distributions with highly correlated parameters. It requires that the gradient of the log-density be computable. At each individual…

Computation · Statistics 2010-11-23 Madeleine B. Thompson , Radford M. Neal

Diversity is an essential metric for evaluating the creativity of outputs generated by language models. Temperature-based sampling is a common strategy to increase diversity. However, for tasks that require high precision, e.g.,…

Machine Learning · Computer Science 2025-10-03 Sergey Troshin , Wafaa Mohammed , Yan Meng , Christof Monz , Antske Fokkens , Vlad Niculae

Scenario decision making offers a flexible way of making decision in an uncertain environment while obtaining probabilistic guarantees on the risk of failure of the decision. The idea of this approach is to draw samples of the uncertainty…

Optimization and Control · Mathematics 2025-09-03 Guillaume O. Berger

Natural language understanding (NLU) tasks face a non-trivial amount of ambiguous samples where veracity of their labels is debatable among annotators. NLU models should thus account for such ambiguity, but they approximate the human…

Computation and Language · Computer Science 2023-06-13 Hancheol Park , Jong C. Park

Consider a Gaussian memoryless multiple source with $m$ components with joint probability distribution known only to lie in a given class of distributions. A subset of $k \leq m$ components are sampled and compressed with the objective of…

Information Theory · Computer Science 2018-03-16 Vinay Praneeth Boda

We investigate probabilistic decoupling of labels supplied for training, from the underlying classes for prediction. Decoupling enables an inference scheme general enough to implement many classification problems, including supervised,…

Machine Learning · Computer Science 2019-05-30 Jeppe Nørregaard , Lars Kai Hansen

We give a probabilistic interpretation of sampling theory of graph signals. To do this, we first define a generative model for the data using a pairwise Gaussian random field (GRF) which depends on the graph. We show that, under certain…

Machine Learning · Computer Science 2015-03-24 Akshay Gadde , Antonio Ortega

This paper considers properties of an optimization based sampler for targeting the posterior distribution when the likelihood is intractable and auxiliary statistics are used to summarize information in the data. Our reverse sampler…

Methodology · Statistics 2015-12-02 Jean-Jacques Forneron , Serena Ng

In a multifidelity setting, data are available under the same conditions from two (or more) sources, e.g. computer codes, one being lower-fidelity but computationally cheaper, and the other higher-fidelity and more expensive. This work…

Methodology · Statistics 2024-09-25 Minji Kim , Kevin O'Connor , Vladas Pipiras , Themistoklis Sapsis

Sampling methods (e.g., node-wise, layer-wise, or subgraph) has become an indispensable strategy to speed up training large-scale Graph Neural Networks (GNNs). However, existing sampling methods are mostly based on the graph structural…

Machine Learning · Computer Science 2021-09-07 Weilin Cong , Rana Forsati , Mahmut Kandemir , Mehrdad Mahdavi

Computing and storing probabilities is a hard problem as soon as one has to deal with complex distributions over multiple random variables. The problem of efficient representation of probability distributions is central in term of…

Artificial Intelligence · Computer Science 2016-08-16 David Bellot , Pierre Bessiere

In this paper we develop a principled, probabilistic, unified approach to non-standard classification tasks, such as semi-supervised, positive-unlabelled, multi-positive-unlabelled and noisy-label learning. We train a classifier on the…

Machine Learning · Computer Science 2020-06-17 Jeppe Nørregaard , Lars Kai Hansen

Generative diffusions are a powerful class of Monte Carlo samplers that leverage bridging Markov processes to approximate complex, high-dimensional distributions, such as those found in image processing and language models. Despite their…

Machine Learning · Statistics 2025-02-20 Zheng Zhao , Ziwei Luo , Jens Sjölund , Thomas B. Schön

Simulation-based inference methods that feature correct conditional coverage of confidence sets based on observations that have been compressed to a scalar test statistic require accurate modeling of either the p-value function or the…

Machine Learning · Statistics 2025-08-18 Ali Al Kadhim , Harrison B. Prosper

Real world scenarios can be captured with lifted probability distributions. However, distributions are usually encoded in a table or list, requiring an exponential number of values. Hence, we propose a method for extracting first-order…

Artificial Intelligence · Computer Science 2026-04-01 Florian Andreas Marwitz , Tanya Braun , Ralf Möller

This paper shows how sparse, high-dimensional probability distributions could be represented by neurons with exponential compression. The representation is a novel application of compressive sensing to sparse probability distributions…

Neurons and Cognition · Quantitative Biology 2012-06-11 Xaq Pitkow

In this paper, we consider a distributed reception scenario where a transmitter broadcasts a signal to multiple geographically separated receive nodes over fading channels, and each node forwards a few bits representing a processed version…

Information Theory · Computer Science 2015-06-19 Junil Choi , David J. Love , Patrick Bidigare

In this paper we develop a methodology that we call split sampling methods to estimate high dimensional expectations and rare event probabilities. Split sampling uses an auxiliary variable MCMC simulation and expresses the expectation of…

Computation · Statistics 2013-11-04 John R. Birge , Changgee Chang , Nicholas G. Polson