English
Related papers

Related papers: Distribution Estimation with Side Information

200 papers

We propose a new modeling approach that is a generalization of generative and discriminative models. The core idea is to use an implicit parameterization of a joint probability distribution by specifying only the conditional distributions.…

Machine Learning · Computer Science 2016-12-06 Dmitrij Schlesinger , Carsten Rother

How do two distributions of texts differ? Humans are slow at answering this, since discovering patterns might require tediously reading through hundreds of samples. We propose to automatically summarize the differences by "learning a…

Computation and Language · Computer Science 2022-05-19 Ruiqi Zhong , Charlie Snell , Dan Klein , Jacob Steinhardt

In many applications of natural language processing (NLP) it is necessary to determine the likelihood of a given word combination. For example, a speech recognizer may need to determine which of the two word combinations ``eat a peach'' and…

Computation and Language · Computer Science 2007-05-23 Ido Dagan , Lillian Lee , Fernando C. N. Pereira

We study the problem of distributed information bottleneck, in which multiple encoders separately compress their observations in a manner such that, collectively, the compressed signals preserve as much information as possible about another…

Information Theory · Computer Science 2017-10-04 Inaki Estella Aguerri , Abdellatif Zaidi

Consider a random sample $X_1 , X_2 , ..., X_n$ drawn independently and identically distributed from some known sampling distribution $P_X$. Let $X_{(1)} \le X_{(2)} \le ... \le X_{(n)}$ represent the order statistics of the sample. The…

Information Theory · Computer Science 2020-09-28 Alex Dytso , Martina Cardone , Cynthia Rush

We analyze a stochastic approximation algorithm for decision-dependent problems, wherein the data distribution used by the algorithm evolves along the iterate sequence. The primary examples of such problems appear in performative prediction…

Optimization and Control · Mathematics 2024-05-15 Joshua Cutler , Mateo Díaz , Dmitriy Drusvyatskiy

We describe a statistical method to avoid biased estimation of the content of different particle species. We consider the case when the particle identification information strongly depends on some kinematical variables, whose distributions…

Data Analysis, Statistics and Probability · Physics 2011-06-16 Massimo Casarsa , Pierluigi Catastini , Giovanni Punzi , Luciano Ristori

In distributionally robust optimization the probability distribution of the uncertain problem parameters is itself uncertain, and a fictitious adversary, e.g., nature, chooses the worst distribution from within a known ambiguity set. A…

Optimization and Control · Mathematics 2018-05-10 Etienne de Klerk , Daniel Kuhn , Krzysztof Postek

In this work we study the set size distribution estimation problem, where elements are randomly sampled from a collection of non-overlapping sets and we seek to recover the original set size distribution from the samples. This problem has…

Statistics Theory · Mathematics 2012-12-04 Fabricio Murai , Bruno Ribeiro , Don Towsley , Pinghui Wang

We study the problem of {\em impartial selection}, a topic that lies at the intersection of computational social choice and mechanism design. The goal is to select the most popular individual among a set of community members. The input can…

Computer Science and Game Theory · Computer Science 2021-02-19 Ioannis Caragiannis , George Christodoulou , Nicos Protopapas

Motivated by recently emerging problems in machine learning and statistics, we propose data models which relax the familiar i.i.d. assumption. In essence, we seek to understand what it means for data to come from a set of probability…

Statistics Theory · Mathematics 2025-01-08 Christian Fröhlich , Robert C. Williamson

This note corrects a technical error in Guardiola (2020, Journal of Statistical Distributions and Applications), presents updated derivations, and offers an extended discussion of the properties of the spherical Dirichlet distribution.…

Methodology · Statistics 2025-06-06 Jose H Guardiola

Recent years have witnessed an increasing popularity of algorithm design for distributed data, largely due to the fact that massive datasets are often collected and stored in different locations. In the distributed setting communication…

Data Structures and Algorithms · Computer Science 2017-06-06 Sudipto Guha , Yi Li , Qin Zhang

It is well known that an extreme order statistic and a central order statistic (os) as well as an intermediate os and a central os from a sample of iid univariate random variables get asymptotically independent as the sample size increases.…

Statistics Theory · Mathematics 2017-02-01 Michael Falk , Florian Wisheckel

This study focuses on an alignment-free sequence comparison method: the number of words of length k shared between two sequences, also known as the D_2 statistic. The advantages of the use of this statistic over alignment-based methods are…

Quantitative Methods · Quantitative Biology 2009-09-08 Sylvain Foret , Susan R. Wilson , Conrad J. Burden

Equilibrium statistical physics is considered from the point of view of statistical estimation theory. This involves the notions of statistical model, of estimators, and of exponential family. A useful property of the latter is the…

Statistical Mechanics · Physics 2016-08-31 Jan Naudts

We propose and analyze a quasirandom analogue of the classical push model for disseminating information in networks ("randomized rumor spreading"). In the classical model, in each round each informed vertex chooses a neighbor at random and…

Data Structures and Algorithms · Computer Science 2015-03-17 Benjamin Doerr , Tobias Friedrich , Thomas Sauerwald

For many interesting tasks, such as medical diagnosis and web page classification, a learner only has access to some positively labeled examples and many unlabeled examples. Learning from this type of data requires making assumptions about…

Machine Learning · Computer Science 2018-08-28 Jessa Bekker , Jesse Davis

Word embeddings predict a word from its neighbours by learning small, dense embedding vectors. In practice, this prediction corresponds to a semantic score given to the predicted word (or term weight). We present a novel model that, given a…

Information Retrieval · Computer Science 2019-06-04 Casper Hansen , Christian Hansen , Stephen Alstrup , Jakob Grue Simonsen , Christina Lioma

Optimization under uncertainty deals with the problem of optimizing stochastic cost functions given some partial information on their inputs. These problems are extremely difficult to solve and yet pervade all areas of technological and…

Statistical Mechanics · Physics 2015-03-13 Fabrizio Altarelli , Alfredo Braunstein , Abolfazl Ramezanpour , Riccardo Zecchina