English
Related papers

Related papers: Product distribution learning with imperfect advic…

200 papers

We study high-dimensional distribution learning in an agnostic setting where an adversary is allowed to arbitrarily corrupt an $\varepsilon$-fraction of the samples. Such questions have a rich history spanning statistics, machine learning…

Data Structures and Algorithms · Computer Science 2019-03-18 Ilias Diakonikolas , Gautam Kamath , Daniel Kane , Jerry Li , Ankur Moitra , Alistair Stewart

On-line and batch learning of a perceptron in a discrete weight space, where each weight can take $2 L+1$ different values, are examined analytically and numerically. The learning algorithm is based on the training of the continuous…

Statistical Mechanics · Physics 2009-11-07 Michal Rosen-Zvi , Ido Kanter

We present two different approaches for parameter learning in several mixture models in one dimension. Our first approach uses complex-analytic methods and applies to Gaussian mixtures with shared variance, binomial mixtures with shared…

Machine Learning · Computer Science 2020-01-22 Akshay Krishnamurthy , Arya Mazumdar , Andrew McGregor , Soumyabrata Pal

We study the problems of identity and closeness testing of $n$-dimensional product distributions. Prior works by Canonne, Diakonikolas, Kane and Stewart (COLT 2017) and Daskalakis and Pan (COLT 2017) have established tight sample complexity…

Data Structures and Algorithms · Computer Science 2021-05-27 Arnab Bhattacharyya , Sutanu Gayen , Saravanan Kandasamy , N. V. Vinodchandran

The minimum rate needed to accurately approximate a product distribution based on an unnormalized informational divergence is shown to be a mutual information. This result subsumes results of Wyner on common information and Han-Verd\'{u} on…

Information Theory · Computer Science 2013-05-14 Jie Hou , Gerhard Kramer

Generative flow networks (GFlowNets) are a family of algorithms that learn a generative policy to sample discrete objects $x$ with non-negative reward $R(x)$. Learning objectives guarantee the GFlowNet samples $x$ from the target…

Machine Learning · Computer Science 2023-05-15 Max W. Shen , Emmanuel Bengio , Ehsan Hajiramezanali , Andreas Loukas , Kyunghyun Cho , Tommaso Biancalani

We study the fundamental problem of learning the parameters of a high-dimensional Gaussian in the presence of noise -- where an $\varepsilon$-fraction of our samples were chosen by an adversary. We give robust estimators that achieve…

Data Structures and Algorithms · Computer Science 2017-11-07 Ilias Diakonikolas , Gautam Kamath , Daniel M. Kane , Jerry Li , Ankur Moitra , Alistair Stewart

Recommender systems can automatically recommend users with items that they probably like. The goal of them is to model the user-item interaction by effectively representing the users and items. Existing methods have primarily learned the…

Information Retrieval · Computer Science 2024-04-30 Xue Dong , Xuemeng Song , Na Zheng , Yinwei Wei , Zhongzhou Zhao

To date, distributional reinforcement learning (distributional RL) methods have exclusively focused on the discounted setting, where an agent aims to optimize a discounted sum of rewards over time. In this work, we extend distributional RL…

Machine Learning · Computer Science 2026-01-14 Juan Sebastian Rojas , Chi-Guhn Lee

This paper investigates simultaneous preference and metric learning from a crowd of respondents. A set of items represented by $d$-dimensional feature vectors and paired comparisons of the form ``item $i$ is preferable to item $j$'' made by…

Machine Learning · Statistics 2022-07-11 Gregory Canal , Blake Mason , Ramya Korlakai Vinayak , Robert Nowak

Real-life data are often non-IID due to complex distributions and interactions, and the sensitivity to the distribution of samples can differ among learning models. Accordingly, a key question for any supervised or unsupervised model is…

Machine Learning · Computer Science 2023-10-03 Zhilin Zhao , Longbing Cao

This paper addresses the problem of distributed learning of average belief with sequential observations, in which a network of $n>1$ agents aim to reach a consensus on the average value of their beliefs, by exchanging information only with…

Multiagent Systems · Computer Science 2018-11-20 Kaiqing Zhang , Yang Liu , Ji Liu , Mingyan Liu , Tamer Başar

We study metric learning from preference comparisons under the ideal point model, in which a user prefers an item over another if it is closer to their latent ideal item. These items are embedded into $\mathbb{R}^d$ equipped with an unknown…

Machine Learning · Computer Science 2024-07-15 Zhi Wang , Geelon So , Ramya Korlakai Vinayak

We study learning of probability distributions characterized by an unknown symmetry direction. Based on an entropic performance measure and the variational method of statistical mechanics we develop exact upper and lower bounds on the…

Disordered Systems and Neural Networks · Physics 2009-11-07 D. Herschkowitz , M. Opper

Motivated by an application of eliciting users' preferences, we investigate the problem of learning hemimetrics, i.e., pairwise distances among a set of $n$ items that satisfy triangle inequalities and non-negativity constraints. In our…

Machine Learning · Statistics 2016-05-30 Adish Singla , Sebastian Tschiatschek , Andreas Krause

Distribution testing deals with what information can be deduced about an unknown distribution over $\{1,\ldots,n\}$, where the algorithm is only allowed to obtain a relatively small number of independent samples from the distribution. In…

Computational Complexity · Computer Science 2016-09-23 Eldar Fischer , Oded Lachish , Yadu Vasudev

We propose a self-improving algorithm for computing Voronoi diagrams under a given convex distance function with constant description complexity. The $n$ input points are drawn from a hidden mixture of product distributions; we are only…

Computational Geometry · Computer Science 2021-10-26 Siu-Wing Cheng , Man Ting Wong

We give highly efficient algorithms, and almost matching lower bounds, for a range of basic statistical problems that involve testing and estimating the L_1 distance between two k-modal distributions $p$ and $q$ over the discrete domain…

Data Structures and Algorithms · Computer Science 2011-12-26 Constantinos Daskalakis , Ilias Diakonikolas , Rocco A. Servedio , Gregory Valiant , Paul Valiant

We introduce a novel class of algorithms to efficiently approximate the unknown return distributions in policy evaluation problems from distributional reinforcement learning (DRL). The proposed distributional dynamic programming algorithms…

Machine Learning · Statistics 2024-07-22 Julian Gerstenberg , Ralph Neininger , Denis Spiegel

In many learning applications, data are collected from multiple sources, each providing a \emph{batch} of samples that by itself is insufficient to learn its input-output relationship. A common approach assumes that the sources fall in one…

Machine Learning · Computer Science 2023-09-06 Ayush Jain , Rajat Sen , Weihao Kong , Abhimanyu Das , Alon Orlitsky