English
Related papers

Related papers: Non-exchangeable feature allocation models with su…

200 papers

By expressing prior distributions as general stochastic processes, nonparametric Bayesian methods provide a flexible way to incorporate prior knowledge and constrain the latent structure in statistical inference. The Indian buffet process…

Machine Learning · Statistics 2015-05-21 Mengjie Chen , Chao Gao , Hongyu Zhao

Matrix factorisation methods decompose multivariate observations as linear combinations of latent feature vectors. The Indian Buffet Process (IBP) provides a way to model the number of latent features required for a good approximation in…

Machine Learning · Statistics 2017-04-14 Matthew C. Pearce , Simon R. White

In this paper we consider a problem of searching a space of predictive models for a given training data set. We propose an iterative procedure for deriving a sequence of improving models and a corresponding sequence of sets of non-linear…

Machine Learning · Computer Science 2014-02-18 Michael Tetelman

Trait allocations are a class of combinatorial structures in which data may belong to multiple groups and may have different levels of belonging in each group. Often the data are also exchangeable, i.e., their joint distribution is…

Statistics Theory · Mathematics 2020-01-28 Trevor Campbell , Diana Cai , Tamara Broderick

Naively trained neural networks tend to experience catastrophic forgetting in sequential task settings, where data from previous tasks are unavailable. A number of methods, using various model expansion strategies, have been proposed…

Machine Learning · Computer Science 2021-04-29 Nikhil Mehta , Kevin J Liang , Vinay K Verma , Lawrence Carin

This paper proposes a novel learning method for multi-task applications. Multi-task neural networks can learn to transfer knowledge across different tasks by using parameter sharing. However, sharing parameters between unrelated tasks can…

Machine Learning · Computer Science 2020-07-21 Krzysztof Maziarz , Efi Kokiopoulou , Andrea Gesmundo , Luciano Sbaiz , Gabor Bartok , Jesse Berent

Transformers have shown improved performance when compared to previous architectures for sequence processing such as RNNs. Despite their sizeable performance gains, as recently suggested, the model is computationally expensive to train and…

Computation and Language · Computer Science 2021-09-09 Machel Reid , Edison Marrese-Taylor , Yutaka Matsuo

We study the question of existence and fast computation of fair and efficient allocations of indivisible resources among agents with additive valuations. As such allocations may not exist for arbitrary instances, we ask if they exist for…

Computer Science and Game Theory · Computer Science 2025-12-22 Aprup Kale , Rucha Kulkarni , Navya Garg

The goal of this presentation is to build an efficient non-parametric Bayes classifier in the presence of large numbers of predictors. When analyzing such data, parametric models are often too inflexible while non-parametric procedures tend…

Methodology · Statistics 2013-01-07 Abhishek Bhattacharya

We propose a Bayesian nonparametric approach to the problem of jointly modeling multiple related time series. Our approach is based on the discovery of a set of latent, shared dynamical behaviors. Using a beta process prior, the size of the…

Methodology · Statistics 2011-11-21 Emily B. Fox , Erik B. Sudderth , Michael I. Jordan , Alan S. Willsky

Using nonparametric methods has been increasingly explored in Bayesian hierarchical modeling as a way to increase model flexibility. Although the field shows a lot of promise, inference in many models, including Hierachical Dirichlet…

Machine Learning · Statistics 2015-01-19 Alexander Spangher

Distributed model fitting refers to the process of fitting a mathematical or statistical model to the data using distributed computing resources, such that computing tasks are divided among multiple interconnected computers or nodes, often…

Computation · Statistics 2024-06-04 Xiaofei Wu , Rongmei Liang , Fabio Roli , Marcello Pelillo , Jing Yuan

We present a generative model that is defined on finite sets of exchangeable, potentially high dimensional, data. As the architecture is an extension of RealNVPs, it inherits all its favorable properties, such as being invertible and…

Machine Learning · Computer Science 2019-09-09 Kashif Rasul , Ingmar Schuster , Roland Vollgraf , Urs Bergmann

In many applications, observed data are influenced by some combination of latent causes. For example, suppose sensors are placed inside a building to record responses such as temperature, humidity, power consumption and noise levels. These…

Machine Learning · Statistics 2020-07-16 Sinead A. Williamson , Michael Minyi Zhang , Paul Damien

Decomposing knowledge into interchangeable pieces promises a generalization advantage when there are changes in distribution. A learning agent interacting with its environment is likely to be faced with situations requiring novel…

Machine Learning · Computer Science 2021-05-20 Kanika Madan , Nan Rosemary Ke , Anirudh Goyal , Bernhard Schölkopf , Yoshua Bengio

As neural networks are increasingly being applied to real-world applications, mechanisms to address distributional shift and sequential task learning without forgetting are critical. Methods incorporating network expansion have shown…

Machine Learning · Computer Science 2021-03-26 Vinay Kumar Verma , Kevin J Liang , Nikhil Mehta , Piyush Rai , Lawrence Carin

In this paper, we propose a non-parametric conditional factor regression (NCFR)model for domains with high-dimensional input and response. NCFR enhances linear regression in two ways: a) introducing low-dimensional latent factors leading to…

Machine Learning · Statistics 2013-07-03 Ava Bargi , Richard Yi Da Xu , Massimo Piccardi

Inference for latent feature models is inherently difficult as the inference space grows exponentially with the size of the input data and number of latent features. In this work, we use Kurihara & Welling (2008)'s maximization-expectation…

Machine Learning · Statistics 2013-07-25 Colorado Reed , Zoubin Ghahramani

We propose a probabilistic model to infer supervised latent variables in the Hamming space from observed data. Our model allows simultaneous inference of the number of binary latent variables, and their values. The latent variables preserve…

Machine Learning · Computer Science 2013-09-27 Novi Quadrianto , Viktoriia Sharmanska , David A. Knowles , Zoubin Ghahramani

We study the problem of allocating indivisible items on a path among agents. The objective is to find a fair and efficient allocation in which each agent's bundle forms a contiguous block on the line. We say that an instance is \emph{$(a,…

Computer Science and Game Theory · Computer Science 2025-01-14 Yasushi Kawase , Bodhayan Roy , Mohammad Azharuddin Sanpui