English
Related papers

Related papers: Infinite Shift-invariant Grouped Multi-task Learni…

200 papers

Bayesian non-parametric methods based on Dirichlet process mixtures have seen tremendous success in various domains and are appealing in being able to borrow information by clustering samples that share identical parameters. However, such…

Methodology · Statistics 2022-07-04 Suprateek Kundu , Joshua Lukemire

We consider the problem of aggregating models learned from sequestered, possibly heterogeneous datasets. Exploiting tools from Bayesian nonparametrics, we develop a general meta-modeling framework that learns shared global latent structures…

Machine Learning · Statistics 2019-11-04 Mikhail Yurochkin , Mayank Agarwal , Soumya Ghosh , Kristjan Greenewald , Trong Nghia Hoang

In this paper, we consider the task of clustering a set of individual time series while modeling each cluster, that is, model-based time series clustering. The task requires a parametric model with sufficient flexibility to describe the…

Machine Learning · Computer Science 2023-02-23 Ryohei Umatani , Takashi Imai , Kaoru Kawamoto , Shutaro Kunimasa

The human ability to synchronize the feedback from all their senses inspired recent works in multi-task and multi-modal learning. While these works rely on expensive supervision, our multi-task graph requires only pseudo-labels from expert…

Machine Learning · Computer Science 2021-11-05 Emanuela Haller , Elena Burceanu , Marius Leordeanu

Learning-based techniques are increasingly effective at controlling complex systems using data-driven models. However, most work done so far has focused on learning individual tasks or control laws. Hence, it is still a largely unaddressed…

Systems and Control · Electrical Eng. & Systems 2020-05-08 Alexandre Capone , Armin Lederer , Jonas Umlauft , Sandra Hirche

We introduce Bayesian Information-Theoretic Sampling for hierarchical GAussian Process Surrogates (BITS for GAPS), a framework enabling information-theoretic experimental design of Gaussian process-based surrogate models. Unlike standard…

Machine Learning · Statistics 2026-05-29 Kyla D. Jones , Alexander W. Dowling

Understanding how adult humans learn non-native speech categories such as tone information has shed novel insights into the mechanisms underlying experience-dependent brain plasticity. Scientists have traditionally examined these questions…

Methodology · Statistics 2020-06-16 Giorgio Paulon , Fernando Llanos , Bharath Chandrasekaran , Abhra Sarkar

This study investigates Bayesian ensemble learning for improving the quality of decision-making. We consider a decision-maker who selects an action from a set of candidates based on a policy trained using observations. In our setting, we…

Methodology · Statistics 2024-06-14 Masahiro Kato

Model-based reinforcement learning refers to a set of approaches capable of sample-efficient decision making, which create an explicit model of the environment. This model can subsequently be used for learning optimal policies. In this…

Machine Learning · Computer Science 2024-11-19 Théophile Champion , Marek Grześ , Howard Bowman

Statistical modelling in the presence of data organized in groups is a crucial task in Bayesian statistics. The present paper conceives a mixture model based on a novel family of Bayesian priors designed for multilevel data and obtained by…

Methodology · Statistics 2024-07-01 Alessandro Colombi , Raffaele Argiento , Federico Camerlenghi , Lucia Paci

Deep learning models lack shift invariance, making them sensitive to input shifts that cause changes in output. While recent techniques seek to address this for images, our findings show that these approaches fail to provide…

Machine Learning · Computer Science 2025-02-28 Berken Utku Demirel , Christian Holz

Recently developed techniques have made it possible to quickly learn accurate probability density functions from data in low-dimensional continuous space. In particular, mixtures of Gaussians can be fitted to data very quickly using an…

Machine Learning · Computer Science 2013-01-18 Scott Davies , Andrew Moore

Influenced mixed moving average fields are a versatile modeling class for spatio-temporal data. However, their predictive distribution is not generally known. Under this modeling assumption, we define a novel spatio-temporal embedding and a…

Machine Learning · Statistics 2024-08-05 Imma Valentina Curato , Orkun Furat , Lorenzo Proietti , Bennet Stroeh

This paper presents a novel extension of multi-task Gaussian Cox processes for modeling multiple heterogeneous correlated tasks jointly, e.g., classification and regression, via multi-output Gaussian processes (MOGP). A MOGP prior over the…

Machine Learning · Computer Science 2023-08-30 Feng Zhou , Quyu Kong , Zhijie Deng , Fengxiang He , Peng Cui , Jun Zhu

Advances in sampling schemes for Markov jump processes have recently enabled multiple inferential tasks. However, in statistical and machine learning applications, we often require that these continuous-time models find support on…

Computation · Statistics 2018-06-08 Iker Perez , Lax Chan , Mercedes Torres Torres , James Goulding , Theodore Kypraios

This paper introduces self-paced task selection to multitask learning, where instances from more closely related tasks are selected in a progression of easier-to-harder tasks, to emulate an effective human education strategy, but applied to…

Machine Learning · Statistics 2017-06-20 Keerthiram Murugesan , Jaime Carbonell

In deep active learning, it is especially important to choose multiple examples to markup at each step to work efficiently, especially on large datasets. At the same time, existing solutions to this problem in the Bayesian setup, such as…

Machine Learning · Computer Science 2023-02-17 Aleksandr Rubashevskii , Daria Kotova , Maxim Panov

We propose a practical and scalable Gaussian process model for large-scale nonlinear probabilistic regression. Our mixture-of-experts model is conceptually simple and hierarchically recombines computations for an overall approximation of a…

Machine Learning · Statistics 2014-12-10 Jun Wei Ng , Marc Peter Deisenroth

Bayesian nonparametric mixture models are common for modeling complex data. While these models are well-suited for density estimation, recent results proved posterior inconsistency of the number of clusters when the true number of…

Statistics Theory · Mathematics 2024-05-31 Louise Alamichel , Daria Bystrova , Julyan Arbel , Guillaume Kon Kam King

We consider the problem of sequential estimation of the unknowns of state-space and deep state-space models that include estimation of functions and latent processes of the models. The proposed approach relies on Gaussian and deep Gaussian…

Machine Learning · Computer Science 2024-03-26 Yuhao Liu , Marzieh Ajirak , Petar Djuric