English
Related papers

Related papers: Statistical Model Aggregation via Parameter Matchi…

200 papers

Multi-task learning leverages shared information among data sets to improve the learning performance of individual tasks. The paper applies this framework for data where each task is a phase-shifted periodic time series. In particular, we…

Machine Learning · Computer Science 2015-03-20 Yuyang Wang , Roni Khardon , Pavlos Protopapas

Learning to sample from complex unnormalized distributions is a fundamental challenge in computational physics and machine learning. While score-based and variational methods have achieved success in continuous domains, extending them to…

Machine Learning · Statistics 2026-03-11 Lei Li , Zhen Wang , Lishuo Zhang

We formulate meta learning using information theoretic concepts; namely, mutual information and the information bottleneck. The idea is to learn a stochastic representation or encoding of the task description, given by a training set, that…

Machine Learning · Computer Science 2021-07-06 Michalis K. Titsias , Francisco J. R. Ruiz , Sotirios Nikoloutsopoulos , Alexandre Galashov

There is significant interest in learning and optimizing a complex system composed of multiple sub-components, where these components may be agents or autonomous sensors. Among the rich literature on this topic, agent-based and…

Machine Learning · Computer Science 2021-07-08 Kai Wang , Bryan Wilder , Sze-chuan Suen , Bistra Dilkina , Milind Tambe

We develop a flexible spline-based Bayesian hidden Markov model stochastic weather generator to statistically model daily precipitation over time by season at individual locations. The model naturally accounts for missing data (considered…

Applications · Statistics 2022-07-19 Christopher J. Paciorek

A network of independently trained Gaussian processes (StackedGP) is introduced to obtain predictions of quantities of interest with quantified uncertainties. The main applications of the StackedGP framework are to integrate different…

Machine Learning · Computer Science 2017-06-20 Kareem Abdelfatah , Junshu Bao , Gabriel Terejanu

Longitudinal data are important in numerous fields, such as healthcare, sociology and seismology, but real-world datasets present notable challenges for practitioners because they can be high-dimensional, contain structured missingness…

Machine Learning · Computer Science 2024-07-01 Maksim Sinelnikov , Manuel Haussmann , Harri Lähdesmäki

We propose a novel Bayesian approach to modelling nonlinear alignments of time series based on latent shared information. We apply the method to the real-world problem of finding common structure in the sensor data of wind turbines…

Machine Learning · Statistics 2018-05-24 Markus Kaiser , Clemens Otte , Thomas Runkler , Carl Henrik Ek

Finite Gaussian mixture models are widely used for model-based clustering of continuous data. Nevertheless, since the number of model parameters scales quadratically with the number of variables, these models can be easily…

Methodology · Statistics 2018-09-25 Michael Fop , Thomas Brendan Murphy , Luca Scrucca

Aggregate data often appear in various fields such as socio-economics and public security. The aggregate data are associated not with points but with supports (e.g., spatial regions in a city). Since the supports may have various…

We propose a new framework for generating cross-sectional synthetic datasets via disjoint generative models. In this paradigm, a dataset is partitioned into disjoint subsets that are supplied to separate instances of generative models. The…

Machine Learning · Computer Science 2025-07-29 Anton Danholt Lautrup , Muhammad Rajabinasab , Tobias Hyrup , Arthur Zimek , Peter Schneider-Kamp

We consider a dependent thinning of a regular point process with the aim of obtaining aggregation on the large scale and regularity on the small scale in the resulting target point process of retained points. Various parametric models for…

Methodology · Statistics 2015-05-28 Frédéric Lavancier , Jesper Møller

Multivariate categorical data occur in many applications of machine learning. One of the main difficulties with these vectors of categorical variables is sparsity. The number of possible observations grows exponentially with vector length,…

Machine Learning · Statistics 2015-03-10 Yarin Gal , Yutian Chen , Zoubin Ghahramani

Datasets containing large samples of time-to-event data arising from several small heterogeneous groups are commonly encountered in statistics. This presents problems as they cannot be pooled directly due to their heterogeneity or analyzed…

Machine Learning · Statistics 2016-12-05 Alexandre Piché , Russell Steele , Ian Shrier , Stephanie Long

We present a general construction for dependent random measures based on thinning Poisson processes on an augmented space. The framework is not restricted to dependent versions of a specific nonparametric model, but can be applied to all…

Machine Learning · Statistics 2012-11-21 Nicholas J. Foti , Joseph D. Futoma , Daniel N. Rockmore , Sinead Williamson

We study the fundamental problem of learning an unknown object from data using a prescribed model class. We introduce a unified framework that accommodates objects in arbitrary Hilbert spaces, general (possibly vector-valued) random linear…

Machine Learning · Computer Science 2026-03-09 Ben Adcock , Juan M. Cardenas , Nick Dexter

In learned image compression, probabilistic models play an essential role in characterizing the distribution of latent variables. The Gaussian model with mean and scale parameters has been widely used for its simplicity and effectiveness.…

Image and Video Processing · Electrical Eng. & Systems 2025-04-24 Haotian Zhang , Li Li , Dong Liu

Graphical models have been widely applied in solving distributed inference problems in sensor networks. In this paper, the problem of coordinating a network of sensors to train a unique ensemble estimator under communication constraints is…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Haipeng Zheng , Sanjeev R. Kulkarni , H. Vincent Poor

We present a unified framework for estimation and analysis of generalized additive models in high dimensions. The framework defines a large class of penalized regression estimators, encompassing many existing methods. An efficient…

Methodology · Statistics 2019-03-13 Asad Haris , Noah Simon , Ali Shojaie

Interpreting a nonparametric regression model with many predictors is known to be a challenging problem. There has been renewed interest in this topic due to the extensive use of machine learning algorithms and the difficulty in…

Machine Learning · Statistics 2018-09-11 Xiaoyu Liu , Jie Chen , Joel Vaughan , Vijayan Nair , Agus Sudjianto