English
Related papers

Related papers: Decomposing feature-level variation with Covariate…

200 papers

Dimensionality reduction (DR) offers a useful representation of complex high-dimensional data. Recent DR methods focus on hyperbolic geometry to derive a faithful low-dimensional representation of hierarchical data. However, existing…

Machine Learning · Computer Science 2026-04-24 Koshi Watanabe , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

Extracting meaningful information from high-dimensional data poses a formidable modeling challenge, particularly when the data is obscured by noise or represented through different modalities. This research proposes a novel non-parametric…

Machine Learning · Computer Science 2024-08-27 Navid Ziaei , Behzad Nazari , Uri T. Eden , Alik Widge , Ali Yousefi

Unsupervised learning on imbalanced data is challenging because, when given imbalanced data, current model is often dominated by the major category and ignores the categories with small amount of data. We develop a latent variable model…

Machine Learning · Computer Science 2016-07-04 Fariba Yousefi , Zhenwen Dai , Carl Henrik Ek , Neil Lawrence

In this paper we propose a novel Bayesian solution for nonlinear regression in complex fields. Previous solutions for kernels methods usually assume a complexification approach, where the real-valued kernel is replaced by a complex-valued…

Machine Learning · Computer Science 2018-03-02 Rafael Boloix-Tortosa , Eva Arias-de-Reyna , F. Javier Payan-Somet , Juan J. Murillo-Fuentes

In this tutorial we explain the inference procedures developed for the sparse Gaussian process (GP) regression and Gaussian process latent variable model (GPLVM). Due to page limit the derivation given in Titsias (2009) and Titsias &…

Machine Learning · Statistics 2014-10-01 Yarin Gal , Mark van der Wilk

The Multi-Output Gaussian Process is is a popular tool for modelling data from multiple sources. A typical choice to build a covariance function for a MOGP is the Linear Model of Coregionalization (LMC) which parametrically models the…

Machine Learning · Computer Science 2025-06-13 Xiaoyu Jiang , Sokratia Georgaka , Magnus Rattray , Mauricio A. Álvarez

High dimensional time series are endemic in applications of machine learning such as robotics (sensor data), computational biology (gene expression data), vision (video sequences) and graphics (motion capture data). Practical nonlinear…

Machine Learning · Statistics 2011-07-26 Andreas C. Damianou , Michalis K. Titsias , Neil D. Lawrence

We present a scalable Gaussian process model for identifying and characterizing smooth multidimensional changepoints, and automatically learning changes in expressive covariance structure. We use Random Kitchen Sink features to flexibly…

Properties of data are frequently seen to vary depending on the sampled situations, which usually changes along a time evolution or owing to environmental effects. One way to analyze such data is to find invariances, or representative…

Machine Learning · Statistics 2012-09-26 Satoshi Hara , Takashi Washio

Gaussian processes (GPs) have been extensively utilized as nonparametric models for component separation in 21 cm data analyses. This exploits the distinct spectral behavior of the cosmological and foreground signals, which are modeled…

Cosmology and Nongalactic Astrophysics · Physics 2025-05-13 Kangning Diao , Richard D. P. Grumitt , Yi Mao

Gaussian graphical models (GGMs) are widely used to recover the conditional independence structure among random variables. Recent work has sought to incorporate auxiliary covariates to improve estimation, particularly in applications such…

Methodology · Statistics 2026-03-31 Ruobin Liu , Guo Yu

The state-of-the-art dimensionality reduction approaches largely rely on complicated optimization procedures. On the other hand, closed-form approaches requiring merely eigen-decomposition do not have enough sophistication and nonlinearity.…

Machine Learning · Computer Science 2023-08-14 Chengrui Li , Anqi Wu

Modern biomedical datasets are increasingly high dimensional and exhibit complex correlation structures. Generalized Linear Mixed Models (GLMMs) have long been employed to account for such dependencies. However, proper specification of the…

Variational autoencoders often assume isotropic Gaussian priors and mean-field posteriors, hence do not exploit structure in scenarios where we may expect similarity or consistency across latent variables. Gaussian process variational…

Machine Learning · Statistics 2020-11-17 Metod Jazbec , Michael Pearce , Vincent Fortuin

We would like to learn latent representations that are low-dimensional and highly interpretable. A model that has these characteristics is the Gaussian Process Latent Variable Model. The benefits and negative of the GP-LVM are complementary…

Machine Learning · Statistics 2017-12-19 Erik Bodin , Iman Malik , Carl Henrik Ek , Neill D. F. Campbell

The Dynamical Gaussian Process Latent Variable Models provide an elegant non-parametric framework for learning the low dimensional representations of the high-dimensional time-series. Real world observational studies, however, are often…

Machine Learning · Computer Science 2019-09-26 Thanh Le , Vasant Honavar

Complex-valued signals are used in the modeling of many systems in engineering and science, hence being of fundamental interest. Often, random complex-valued signals are considered to be proper. A proper complex random variable or process…

Machine Learning · Computer Science 2015-02-19 Rafael Boloix-Tortosa , F. Javier Payán-Somet , Eva Arias-de-Reyna , Juan José Murillo-Fuentes

We introduce a Gaussian Prototype Layer for gradient-based prototype learning and demonstrate two novel network architectures for explainable segmentation one of which relies on region proposals. Both models are evaluated on agricultural…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Michael Gerstenberger , Steffen Maaß , Peter Eisert , Sebastian Bosse

This paper proposes a novel method for deep learning based on the analytical convolution of multidimensional Gaussian mixtures. In contrast to tensors, these do not suffer from the curse of dimensionality and allow for a compact…

Machine Learning · Computer Science 2022-02-21 Adam Celarek , Pedro Hermosilla , Bernhard Kerbl , Timo Ropinski , Michael Wimmer

Gaussian processes provide a powerful probabilistic kernel learning framework, which allows learning high quality nonparametric regression models via methods such as Gaussian process regression. Nevertheless, the learning phase of Gaussian…

Numerical Analysis · Mathematics 2021-01-06 Paz Fink Shustin , Haim Avron