English
Related papers

Related papers: Federated Automatic Latent Variable Selection in M…

200 papers

For a learning task, Gaussian process (GP) is interested in learning the statistical relationship between inputs and outputs, since it offers not only the prediction mean but also the associated variability. The vanilla GP however struggles…

Machine Learning · Statistics 2020-09-01 Haitao Liu , Yew-Soon Ong , Xiaomo Jiang , Xiaofang Wang

In this paper, we propose \texttt{FGPR}: a Federated Gaussian process ($\mathcal{GP}$) regression framework that uses an averaging strategy for model aggregation and stochastic gradient descent for local client computations. Notably, the…

Machine Learning · Statistics 2024-04-01 Xubo Yue , Raed Al Kontar

Gaussian process (GP) regression with 1D inputs can often be performed in linear time via a stochastic differential equation formulation. However, for non-Gaussian likelihoods, this requires application of approximate inference methods…

Machine Learning · Computer Science 2020-07-20 Paul E. Chang , William J. Wilkinson , Mohammad Emtiyaz Khan , Arno Solin

In this paper, we propose decentralized and scalable algorithms for Gaussian process (GP) training and prediction in multi-agent systems. To decentralize the implementation of GP training optimization algorithms, we employ the alternating…

Machine Learning · Statistics 2022-03-08 George P. Kontoudis , Daniel J. Stilwell

A model involving Gaussian processes (GPs) is introduced to simultaneously handle multi-task learning, clustering, and prediction for multiple functional data. This procedure acts as a model-based clustering method for functional data as…

Machine Learning · Computer Science 2023-01-24 Arthur Leroy , Pierre Latouche , Benjamin Guedj , Servane Gey

Gaussian processes (GPs) have been proven to be powerful tools in various areas of machine learning. However, there are very few applications of GPs in the scenario of multi-view learning. In this paper, we present a new GP model for…

Machine Learning · Statistics 2017-01-18 Qiuyang Liu , Shiliang Sun

Federated learning describes the distributed training of models across multiple clients while keeping the data private on-device. In this work, we view the server-orchestrated federated learning process as a hierarchical latent variable…

Machine Learning · Computer Science 2021-11-22 Christos Louizos , Matthias Reisser , Joseph Soriaga , Max Welling

Federated learning (FL) enables leveraging distributed private data for model training in a privacy-preserving way. However, data heterogeneity significantly limits the performance of current FL methods. In this paper, we propose a novel FL…

Machine Learning · Computer Science 2023-12-12 Rui Ye , Xinyu Zhu , Jingyi Chai , Siheng Chen , Yanfeng Wang

Multi-task regression attempts to exploit the task similarity in order to achieve knowledge transfer across related tasks for performance improvement. The application of Gaussian process (GP) in this scenario yields the non-parametric yet…

Machine Learning · Statistics 2021-09-21 Haitao Liu , Jiaqi Ding , Xinyu Xie , Xiaomo Jiang , Yusong Zhao , Xiaofang Wang

Federated Learning (FL) is a promising machine learning paradigm that enables participating devices to train privacy-preserved and collaborative models. FL has proven its benefits for robotic manipulation tasks. However, grasping tasks lack…

Machine Learning · Computer Science 2025-07-17 Obaidullah Zaland , Erik Elmroth , Monowar Bhuyan

This paper introduces an active learning framework for manifold Gaussian Process (GP) regression, combining manifold learning with strategic data selection to improve accuracy in high-dimensional spaces. Our method jointly optimizes a…

Machine Learning · Statistics 2026-05-12 Yuanxing Cheng , Lulu Kang , Yiwei Wang , Chun Liu

The Gaussian process latent variable model (GP-LVM) provides a flexible approach for non-linear dimensionality reduction that has been widely applied. However, the current approach for training GP-LVMs is based on maximum likelihood, where…

Machine Learning · Statistics 2014-09-09 Andreas C. Damianou , Michalis K. Titsias , Neil D. Lawrence

Artificial intelligence and machine learning frameworks have served as computationally efficient mapping between inputs and outputs for engineering problems. These mappings have enabled optimization and analysis routines that have warranted…

Machine Learning · Statistics 2024-07-17 Yigitcan Comlek , Sandipp Krishnan Ravi , Piyush Pandita , Sayan Ghosh , Liping Wang , Wei Chen

Through sequential construction of posteriors on observing data online, Bayes' theorem provides a natural framework for continual learning. We develop Variational Auto-Regressive Gaussian Processes (VAR-GPs), a principled posterior updating…

Machine Learning · Statistics 2021-06-15 Sanyam Kapoor , Theofanis Karaletsos , Thang D. Bui

The feasibility of federated learning is highly constrained by the server-clients infrastructure in terms of network communication. Most newly launched smartphones and IoT devices are equipped with GPUs or sufficient computing hardware to…

Machine Learning · Computer Science 2020-07-21 Marten van Dijk , Nhuong V. Nguyen , Toan N. Nguyen , Lam M. Nguyen , Quoc Tran-Dinh , Phuong Ha Nguyen

Federated learning, where algorithms are trained across multiple decentralized devices without sharing local data, is increasingly popular in distributed machine learning practice. Typically, a graph structure $G$ exists behind local…

Machine Learning · Statistics 2022-09-20 Huiyuan Wang , Xuyang Zhao , Wei Lin

This work introduces the Efficient Transformed Gaussian Process (ETGP), a new way of creating C stochastic processes characterized by: 1) the C processes are non-stationary, 2) the C processes are dependent by construction without needing a…

Machine Learning · Computer Science 2022-06-01 Juan Maroñas , Daniel Hernández-Lobato

Time-series prediction is increasingly popular in a variety of applications, such as smart factories and smart transportation. Researchers have used various techniques to predict power consumption, but existing models lack discussion of…

Machine Learning · Computer Science 2025-01-22 Jia-Hao Syu , Jerry Chun-Wei Lin , Gautam Srivastava , Unil Yun

Multi-Output Gaussian Processes (MOGPs) provide a principled probabilistic framework for modelling correlated outputs but face scalability bottlenecks when applied to datasets with high-dimensional output spaces. To maintain tractability,…

Machine Learning · Computer Science 2026-05-29 Xiaoyu Jiang , Xinxing Shi , Sokratia Georgaka , Magnus Rattray , Mauricio A Álvarez

The data-driven approach is emerging as a promising method for the topological design of multiscale structures with greater efficiency. However, existing data-driven methods mostly focus on a single class of microstructures without…

Computational Engineering, Finance, and Science · Computer Science 2020-09-17 Liwei Wang , Siyu Tao , Ping Zhu , Wei Chen