English
Related papers

Related papers: A reproducible comparative study of categorical ke…

200 papers

Forecasting in probabilistic time series is a complex endeavor that extends beyond predicting future values to also quantifying the uncertainty inherent in these predictions. Gaussian process regression stands out as a Bayesian machine…

Categorical predictors are omnipresent in everyday regression practice: in fact, most regression data involve some categorical predictors, and this tendency is increasing in modern applications with more complex structures and larger data…

Methodology · Statistics 2025-11-11 Chaegeun Song , Zhong Zheng , Bing Li , Lingzhou Xue

Numerical simulation is powerful to study nonlinear solid mechanics problems. However, mesh-based or particle-based numerical methods suffer from the common shortcoming of being time-consuming, particularly for complex problems with…

Machine Learning · Statistics 2024-09-18 Ming-Jian Li , Yanping Lian , Zhanshan Cheng , Lehui Li , Zhidong Wang , Ruxin Gao , Daining Fang

Recently, some contrastive learning methods have been proposed to simultaneously learn representations and clustering assignments, achieving significant improvements. However, these methods do not take the category information and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Huasong Zhong , Jianlong Wu , Chong Chen , Jianqiang Huang , Minghua Deng , Liqiang Nie , Zhouchen Lin , Xian-Sheng Hua

Supervised learning has recently garnered significant attention in the field of computational physics due to its ability to effectively extract complex patterns for tasks like solving partial differential equations, or predicting material…

Machine Learning · Statistics 2024-03-12 Raphaël Carpintero Perez , Sébastien da Veiga , Josselin Garnier , Brian Staber

Similarity-based clustering and semi-supervised learning methods separate the data into clusters or classes according to the pairwise similarity between the data, and the pairwise similarity is crucial for their performance. In this paper,…

Machine Learning · Statistics 2017-09-06 Yingzhen Yang , Feng Liang , Nebojsa Jojic , Shuicheng Yan , Jiashi Feng , Thomas S. Huang

Low-rank tensor regression, a new model class that learns high-order correlation from data, has recently received considerable attention. At the same time, Gaussian processes (GP) are well-studied machine learning models for structure…

Machine Learning · Computer Science 2017-11-01 Rose Yu , Guangyu Li , Yan Liu

A fundamental drawback of kernel-based statistical models is their limited scalability to large data sets, which requires resorting to approximations. In this work, we focus on the popular Gaussian kernel and on techniques to linearize…

Machine Learning · Statistics 2022-04-13 Jonas Wacker , Maurizio Filippone

This paper develops a novel mathematical framework for collaborative learning by means of geometrically inspired kernel machines which includes statements on the bounds of generalisation and approximation errors, and sample complexity. For…

We introduce a method that uses low-rank approximations of cross-correlation matrices in mixed continuous and categorical Gaussian Process models. This new method -- called Low-Rank Correlation (LRC) -- offers the ability to flexibly adapt…

Machine Learning · Statistics 2020-10-07 Dominik Kirchhoff , Sonja Kuhnt

We consider the problem of operator-valued kernel learning and investigate the possibility of going beyond the well-known separable kernels. Borrowing tools and concepts from the field of quantum computing, such as partial trace and…

Machine Learning · Computer Science 2021-01-18 Riikka Huusari , Hachem Kadri

Clustering is often used for discovering structure in data. Clustering systems differ in the objective function used to evaluate clustering quality and the control strategy used to search the space of clusterings. Ideally, the search…

Artificial Intelligence · Computer Science 2014-11-17 D. Fisher

A method to reconstruct fields, source strengths and physical parameters based on Gaussian process regression is presented for the case where data are known to fulfill a given linear differential equation with localized sources. The…

Data Analysis, Statistics and Probability · Physics 2019-09-10 Christopher G. Albert

Gaussian process regression is a popular Bayesian framework for surrogate modeling of expensive data sources. As part of a broader effort in scientific machine learning, many recent works have incorporated physical constraints or other a…

Machine Learning · Computer Science 2021-01-07 Laura Swiler , Mamikon Gulian , Ari Frankel , Cosmin Safta , John Jakeman

A structure-preserving kernel ridge regression method is presented that allows the recovery of nonlinear Hamiltonian functions out of datasets made of noisy observations of Hamiltonian vector fields. The method proposes a closed-form…

Machine Learning · Statistics 2025-04-07 Jianyu Hu , Juan-Pablo Ortega , Daiying Yin

This work incorporates the multi-modality of the data distribution into a Gaussian Process regression model. We approach the problem from a discriminative perspective by learning, jointly over the training data, the target space variance in…

Machine Learning · Computer Science 2018-03-20 Silvia L. Pintea , Jan C. van Gemert , Arnold W. M. Smeulders

In this paper we propose a novel Bayesian solution for nonlinear regression in complex fields. Previous solutions for kernels methods usually assume a complexification approach, where the real-valued kernel is replaced by a complex-valued…

Machine Learning · Computer Science 2018-03-02 Rafael Boloix-Tortosa , Eva Arias-de-Reyna , F. Javier Payan-Somet , Juan J. Murillo-Fuentes

We propose a principled way to define Gaussian process priors on various sets of unweighted graphs: directed or undirected, with or without loops. We endow each of these sets with a geometric structure, inducing the notions of closeness and…

Machine Learning · Statistics 2023-02-28 Viacheslav Borovitskiy , Mohammad Reza Karimi , Vignesh Ram Somnath , Andreas Krause

Neural network-based clustering has recently gained popularity, and in particular a constrained clustering formulation has been proposed to perform transfer learning and image category discovery using deep learning. The core idea is to…

Computer Vision and Pattern Recognition · Computer Science 2018-06-29 Yen-Chang Hsu , Zhaoyang Lv , Joel Schlosser , Phillip Odom , Zsolt Kira

We design replicable algorithms in the context of statistical clustering under the recently introduced notion of replicability from Impagliazzo et al. [2022]. According to this definition, a clustering algorithm is replicable if, with high…

Machine Learning · Computer Science 2025-10-15 Hossein Esfandiari , Amin Karbasi , Vahab Mirrokni , Grigoris Velegkas , Felix Zhou