English
Related papers

Related papers: Efficient training of Gaussian processes with tens…

200 papers

In computational physics, machine learning has now emerged as a powerful complementary tool to explore efficiently candidate designs in engineering studies. Outputs in such supervised problems are signals defined on meshes, and a natural…

Machine Learning · Statistics 2025-03-11 Raphaël Carpintero Perez , Sébastien da Veiga , Josselin Garnier , Brian Staber

We provide a computational framework for approximating a class of structured matrices; here, the term structure is very general, and may refer to a regular sparsity pattern (e.g., block-banded), or be more highly structured (e.g., symmetric…

Numerical Analysis · Mathematics 2021-05-05 Misha E. Kilmer , Arvind K. Saibaba

Higher-order data with high dimensionality arise in a diverse set of application areas such as computer vision, video analytics and medical imaging. Tensors provide a natural tool for representing these types of data. Although there has…

Signal Processing · Electrical Eng. & Systems 2020-08-04 Seyyid Emre Sofuoglu , Selin Aviyente

Banded matrices can be used as precision matrices in several models including linear state-space models, some Gaussian processes, and Gaussian Markov random fields. The aim of the paper is to make modern inference methods (such as…

Machine Learning · Statistics 2019-02-27 Nicolas Durrande , Vincent Adam , Lucas Bordeaux , Stefanos Eleftheriadis , James Hensman

We discuss the efficient computation of performance, reliability, and availability measures for Markov chains; these metrics, and the ones obtained by combining them, are often called performability measures. We show that this computational…

Numerical Analysis · Mathematics 2019-10-11 Giulio Masetti , Leonardo Robol

In engineering design, one often wishes to calculate the probability that the performance of a system is satisfactory under uncertainty. State of the art algorithms exist to solve this problem using active learning with Gaussian process…

Machine Learning · Computer Science 2022-11-03 Jonathan Sadeghi , Romain Mueller , John Redford

Tensor decomposition methods have proven effective in various applications, including compression and acceleration of neural networks. At the same time, the problem of determining optimal decomposition ranks, which present the crucial…

Machine Learning · Computer Science 2023-04-05 Maxim Kodryan , Dmitry Kropotov , Dmitry Vetrov

In machine learning, knowing the impact of a given datum on model training is a fundamental task referred to as Data Valuation. Building on previous works from the literature, we have designed a novel canonical decomposition allowing…

Machine Learning · Computer Science 2025-06-05 Clément Bénesse , Patrick Mesana , Athénaïs Gautier , Sébastien Gambs

Gaussian processes are probabilistic models that are commonly used as functional priors in machine learning. Due to their probabilistic nature, they can be used to capture the prior information on the statistics of noise, smoothness of the…

Computation · Statistics 2024-02-02 Ahmad Farooq , Cristian A. Galvis-Florez , Simo Särkkä

In this paper we develop a dynamic form of Bayesian optimization for machine learning models with the goal of rapidly finding good hyperparameter settings. Our method uses the partial information gained during the training of a machine…

Machine Learning · Statistics 2014-06-17 Kevin Swersky , Jasper Snoek , Ryan Prescott Adams

Modeling joint probability distributions over sequences has been studied from many perspectives. The physics community developed matrix product states, a tensor-train decomposition for probabilistic modeling, motivated by the need to…

Machine Learning · Computer Science 2020-10-22 Siddarth Srinivasan , Sandesh Adhikary , Jacob Miller , Guillaume Rabusseau , Byron Boots

We propose a simple method that combines neural networks and Gaussian processes. The proposed method can estimate the uncertainty of outputs and flexibly adjust target functions where training data exist, which are advantages of Gaussian…

Machine Learning · Statistics 2017-07-20 Tomoharu Iwata , Zoubin Ghahramani

In the literature on deep neural networks, there is considerable interest in developing activation functions that can enhance neural network performance. In recent years, there has been renewed scientific interest in proposing activation…

Machine Learning · Computer Science 2023-04-20 Mohamed Fakhfakh , Lotfi Chaari

We propose a method for learning constraints represented as Gaussian processes (GPs) from locally-optimal demonstrations. Our approach uses the Karush-Kuhn-Tucker (KKT) optimality conditions to determine where on the demonstrations the…

Robotics · Computer Science 2022-03-02 Glen Chou , Hao Wang , Dmitry Berenson

Brown-Resnick processes are max-stable processes that are associated to Gaussian processes. Their simulation is often based on the corresponding spectral representation which is not unique. We study to what extent simulation accuracy and…

Probability · Mathematics 2018-10-17 Marco Oesting , Kirstin Strokorb

Gaussian processes have become a popular tool for nonparametric regression because of their flexibility and uncertainty quantification. However, they often use stationary kernels, which limit the expressiveness of the model and may be…

Machine Learning · Computer Science 2025-07-17 Zachary James , Joseph Guinness

Most machine learning methods require careful selection of hyper-parameters in order to train a high performing model with good generalization abilities. Hence, several automatic selection algorithms have been introduced to overcome tedious…

Machine Learning · Computer Science 2020-01-17 Raju Ram , Sabine Müller , Franz-Josef Pfreundt , Nicolas R. Gauger , Janis Keuper

The Bayesian approach to Inverse Problems relies predominantly on Markov Chain Monte Carlo methods for posterior inference. The typical nonlinear concentration of posterior measure observed in many such Inverse Problems presents severe…

Computation · Statistics 2016-02-17 Shiwei Lan , Tan Bui-Thanh , Mike Christie , Mark Girolami

Quantum state tomography is a key technique for quantum information processing, but is challenging due to the exponential growth of its complexity with the system size. In this work, we propose an algorithm which iteratively finds the best…

Quantum Physics · Physics 2022-05-13 Donghong Han , Chu Guo , Xiaoting Wang

The optimization algorithms for solving multi-parameter inverse problem for the mathematical model of parabolic equations arising in social networks, epidemiology and economy are investigated. The data fitting is formulated as optimization…

Optimization and Control · Mathematics 2019-06-13 Kabanikhin Sergey , Krivorotko Olga , Zhang Shuhua , Kashtanova Victoriya , Wang Yufang