English
Related papers

Related papers: Replacing Gaussian Processes with Neural Networks …

200 papers

Gaussian processes offers a convenient way to perform nonparametric reconstructions of observational data assuming only a kernel which describes the covariance between neighbouring points in a data set. We approach the ambiguity in the…

Cosmology and Nongalactic Astrophysics · Physics 2021-08-17 Reginald Christian Bernardo , Jackson Levi Said

Probabilistic machine learning models are distinguished by their ability to integrate prior knowledge of noise statistics, smoothness parameters, and training data uncertainty. A common approach involves modeling data with Gaussian…

Computation · Statistics 2025-07-31 Cristian A. Galvis-Florez , Ahmad Farooq , Simo Särkkä

The characterization of nanohertz-frequency gravitational waves (GWs) with pulsar-timing arrays requires a continual expansion of datasets and monitored pulsars. Whereas detection of the stochastic GW background is predicated on measuring a…

General Relativity and Quantum Cosmology · Physics 2022-05-11 Stephen R. Taylor , Joseph Simon , Levi Schult , Nihan Pol , William G. Lamb

Neural networks are used extensively in classification problems in particle physics research. Since the training of neural networks can be viewed as a problem of inference, Bayesian learning of neural networks can provide more optimal and…

Data Analysis, Statistics and Probability · Physics 2007-07-09 Michael Pogwizd , Laura Jane Elgass , Pushpalatha C. Bhat

This paper is centered around the approximation of dynamical systems by means of Gaussian processes. To this end, trajectories of such systems must be collected to be used as training data. The measurements of these trajectories are…

Systems and Control · Electrical Eng. & Systems 2025-04-02 Tobias M. Wolff , Victor G. Lopez , Matthias A. Müller

The accurate prediction of time-changing variances is an important task in the modeling of financial data. Standard econometric models are often limited as they assume rigid functional relationships for the variances. Moreover, function…

Methodology · Statistics 2014-02-14 Yue Wu , Jose Miguel Hernandez Lobato , Zoubin Ghahramani

The increased demand for online prediction and the growing availability of large data sets drives the need for computationally efficient models. While exact Gaussian process regression shows various favorable theoretical properties…

Machine Learning · Computer Science 2021-08-02 Armin Lederer , Alejandro Jose Ordonez Conejo , Korbinian Maier , Wenxin Xiao , Jonas Umlauft , Sandra Hirche

Multi-task learning requires accurate identification of the correlations between tasks. In real-world time-series, tasks are rarely perfectly temporally aligned; traditional multi-task models do not account for this and subsequent errors in…

This paper proposes a new algorithm for Gaussian process classification based on posterior linearisation (PL). In PL, a Gaussian approximation to the posterior density is obtained iteratively using the best possible linearisation of the…

Machine Learning · Computer Science 2019-04-19 Ángel F. García-Fernández , Filip Tronarp , Simo Särkkä

After large galaxies merge, their central supermassive black holes are expected to form binary systems whose orbital motion generates a gravitational wave background (GWB) at nanohertz frequencies. Searches for this background utilize…

High Energy Astrophysical Phenomena · Physics 2022-04-12 M. Ajello , W. B. Atwood , L. Baldini , J. Ballet , G. Barbiellini , D. Bastieri , R. Bellazzini , A. Berretta , B. Bhattacharyya , E. Bissaldi , R. D. Blandford , E. Bloom , R. Bonino , P. Bruel , R. Buehler , E. Burns , S. Buson , R. A. Cameron , P. A. Caraveo , E. Cavazzuti , N. Cibrario , S. Ciprini , C. J. Clark , I. Cognard , J. Coronado-Blázquez , M. Crnogorcevic , H. Cromartie , K. Crowter , S. Cutini , F. D'Ammando , S. D. Gaetano , F. d. Palma , S. W. Digel , N. D. Lalla , F. Fan. Dirirsa , L. D. Venere , A. Domínguez , E. C. Ferrara , A. Fiori , A. Franckowiak , Y. Fukazawa , S. Funk , P. Fusco , V. Gammaldi , F. Gargano , D. Gasparrini , N. Giglietto , F. Giordano , M. Giroletti , D. Green , I. A. Grenier , L. Guillemot , S. Guiriec , M. Gustafsson , A. K. Harding , E. Hays , J. W. Hewitt , D. Horan , X. Hou , G. Jóhannesson , M. J. Keith , M. Kerr , M. Kramer , M. Kuss , S. Larsson , L. Latronico , J. Li , F. Longo , F. Loparco , M. N. Lovellette , P. Lubrano , S. Maldera , A. Manfreda , G. Martí-Devesa , M. N. Mazziotta , I. Mereu , P. F. Michelson , N. Mirabal , W. Mitthumsiri , T. Mizuno , M. E. Monzani , A. Morselli , M. Negro , L. Nieder , R. Ojha , N. Omodei , M. Orienti , E. Orlando , J. F. Ormes , D. Paneque , A. Parthasarathy , Z. Pei , M. Persic , M. Pesce-Rollins , R. Pillera , H. Poon , T. A. Porter , G. Principe , J. L. Racusin , S. Rainò , R. Rando , B. Rani , S. M. Ransom , P. S. Ray , M. Razzano , S. Razzaque , A. Reimer , O. Reimer , J. Roy , M. Sánchez-Conde , P. M. Sa. Parkinson , J. Scargle , L. Scotton , D. Serini , C. Sgrò , E. J. Siskind , D. A. Smith , G. Spandre , R. Spiewak , P. Spinelli , I. Stairs , D. J. Suson , S. J. Swihart , S. Tabassum , J. B. Thayer , G. Theureau , D. F. Torres , E. Troja , J. Valverde , Z. Wadiasingh , K. Wood , G. Zaharijas

A fully Bayesian treatment of complicated predictive models (such as deep neural networks) would enable rigorous uncertainty quantification and the automation of higher-level tasks including model selection. However, the intractability of…

Posterior sampling by Monte Carlo methods provides a more comprehensive solution approach to inverse problems than computing point estimates such as the maximum posterior using optimization methods, at the expense of usually requiring many…

Numerical Analysis · Mathematics 2024-11-28 Paolo Villani , Daniel Andrés-Arcones , Jörg F. Unger , Martin Weiser

Machine learning algorithms frequently require careful tuning of model hyperparameters, regularization terms, and optimization parameters. Unfortunately, this tuning is often a "black art" that requires expert experience, unwritten rules of…

Machine Learning · Statistics 2012-08-30 Jasper Snoek , Hugo Larochelle , Ryan P. Adams

A key challenge in spatial statistics is the analysis for massive spatially-referenced data sets. Such analyses often proceed from Gaussian process specifications that can produce rich and robust inference, but involve dense covariance…

Methodology · Statistics 2019-07-25 Shinichiro Shirota , Andrew O. Finley , Bruce D. Cook , Sudipto Banerjee

Searching for gravitational waves in pulsar timing array data is computationally intensive. The data is unevenly sampled, and the noise is heteroscedastic, necessitating the use of a time-domain likelihood function with attendant expensive…

General Relativity and Quantum Cosmology · Physics 2022-06-22 Bence Bécsy , Neil J. Cornish , Matthew C. Digman

Deep Gaussian processes (DGPs) are multi-layer hierarchical generalisations of Gaussian processes (GPs) and are formally equivalent to neural networks with multiple, infinitely wide hidden layers. DGPs are probabilistic and non-parametric…

Pulsar timing array (PTA) searches for a gravitational-wave background (GWB) typically include time-correlated "red" noise models intrinsic to each pulsar. Using a simple simulated PTA dataset with an injected GWB signal we show that the…

Instrumentation and Methods for Astrophysics · Physics 2020-12-16 Jeffrey S. Hazboun , Joseph Simon , Xavier Siemens , Joseph D. Romano

In recent years, much work have studied the use of convolutional neural networks for gravitational-wave detection. However little work pay attention to whether the transient noise can trigger the CNN model or not. In this paper, we study…

General Relativity and Quantum Cosmology · Physics 2021-03-08 Chao Zhan , Mingzhen Jia , Cunliang Ma , Zhongliang Lu , Wenbin Lin

The present operation of the ground-based network of gravitational-wave laser interferometers in "enhanced" configuration brings the search for gravitational waves into a regime where detection is highly plausible. The development of…

Cosmology and Nongalactic Astrophysics · Physics 2015-03-13 John Veitch , Alberto Vecchio

Gaussian processes are a natural way of defining prior distributions over functions of one or more input variables. In a simple nonparametric regression problem, where such a function gives the mean of a Gaussian distribution for an…

Data Analysis, Statistics and Probability · Physics 2008-02-03 Radford M. Neal