English
Related papers

Related papers: A Gaussian Comparison Theorem for Training Dynamic…

200 papers

This paper presents a problem of model learning for the purpose of learning how to navigate a ball to a goal state in a circular maze environment with two degrees of freedom. The motion of the ball in the maze environment is influenced by…

Robotics · Computer Science 2018-09-20 Diego Romeres , Devesh Jha , Alberto Dalla Libera , William Yerazunis , Daniel Nikovski

While Generative Adversarial Networks (GANs) have demonstrated promising performance on multiple vision tasks, their learning dynamics are not yet well understood, both in theory and in practice. To address this issue, we study GAN dynamics…

Machine Learning · Computer Science 2018-06-05 Jerry Li , Aleksander Madry , John Peebles , Ludwig Schmidt

For a large class of feature maps we provide a tight asymptotic characterisation of the test error associated with learning the readout layer, in the high-dimensional limit where the input dimension, hidden layer widths, and number of…

Machine Learning · Statistics 2024-06-11 Dominik Schröder , Daniil Dmitriev , Hugo Cui , Bruno Loureiro

The purpose of this paper is to provide a discussion, with illustrating examples, on Bayesian forecasting for dynamic generalized linear models (DGLMs). Adopting approximate Bayesian analysis, based on conjugate forms and on Bayes linear…

Methodology · Statistics 2008-02-05 K. Triantafyllopoulos

Gaussian processes provide a compact representation for modeling and estimating an unknown function, that can be updated as new measurements of the function are obtained. This paper extends this powerful framework to the case where the…

Systems and Control · Electrical Eng. & Systems 2023-11-30 Jilles van Hulst , Roy van Zuijlen , Duarte Antunes , W. P. M. H. , Heemels

In this paper, we introduce a novel Gaussian mixture based evidential learning solution for robust stereo matching. Diverging from previous evidential deep learning approaches that rely on a single Gaussian distribution, our framework…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Weide Liu , Xingxing Wang , Lu Wang , Jun Cheng , Fayao Liu , Xulei Yang

We study the global fluctuations for a class of determinantal point processes coming from large systems of non-colliding processes and non-intersecting paths. Our main assumption is that the point processes are constructed by biorthogonal…

Mathematical Physics · Physics 2015-12-22 Maurice Duits

This work presents a novel algorithm that integrates a data-efficient function approximator with reinforcement learning in continuous state spaces. An online and incremental algorithm capable of learning from a single pass through data,…

Machine Learning · Computer Science 2020-11-03 Rafael Pinto

This work studies the global convergence and implicit bias of Gauss Newton's (GN) when optimizing over-parameterized one-hidden layer networks in the mean-field regime. We first establish a global convergence result for GN in the…

Machine Learning · Computer Science 2023-12-13 Michael Arbel , Romain Menegaux , Pierre Wolinski

Topic modeling of textual corpora is an important and challenging problem. In most previous work, the "bag-of-words" assumption is usually made which ignores the ordering of words. This assumption simplifies the computation, but it…

Machine Learning · Computer Science 2015-02-13 Min Yang , Tianyi Cui , Wenting Tu

Established techniques for simulation and prediction with Gaussian process (GP) dynamics often implicitly make use of an independence assumption on successive function evaluations of the dynamics model. This can result in significant error…

Machine Learning · Computer Science 2020-05-05 Lukas Hewing , Elena Arcari , Lukas P. Fröhlich , Melanie N. Zeilinger

Physical systems can often be described via a continuous-time dynamical system. In practice, the true system is often unknown and has to be learned from measurement data. Since data is typically collected in discrete time, e.g. by sensors,…

Machine Learning · Computer Science 2024-01-31 Katharina Ensinger , Nicholas Tagliapietra , Sebastian Ziesche , Sebastian Trimpe

In this paper, we study random subsampling of Gaussian process regression, one of the simplest approximation baselines, from a theoretical perspective. Although subsampling discards a large part of training data, we show provable guarantees…

Machine Learning · Statistics 2019-01-29 Kohei Hayashi , Masaaki Imaizumi , Yuichi Yoshida

Generative adversarial networks (GANs) learn the distribution of observed samples through a zero-sum game between two machine players, a generator and a discriminator. While GANs achieve great success in learning the complex distribution of…

Machine Learning · Computer Science 2020-06-19 Farzan Farnia , William Wang , Subhro Das , Ali Jadbabaie

This article focuses on the general theory of open quantum systems in the Gaussian regime and explores a number of diverse ramifications and consequences of the theory. We shall first introduce the Gaussian framework in its full generality,…

Quantum Physics · Physics 2017-01-19 Marco G. Genoni , Ludovico Lami , Alessio Serafini

A generalized Gaussian process model (GGPM) is a unifying framework that encompasses many existing Gaussian process (GP) models, such as GP regression, classification, and counting. In the GGPM framework, the observation likelihood of the…

Machine Learning · Statistics 2013-11-28 Lifeng Shang , Antoni B. Chan

Sparse variational Gaussian processes (GPs) construct tractable posterior approximations to GP models. At the core of these methods is the assumption that the true posterior distribution over training function values ${\bf f}$ and inducing…

Machine Learning · Computer Science 2025-06-27 Michalis K. Titsias

Parton distribution functions (PDFs) form an essential part of particle physics calculations. Currently, the most precise predictions for these non-perturbative functions are generated through fits to global data. A problem that several PDF…

High Energy Physics - Phenomenology · Physics 2025-09-04 Mengshi Yan , Tie-Jiun Hou , Zhao Li , Kirtimaan Mohan , C. -P. Yuan

An important question in deep learning is how higher-order optimization methods affect generalization. In this work, we analyze a stochastic Gauss-Newton (SGN) method with Levenberg-Marquardt damping and mini-batch sampling for training…

Machine Learning · Computer Science 2025-11-13 Semih Cayci

Identifying the underlying dynamics of physical systems can be challenging when only provided with observational data. In this work, we consider systems that can be modelled as first-order ordinary differential equations. By assuming a…

Systems and Control · Electrical Eng. & Systems 2024-01-03 Sigurd Holmsen , Sølve Eidnes , Signe Riemer-Sørensen