English
Related papers

Related papers: Learning Active Subspaces and Discovering Importan…

200 papers

We present a novel Neural Embedding Spatio-Temporal (NEST) point process model for spatio-temporal discrete event data and develop an efficient imitation learning (a type of reinforcement learning) based approach for model fitting. Despite…

Machine Learning · Computer Science 2021-01-25 Shixiang Zhu , Shuang Li , Zhigang Peng , Yao Xie

The increased demand for online prediction and the growing availability of large data sets drives the need for computationally efficient models. While exact Gaussian process regression shows various favorable theoretical properties…

Machine Learning · Computer Science 2021-08-02 Armin Lederer , Alejandro Jose Ordonez Conejo , Korbinian Maier , Wenxin Xiao , Jonas Umlauft , Sandra Hirche

Symmetry, where certain features remain invariant under geometric transformations, can often serve as a powerful prior in designing convolutional neural networks (CNNs). While conventional CNNs inherently support translational equivariance,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Yuexi Du , Jiazhen Zhang , Nicha C. Dvornek , John A. Onofrey

Despite their widespread success, the application of deep neural networks to functional data remains scarce today. The infinite dimensionality of functional data means standard learning algorithms can be applied only after appropriate…

Machine Learning · Statistics 2021-06-22 Junwen Yao , Jonas Mueller , Jane-Ling Wang

Capturing the temporal evolution of Gaussian properties such as position, rotation, and scale is a challenging task due to the vast number of time-varying parameters and the limited photometric data available, which generally results in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bingbing Hu , Yanyan Li , Rui Xie , Bo Xu , Haoye Dong , Junfeng Yao , Gim Hee Lee

Latent variable models are powerful tools for learning low-dimensional manifolds from high-dimensional data. However, when dealing with constrained data such as unit-norm vectors or symmetric positive-definite matrices, existing approaches…

Machine Learning · Computer Science 2025-03-10 Leonel Rozo , Miguel González-Duque , Noémie Jaquier , Søren Hauberg

Over the past decade, a number of algorithms for full-field elastic strain estimation from neutron and X-ray measurements have been published. Many of the recently published algorithms rely on modelling the unknown strain field as a…

Computational Physics · Physics 2020-07-10 A. W. T. Gregg , J. N. Hendriks , C. M. Wensrich , N. O'Dell

For a large class of feature maps we provide a tight asymptotic characterisation of the test error associated with learning the readout layer, in the high-dimensional limit where the input dimension, hidden layer widths, and number of…

Machine Learning · Statistics 2024-06-11 Dominik Schröder , Daniil Dmitriev , Hugo Cui , Bruno Loureiro

This paper deals with adaptive radar detection of a subspace signal competing with two sources of interference. The former is Gaussian with unknown covariance matrix and accounts for the joint presence of clutter plus thermal noise. The…

Applications · Statistics 2016-04-20 Antonio De Maio , Danilo Orlando

Expressiveness and generalization of deep models was recently addressed via the connection between neural networks (NNs) and kernel learning, where first-order dynamics of NN during a gradient-descent (GD) optimization were related to…

Machine Learning · Computer Science 2020-04-21 Dmitry Kopitkov , Vadim Indelman

Deep feedforward neural networks (DFNNs) are a powerful tool for functional approximation. We describe flexible versions of generalized linear and generalized linear mixed models incorporating basis functions formed by a DFNN. The…

Computation · Statistics 2018-05-28 Minh-Ngoc Tran , Nghia Nguyen , David Nott , Robert Kohn

Retinal prostheses restore vision by electrically stimulating surviving neurons, but calibrating perceptual thresholds (i.e., the minimum stimulus intensity required for perception) remains a time-intensive challenge, especially for…

Quantitative Methods · Quantitative Biology 2025-04-30 Roksana Sadeghi , Michael Beyeler

Gaussian processes are an effective model class for learning unknown functions, particularly in settings where accurately representing predictive uncertainty is of key importance. Motivated by applications in the physical sciences, the…

Machine Learning · Statistics 2023-04-19 Viacheslav Borovitskiy , Alexander Terenin , Peter Mostowsky , Marc Peter Deisenroth

Bayesian learning with Gaussian processes demonstrates encouraging regression and classification performances in solving computer vision tasks. However, Bayesian methods on 3D manifold-valued vision data, such as meshes and point clouds,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Yonghui Fan , Yalin Wang

The modeling of high-dimensional spatio-temporal processes presents a fundamental dichotomy between the probabilistic rigor of classical geostatistics and the flexible, high-capacity representations of deep learning. While Gaussian…

Machine Learning · Computer Science 2025-12-22 Yuri Calleo

It is well-known that non-linear approximation has an advantage over linear schemes in the sense that it provides comparable approximation rates to those of the linear schemes, but to a larger class of approximands. This was established for…

Classical Analysis and ODEs · Mathematics 2010-04-28 Thomas Hangelbroek , Amos Ron

In this article, we show that solving the system of linear equations by manipulating the kernel and the range space is equivalent to solving the problem of least squares error approximation. This establishes the ground for a gradient-free…

Machine Learning · Computer Science 2018-10-30 Kar-Ann Toh , Zhiping Lin , Zhengguo Li , Beomseok Oh , Lei Sun

Deep neural networks have revolutionized medical image analysis and disease diagnosis. Despite their impressive performance, it is difficult to generate well-calibrated probabilistic outputs for such networks, which makes them…

Machine Learning · Computer Science 2020-05-29 Pranav Poduval , Hrushikesh Loya , Amit Sethi

Various Graph Neural Networks (GNNs) have been successful in analyzing data in non-Euclidean spaces, however, they have limitations such as oversmoothing, i.e., information becomes excessively averaged as the number of hidden layers…

Machine Learning · Computer Science 2024-01-23 Jaeyoon Sim , Sooyeon Jeon , InJun Choi , Guorong Wu , Won Hwa Kim

A common theoretical approach to understanding neural networks is to take an infinite-width limit, at which point the outputs become Gaussian process (GP) distributed. This is known as a neural network Gaussian process (NNGP). However, the…

Machine Learning · Statistics 2025-06-26 Ben Anson , Edward Milsom , Laurence Aitchison