English
Related papers

Related papers: Efficient recursive algorithms for functionals bas…

200 papers

A new probabilistic post-processing method for wind vectors is presented in a distributional regression framework employing the bivariate Gaussian distribution. In contrast to previous studies all parameters of the distribution are…

Applications · Statistics 2019-07-26 Moritz N. Lang , Georg J. Mayr , Reto Stauffer , Achim Zeileis

Multivariate functions emerge naturally in a wide variety of data-driven models. Popular choices are expressions in the form of basis expansions or neural networks. While highly effective, the resulting functions tend to be hard to…

Machine Learning · Statistics 2022-06-15 Jan Decuyper , Koen Tiels , Siep Weiland , Mark C. Runacres , Johan Schoukens

We derive methods to compute higher order differentials (Hessians and Hessian-vector products) of the rendering operator. Our approach is based on importance sampling of a convolution that represents the differentials of rendering…

Graphics · Computer Science 2025-08-07 Zican Wang , Michael Fischer , Tobias Ritschel

Weighted finite-state machines are a fundamental building block of NLP systems. They have withstood the test of time -- from their early use in noisy channel models in the 1990s up to modern-day neurally parameterized conditional random…

Computation and Language · Computer Science 2023-09-29 Ran Zmigrod , Tim Vieira , Ryan Cotterell

This paper studies the convexity properties of nonsmooth extended-real-valued weakly convex functions, a class of functions that is central to modern optimization and its applications. We establish new characterizations of convexity using…

Optimization and Control · Mathematics 2026-03-27 Vo Thanh Phat

This paper proposes a novel method for deep learning based on the analytical convolution of multidimensional Gaussian mixtures. In contrast to tensors, these do not suffer from the curse of dimensionality and allow for a compact…

Machine Learning · Computer Science 2022-02-21 Adam Celarek , Pedro Hermosilla , Bernhard Kerbl , Timo Ropinski , Michael Wimmer

We introduce a new interpretation of sparse variational approximations for Gaussian processes using inducing points, which can lead to more scalable algorithms than previous methods. It is based on decomposing a Gaussian process as a sum of…

Machine Learning · Statistics 2024-02-27 Jiaxin Shi , Michalis K. Titsias , Andriy Mnih

The problem of optimal recovering high-order mixed derivatives of bivariate functions with finite smoothness is studied. On the basis of the truncation method, an algorithm for numerical differentiation is constructed, which is…

Numerical Analysis · Mathematics 2023-09-19 Y. V. Semenova , S. G. Solodky

We investigate the use of derivative information for Batch Active Learning in Gaussian Process regression models. The proposed approach employs the predictive covariance matrix for selection of data batches to exploit full correlation of…

Machine Learning · Computer Science 2024-08-06 Hon Sum Alec Yu , Christoph Zimmer , Duy Nguyen-Tuong

This paper is devoted to filtering, smoothing, and prediction of polynomial processes that are partially observed. These problems are known to allow for an explicit solution in the simpler case of linear Gaussian state space models. The key…

Probability · Mathematics 2025-07-10 Jan Kallsen , Ivo Richert

Gaussian processes are the gold standard for many real-world modeling problems, especially in cases where a model's success hinges upon its ability to faithfully represent predictive uncertainty. These problems typically exist as parts of…

This article presents a rigorous analysis for efficient statistically accurate algorithms for solving the Fokker-Planck equations associated with high-dimensional nonlinear turbulent dynamical systems with conditional Gaussian structures.…

Statistics Theory · Mathematics 2017-09-19 Nan Chen , Andrew J. Majda , Xin T. Tong

Covariate measurement error in nonparametric regression is a common problem in nutritional epidemiology and geostatistics, and other fields. Over the last two decades, this problem has received substantial attention in the frequentist…

Statistics Theory · Mathematics 2023-01-27 Shuang Zhou , Debdeep Pati , Tianying Wang , Yun Yang , Raymond J. Carroll

We use rescaled Gaussian processes as prior models for functional parameters in nonparametric statistical models. We show how the rate of contraction of the posterior distributions depends on the scaling factor. In particular, we exhibit…

Statistics Theory · Mathematics 2009-09-29 Aad van der Vaart , Harry van Zanten

Recent research has shown the potential utility of Deep Gaussian Processes. These deep structures are probability distributions, designed through hierarchical construction, which are conditionally Gaussian. In this paper, the current…

Statistics Theory · Mathematics 2018-08-20 Matthew M. Dunlop , Mark A. Girolami , Andrew M. Stuart , Aretha L. Teckentrup

Graphical models describe associations between variables through the notion of conditional independence. Gaussian graphical models are a widely used class of such models where the relationships are formalized by non-null entries of the…

Methodology · Statistics 2023-08-08 Sagnik Bhadury , Riten Mitra , Jeremy T. Gaskins

In this paper, we study the problem of learning one-dimensional Gaussian mixture models (GMMs) with a specific focus on estimating both the model order and the mixing distribution from independent and identically distributed (i.i.d.)…

Machine Learning · Statistics 2026-02-24 Xinyu Liu , Hai Zhang

In this paper, we consider derivative free optimization problems, where the objective function is smooth but is computed with some amount of noise, the function evaluations are expensive and no derivative information is available. We are…

Optimization and Control · Mathematics 2019-06-05 Albert S Berahas , Liyuan Cao , Krzysztof Choromanski , Katya Scheinberg

This work introduces the Gaussian integration to address a smoothing problem of a nonlinear stochastic state space model. The probability densities of states at each time instant are assumed to be Gaussian, and their means and covariances…

Signal Processing · Electrical Eng. & Systems 2025-01-14 Rohit Kumar Singh , Kundan Kumar , Shovan Bhaumik

We consider the problem of learning high dimensional polynomial transformations of Gaussians. Given samples of the form $p(x)$, where $x\sim N(0, \mathrm{Id}_r)$ is hidden and $p: \mathbb{R}^r \to \mathbb{R}^d$ is a function where every…

Machine Learning · Computer Science 2022-04-11 Sitan Chen , Jerry Li , Yuanzhi Li , Anru R. Zhang