English
Related papers

Related papers: A Sparse Bayesian Learning Algorithm for Estimatio…

200 papers

Kernel-based nonparametric models have become very attractive for model-based control approaches for nonlinear systems. However, the selection of the kernel and its hyperparameters strongly influences the quality of the learned model.…

Systems and Control · Electrical Eng. & Systems 2019-09-13 Thomas Beckers , Somil Bansal , Claire J. Tomlin , Sandra Hirche

In decision-making systems, it is important to have classifiers that have calibrated uncertainties, with an optimisation objective that can be used for automated model selection and training. Gaussian processes (GPs) provide uncertainty…

Machine Learning · Statistics 2020-03-05 Vincent Dutordoir , Mark van der Wilk , Artem Artemev , James Hensman

Building spatial process models that capture nonstationary behavior while delivering computationally efficient inference is challenging. Nonstationary spatially varying kernels (see, e.g., Paciorek, 2003) offer flexibility and richness, but…

Methodology · Statistics 2025-07-01 Sébastien Coube-Sisqueille , Sudipto Banerjee , Benoît Liquet

This paper investigates the use of nonparametric kernel-regression to obtain a tasksimilarity aware meta-learning algorithm. Our hypothesis is that the use of tasksimilarity helps meta-learning when the available tasks are limited and may…

Machine Learning · Computer Science 2020-10-13 Arun Venkitaraman , Anders Hansson , Bo Wahlberg

Manifold learning is a central task in modern statistics and data science. Many datasets (cells, documents, images, molecules) can be represented as point clouds embedded in a high dimensional ambient space, however the degrees of freedom…

Machine Learning · Statistics 2025-02-18 Stephen Zhang , Gilles Mordant , Tetsuya Matsumoto , Geoffrey Schiebinger

We propose a kernel mixture of polynomials prior for Bayesian nonparametric regression. The regression function is modeled by local averages of polynomials with kernel mixture weights. We obtain the minimax-optimal rate of contraction of…

Statistics Theory · Mathematics 2018-09-17 Fangzheng Xie , Yanxun Xu

In this abstract paper, we introduce a new kernel learning method by a nonparametric density estimator. The estimator consists of a group of k-centroids clusterings. Each clustering randomly selects data points with randomly selected…

Machine Learning · Computer Science 2017-08-02 Xiao-Lei Zhang

The primary objective of this research is to investigate an inverse problem of parameter identification in nonlinear mixed quasi-variational inequalities posed in a Banach space setting. By using a fixed point theorem, we explore properties…

Analysis of PDEs · Mathematics 2019-02-20 Stanislaw Migorski , Akhtar A. Khan , Shengda Zeng

This chapter discusses the importance of incorporating three-dimensional symmetries in the context of statistical learning models geared towards the interpolation of the tensorial properties of atomic-scale structures. We focus on Gaussian…

Chemical Physics · Physics 2019-04-04 Andrea Grisafi , David M. Wilkins , Michael J. Willatt , Michele Ceriotti

In statistical machine learning, kernel methods allow to consider infinite dimensional feature spaces with a computational cost that only depends on the number of observations. This is usually done by solving an optimization problem…

Optimization and Control · Mathematics 2019-01-17 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

This paper discusses the solution of nonlinear integral equations with noisy integral kernels as they appear in nonparametric instrumental regression. We propose a regularized Newton-type iteration and establish convergence and convergence…

Numerical Analysis · Mathematics 2015-04-01 Fabian Dunker , Jean-Pierre Florens , Thorsten Hohage , Jan Johannes , Enno Mammen

A fundamental problem for waveform-agile radar systems is that the true environment is unknown, and transmission policies which perform well for a particular tracking instance may be sub-optimal for another. Additionally, there is a limited…

Information Theory · Computer Science 2021-10-25 Charles E. Thornton , R. Michael Buehrer , Anthony F. Martone

We study inverse boundary problems for evolutionary PDEs using only a single passive boundary observation, where data from an unknown internal source propagate through an unknown medium without active inputs. The goal is the simultaneous…

Analysis of PDEs · Mathematics 2026-05-26 Lu Chen , Yan Jiang , Hongyu Liu , Catharine W. K. Lo , Longyue Tao

Bayesian optimization is a data-efficient technique which can be used for control parameter tuning, parametric policy adaptation, and structure design in robotics. Many of these problems require optimization of functions defined on…

Spectral methods have greatly advanced the estimation of latent variable models, generating a sequence of novel and efficient algorithms with strong theoretical guarantees. However, current spectral algorithms are largely restricted to…

Machine Learning · Computer Science 2013-12-10 Le Song , Animashree Anandkumar , Bo Dai , Bo Xie

This paper is concerned with the development, analysis and numerical realization of a novel variational model for the regularization of inverse problems in imaging. The proposed model is inspired by the architecture of generative…

Optimization and Control · Mathematics 2021-11-10 Andreas Habring , Martin Holler

We consider the problem of learning low-dimensional representations for large-scale Markov chains. We formulate the task of representation learning as that of mapping the state space of the model to a low-dimensional state space, called the…

Machine Learning · Computer Science 2020-04-09 Mahsa Ghasemi , Abolfazl Hashemi , Haris Vikalo , Ufuk Topcu

The diffusion-driven Turing instability is a potential mechanism for spatial pattern formation in numerous biological and chemical systems. However, engineering these patterns and demonstrating that they are produced by this mechanism is…

Biological Physics · Physics 2025-12-02 Antonio Matas-Gil , Robert G. Endres

Nonlinear kernel regression models are often used in statistics and machine learning because they are more accurate than linear models. Variable selection for kernel regression models is a challenge partly because, unlike the linear…

Methodology · Statistics 2017-06-13 Lorin Crawford , Kris C. Wood , Xiang Zhou , Sayan Mukherjee

While the formulation of most data assimilation schemes assumes an unbiased observation model error, in real applications, model error with nontrivial biases is unavoidable. A practical example is the error in the radiative transfer model…

Methodology · Statistics 2016-11-17 John Harlim , Tyrus Berry