English
Related papers

Related papers: Structure Parameter Optimized Kernel Based Online …

200 papers

Identification of model parameters in computer simulations is an important topic in computer experiments. We propose a new method, called the projected kernel calibration method, to estimate these model parameters. The proposed method is…

Methodology · Statistics 2017-05-10 Rui Tuo

Motivated by practical applications, I present a novel and comprehensive framework for operator-valued positive definite kernels. This framework is applied to both operator theory and stochastic processes. The first application focuses on…

Statistics Theory · Mathematics 2025-11-04 Saeed Hashemi Sababe

Sparsity-based models and techniques have been exploited in many signal processing and imaging applications. Data-driven methods based on dictionary and sparsifying transform learning enable learning rich image features from data, and can…

Machine Learning · Computer Science 2019-09-25 Saiprasad Ravishankar , Anna Ma , Deanna Needell

Time series forecasting task predicts future trends based on historical information. Transformer-based U-Net architectures, despite their success in medical image segmentation, have limitations in both expressiveness and computation…

Machine Learning · Computer Science 2024-09-10 Jiang You , Arben Cela , René Natowicz , Jacob Ouanounou , Patrick Siarry

Needlets have been recognized as state-of-the-art tools to tackle spherical data, due to their excellent localization properties in both spacial and frequency domains. This paper considers developing kernel methods associated with the…

Machine Learning · Computer Science 2015-09-11 Shaobo Lin

We consider the kernel partial least squares algorithm for non-parametric regression with stationary dependent data. Probabilistic convergence rates of the kernel partial least squares estimator to the true regression function are…

Statistics Theory · Mathematics 2017-06-13 Marco Singer , Tatyana Krivobokova , Axel Munk

Kernel ridge regression (KRR) is widely used for nonparametric regression over reproducing kernel Hilbert spaces. It offers powerful modeling capabilities at the cost of significant computational costs, which typically require $O(n^3)$…

Methodology · Statistics 2024-03-18 Xiaowu Dai , Huiying Zhong

The stochastic gradient descent (SGD) algorithm is widely used for parameter estimation, especially for huge data sets and online learning. While this recursive algorithm is popular for computation and memory efficiency, quantifying…

Machine Learning · Statistics 2021-06-23 Wanrong Zhu , Xi Chen , Wei Biao Wu

Quantum machine learning with quantum kernels for classification problems is a growing area of research. Recently, quantum kernel alignment techniques that parameterise the kernel have been developed, allowing the kernel to be trained and…

The past few years have witnessed increasing research interest on covariance-based feature representation. A variety of methods have been proposed to boost its efficacy, with some recent ones resorting to nonlinear kernel technique. Noting…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Jianjia Zhang , Lei Wang , Luping Zhou , Wanqing Li

High dimensional piecewise stationary graphical models represent a versatile class for modelling time varying networks arising in diverse application areas, including biology, economics, and social sciences. There has been recent work in…

Machine Learning · Statistics 2018-06-21 Hossein Keshavarz , George Michailidis , Yves Atchade

Computing high-quality independent sets quickly is an important problem in combinatorial optimization. Several recent algorithms have shown that kernelization techniques can be used to find exact maximum independent sets in medium-sized…

Data Structures and Algorithms · Computer Science 2016-02-05 Jakob Dahlum , Sebastian Lamm , Peter Sanders , Christian Schulz , Darren Strash , Renato F. Werneck

We propose a novel approach for change-point detection and parameter learning in multivariate non-stationary time series exhibiting oscillatory behaviour. We approximate the process through a piecewise function defined by a sum of…

Methodology · Statistics 2026-02-02 Nicolas Bianco , Lorenzo Cappello

This study proposes a new framework to evolve efficacious yet parsimonious neural architectures for the movement prediction of stock market indices using technical indicators as inputs. In the light of a sparse signal-to-noise ratio under…

Neural and Evolutionary Computing · Computer Science 2021-11-17 Faizal Hafiz , Jan Broekaert , Davide La Torre , Akshya Swain

In this paper, we present an efficient algorithm for solving a class of chance constrained optimization under non-parametric uncertainty. Our algorithm is built on the possibility of representing arbitrary distributions as functions in…

Robotics · Computer Science 2018-11-26 Bharath Gopalakrishnan , Arun Kumar Singh , K. Madhava Krishna , Dinesh Manocha

Despite its importance, choosing the structural form of the kernel in nonparametric regression remains a black art. We define a space of kernel structures which are built compositionally by adding and multiplying a small number of base…

Machine Learning · Statistics 2013-05-15 David Duvenaud , James Robert Lloyd , Roger Grosse , Joshua B. Tenenbaum , Zoubin Ghahramani

We are interested in a framework of online learning with kernels for low-dimensional but large-scale and potentially adversarial datasets. We study the computational and theoretical performance of online variations of kernel Ridge…

Machine Learning · Statistics 2019-05-30 Rémi Jézéquel , Pierre Gaillard , Alessandro Rudi

The strategy of early stopping is a regularization technique based on choosing a stopping time for an iterative algorithm. Focusing on non-parametric regression in a reproducing kernel Hilbert space, we analyze the early stopping strategy…

Machine Learning · Statistics 2013-06-18 Garvesh Raskutti , Martin J. Wainwright , Bin Yu

Weakly stationary Gaussian processes (GPs) are the principal tool in the statistical approaches to the design and analysis of computer experiments (or Uncertainty Quantification). Such processes are fitted to computer model output using a…

Methodology · Statistics 2019-02-28 Victoria Volodina , Daniel B. Williamson

This paper develops a novel mathematical framework for collaborative learning by means of geometrically inspired kernel machines which includes statements on the bounds of generalisation and approximation errors, and sample complexity. For…