English
Related papers

Related papers: A universal preprocessing algorithm of average ker…

200 papers

Many signal processing and machine learning applications are built from evaluating a kernel on pairs of signals, e.g. to assess the similarity of an incoming query to a database of known signals. This nonlinear evaluation can be simplified…

Signal Processing · Electrical Eng. & Systems 2021-03-16 Vincent Schellekens , Laurent Jacques

This paper investigates preconditioned conjugate gradient techniques for solving kernel ridge regression (KRR) problems with a medium to large number of data points ($10^4 \leq N \leq 10^7$), and it describes two methods with the strongest…

Numerical Analysis · Mathematics 2025-10-22 Mateo Díaz , Ethan N. Epperly , Zachary Frangella , Joel A. Tropp , Robert J. Webber

The growing demand for accurate, efficient, and scalable solutions in computational mechanics highlights the need for advanced operator learning algorithms that can efficiently handle large datasets while providing reliable uncertainty…

Machine Learning · Statistics 2024-09-18 Sawan Kumar , Rajdip Nayek , Souvik Chakraborty

Nonconvex optimization problems are widespread in modern machine learning and data science. We introduce an extrapolation strategy into a class of preconditioned second-order convex splitting algorithms for nonconvex optimization problems.…

Optimization and Control · Mathematics 2025-12-19 Xinhua Shen , Hongpeng Sun

This paper deals with the speed of convergence of the learning curve in a Gaussian process regression framework. The learning curve describes the average generalization error of the Gaussian process used for the regression. More…

Statistics Theory · Mathematics 2013-01-14 Loic Le Gratiet , Josselin Garnier

A fast algorithm (linear in the degrees of freedom) for the solution of linear variable-coefficient rational-order fractional integral and differential equations is described. The approach is related to the ultraspherical method for…

Numerical Analysis · Mathematics 2017-12-04 Nicholas Hale , Sheehan Olver

The error of smoothed particle hydrodynamics (SPH) using kernel for particle-based approximation mainly comes from smoothing and integration errors. The choice of kernels has a significant impact on the numerical accuracy, stability and…

Computational Physics · Physics 2023-09-06 Zhentong Wang , Bo Zhang , Oskar J. Haidn , Xiangyu Hu

Kernel-based clustering algorithm can identify and capture the non-linear structure in datasets, and thereby it can achieve better performance than linear clustering. However, computing and storing the entire kernel matrix occupy so large…

Machine Learning · Computer Science 2020-02-10 Li Chen , Shuisheng Zhou , Jiajun Ma

Efficient and fast predictor-corrector methods are proposed to deal with nonlinear Caputo-Fabrizio fractional differential equations, where Caputo-Fabrizio operator is a new proposed fractional derivative with a smooth kernel. The proposed…

Numerical Analysis · Mathematics 2020-10-07 Seyeon Lee , Junseo Lee , Hyunju Kim , Bongsoo Jang

Approximating kernel functions with random features (RFs)has been a successful application of random projections for nonparametric estimation. However, performing random projections presents computational challenges for large-scale…

Emerging Technologies · Computer Science 2020-06-23 Ruben Ohana , Jonas Wacker , Jonathan Dong , Sébastien Marmin , Florent Krzakala , Maurizio Filippone , Laurent Daudet

Acquiring labels are often costly, whereas unlabeled data are usually easy to obtain in modern machine learning applications. Semi-supervised learning provides a principled machine learning framework to address such situations, and has been…

Machine Learning · Computer Science 2017-04-07 Trung Le , Khanh Nguyen , Van Nguyen , Vu Nguyen , Dinh Phung

By applying an idea of Borodin and Olshanski [J. Algebra 313 (2007), 40-60], we study various scaling limits of determinantal point processes with trace class projection kernels given by spectral projections of selfadjoint Sturm-Liouville…

Mathematical Physics · Physics 2016-08-22 Folkmar Bornemann

Bayesian optimization with Gaussian process as surrogate model has been successfully applied to analog circuit synthesis. In the traditional Gaussian process regression model, the kernel functions are defined explicitly. The computational…

Machine Learning · Computer Science 2019-12-03 Shuhan Zhang , Wenlong Lyu , Fan Yang , Changhao Yan , Dian Zhou , Xuan Zeng

We consider the minimization problem with the truncated quadratic regularization with gradient operator, which is a nonsmooth and nonconvex problem. We cooperated the classical preconditioned iterations for linear equations into the…

Optimization and Control · Mathematics 2021-05-04 Shengxiang Deng , Hongpeng Sun

High-dimensional data pose challenges in statistical learning and modeling. Sometimes the predictors can be naturally grouped where pursuing the between-group sparsity is desired. Collinearity may occur in real-world high-dimensional…

Machine Learning · Statistics 2011-11-11 Yiyuan She

In high-energy physics it is a recurring challenge to efficiently and precisely (enough) calculate the global significance of, e.g., a potential new resonance. We propose a new method that models the significance in the search region as a…

Methodology · Statistics 2023-06-19 V. Ananiev , A. L. Read

Kernelization algorithms, usually a preprocessing step before other more traditional algorithms, are very special in the sense that they return (reduced) instances, instead of final results. This characteristic excludes the freedom of…

Data Structures and Algorithms · Computer Science 2010-10-04 Yixin Cao , Jianer Chen

Let $\mathrm{R}$ be a real closed field and $\mathrm{D} \subset \mathrm{R}$ an ordered domain. We consider the algorithmic problem of computing the generalized Euler-Poincar\'e characteristic of real algebraic as well as semi-algebraic…

Algebraic Geometry · Mathematics 2017-07-13 Saugata Basu , Cordian Riener

We present a fast algorithm to calculate Coulomb/exchange integrals of prolate spheroidal electronic orbitals, which are the exact solutions of the single-electron, two-center Schr\"odinger equation for diatomic molecules. Our approach…

Quantum Physics · Physics 2012-08-01 Christian B. Mendl

It was demonstrated in earlier work that, by approximating its range kernel using shiftable functions, the non-linear bilateral filter can be computed using a series of fast convolutions. Previous approaches based on shiftable approximation…

Computer Vision and Pattern Recognition · Computer Science 2016-04-20 Sanjay Ghosh , Kunal N. Chaudhury