English
Related papers

Related papers: A Multiple Parameter Linear Scale-Space for one di…

200 papers

A method for analyzing the feature map for the kernel-based quantum classifier is developed; that is, we give a general formula for computing a lower bound of the exact training accuracy, which helps us to see whether the selected feature…

Quantum Physics · Physics 2020-08-18 Yudai Suzuki , Hiroshi Yano , Qi Gao , Shumpei Uno , Tomoki Tanaka , Manato Akiyama , Naoki Yamamoto

We introduce a class of algorithms for constructing Fourier representations of Gaussian processes in $1$ dimension that are valid over ranges of hyperparameter values. The scaling and frequencies of the Fourier basis functions are evaluated…

Computation · Statistics 2024-06-05 Philip Greengard

Motivated by chemical applications, we revisit and extend a family of positive definite kernels for graphs based on the detection of common subtrees, initially proposed by Ramon et al. (2003). We propose new kernels with a parameter to…

Quantitative Methods · Quantitative Biology 2016-08-16 Pierre Mahé , Jean-Philippe Vert

In this paper, we propose a design methodology for one-class classifiers using an ensemble-of-classifiers approach. The objective is to select the best structures created during the training phase using an ensemble of spanning trees. It…

Machine Learning · Computer Science 2019-09-11 Riccardo La Grassa , Ignazio Gallo , Alessandro Calefati , Dimitri Ognibene

Gaussian processes (GPs) stand as crucial tools in machine learning and signal processing, with their effectiveness hinging on kernel design and hyper-parameter optimization. This paper presents a novel GP linear multiple kernel (LMK) and a…

Machine Learning · Computer Science 2025-01-17 Richard Cornelius Suwandi , Zhidi Lin , Feng Yin , Zhiguo Wang , Sergios Theodoridis

The architecture of a neural network and the selection of its activation function are both fundamental to its performance. Equally vital is ensuring these two elements are well-matched, as their alignment is key to achieving effective…

Machine Learning · Computer Science 2025-06-25 Shijun Zhang , Hongkai Zhao , Yimin Zhong , Haomin Zhou

Reconstructing continuous signals from a small number of discrete samples is a fundamental problem across science and engineering. In practice, we are often interested in signals with 'simple' Fourier structure, such as bandlimited,…

Data Structures and Algorithms · Computer Science 2018-12-24 Haim Avron , Michael Kapralov , Cameron Musco , Christopher Musco , Ameya Velingker , Amir Zandieh

Gaussian processes provide a powerful probabilistic kernel learning framework, which allows learning high quality nonparametric regression models via methods such as Gaussian process regression. Nevertheless, the learning phase of Gaussian…

Numerical Analysis · Mathematics 2021-01-06 Paz Fink Shustin , Haim Avron

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…

Machine Learning · Statistics 2026-05-14 Rafael Oliveira

Kernel methods are ubiquitous tools in machine learning. However, there is often little reason for the common practice of selecting a kernel a priori. Even if a universal approximating kernel is selected, the quality of the finite sample…

Machine Learning · Statistics 2018-01-31 Junier Oliva , Avinava Dubey , Andrew G. Wilson , Barnabas Poczos , Jeff Schneider , Eric P. Xing

We study non-linear data-dimension reduction. We are motivated by the classical linear framework of Principal Component Analysis. In nonlinear case, we introduce instead a new kernel-Principal Component Analysis, manifold and feature space…

Functional Analysis · Mathematics 2022-09-09 Palle E. T. Jorgensen , Sooran Kang , Myung-Sin Song , Feng Tian

Kernel-based methods are heavily used in machine learning. However, they suffer from $O(N^2)$ complexity in the number $N$ of considered data points. In this paper, we propose an approximation procedure, which reduces this complexity to…

Numerical Analysis · Mathematics 2024-11-20 Johannes Hertrich

A recent series of theoretical works showed that the dynamics of neural networks with a certain initialisation are well-captured by kernel methods. Concurrent empirical work demonstrated that kernel methods can come close to the performance…

Machine Learning · Computer Science 2021-06-11 Maria Refinetti , Sebastian Goldt , Florent Krzakala , Lenka Zdeborová

This work introduces a transformation-based learner model for classification forests. The weak learner at each split node plays a crucial role in a classification tree. We propose to optimize the splitting objective by learning a linear…

Computer Vision and Pattern Recognition · Computer Science 2014-02-07 Qiang Qiu , Guillermo Sapiro

This article addresses the problem of two- and higher dimensional pattern matching, i.e. the identification of instances of a template within a larger signal space, which is a form of registration. Unlike traditional correlation, we aim at…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-09-19 Luciano da Fontoura Costa , Erik Bollt

Scale transformations have played an extremely successful role in studies of cosmological large-scale structure by relating the non-linear spectrum of cosmological density fluctuations to the linear primordial power at longer wavelengths.…

Astrophysics · Physics 2009-11-13 Jun Pan , Peter Coles , Istvan Szapudi

We introduce a Fourier-based fast algorithm for Gaussian process regression in low dimensions. It approximates a translationally-invariant covariance kernel by complex exponentials on an equispaced Cartesian frequency grid of $M$ nodes.…

Computation · Statistics 2023-05-19 Philip Greengard , Manas Rachh , Alex Barnett

This paper investigates tree species classification using Sentinel-2 multispectral satellite image time-series. Despite their critical importance for many applications, such maps are often unavailable, outdated, or inaccurate for large…

Image and Video Processing · Electrical Eng. & Systems 2024-11-28 Florian Mouret , David Morin , Milena Planells , Cécile Vincent-Barbaroux

The importance of wild video based image set recognition is becoming monotonically increasing. However, the contents of these collected videos are often complicated, and how to efficiently perform set modeling and feature extraction is a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Rui Wang , XiaoJun Wu , Josef Kittler

We propose a general matrix-valued multiple kernel learning framework for high-dimensional nonlinear multivariate regression problems. This framework allows a broad class of mixed norm regularizers, including those that induce sparsity, to…

Machine Learning · Computer Science 2014-08-12 Vikas Sindhwani , Ha Quang Minh , Aurelie Lozano