English
Related papers

Related papers: Data-Efficient Kernel Methods for Learning Differe…

200 papers

A well-recognized limitation of kernel learning is the requirement to handle a kernel matrix, whose size is quadratic in the number of training examples. Many methods have been proposed to reduce this computational cost, mostly by using a…

Machine Learning · Computer Science 2014-11-06 Nicolò Cesa-Bianchi , Yishay Mansour , Ohad Shamir

We present a novel framework for kernel learning with sequential data of any kind, such as time series, sequences of graphs, or strings. Our approach is based on signature features which can be seen as an ordered variant of sample…

Machine Learning · Statistics 2016-02-01 Franz J Király , Harald Oberhauser

Quantum kernels hold great promise for offering computational advantages over classical learners, with the effectiveness of these kernels closely tied to the design of the quantum feature map. However, the challenge of designing effective…

Quantum Physics · Physics 2024-01-23 Cong Lei , Yuxuan Du , Peng Mi , Jun Yu , Tongliang Liu

We present a machine learning approach for model-independent new physics searches. The corresponding algorithm is powered by recent large-scale implementations of kernel methods, nonparametric learning algorithms that can approximate any…

High Energy Physics - Phenomenology · Physics 2022-10-17 Marco Letizia , Gianvito Losapio , Marco Rando , Gaia Grosso , Andrea Wulzer , Maurizio Pierini , Marco Zanetti , Lorenzo Rosasco

Numerical solution of partial differential equations (PDEs) plays a vital role in various fields of science and engineering. In recent years, deep neural networks (DNNs) have emerged as a powerful tool for solving PDEs, leveraging their…

Numerical Analysis · Mathematics 2026-02-16 Shuo Ling , Wenjun Ying , Zhen Zhang

In this paper, a class of high order numerical schemes is proposed to solve the nonlinear parabolic equations with variable coefficients. This method is based on our previous work [10] for convection-diffusion equations, which relies on a…

Numerical Analysis · Mathematics 2020-12-30 Kaipeng Wang , Andrew Christlieb , Yan Jiang , Mengping Zhang

The accuracy and complexity of machine learning algorithms based on kernel optimization are determined by the set of kernels over which they are able to optimize. An ideal set of kernels should: admit a linear parameterization (for…

Machine Learning · Statistics 2024-10-30 Aleksandr Talitckii , Brendon K. Colbert , Matthew M. Peet

As a promising step, the performance of data analysis and feature learning are able to be improved if certain pattern matching mechanism is available. One of the feasible solutions can refer to the importance estimation of instances, and…

Machine Learning · Computer Science 2020-11-17 Miao Cheng , Xinge You

The kernel matrix used in kernel methods encodes all the information required for solving complex nonlinear problems defined on data representations in the input space using simple, but implicitly defined, solutions. Spectral analysis on…

Machine Learning · Computer Science 2020-10-26 Alexandros Iosifidis

Deep neural networks (DNNs) have achieved remarkable empirical success, yet the absence of a principled theoretical foundation continues to hinder their systematic development. In this survey, we present differential equations as a…

Artificial Intelligence · Computer Science 2026-03-20 Hongjue Zhao , Yizhuo Chen , Yuchen Wang , Hairong Qi , Lui Sha , Tarek Abdelzaher , Huajie Shao

This paper presents new and effective algorithms for learning kernels. In particular, as shown by our empirical results, these algorithms consistently outperform the so-called uniform combination solution that has proven to be difficult to…

Machine Learning · Computer Science 2024-05-01 Corinna Cortes , Mehryar Mohri , Afshin Rostamizadeh

We propose an efficient nonparametric strategy for learning a message operator in expectation propagation (EP), which takes as input the set of incoming messages to a factor node, and produces an outgoing message as output. This learned…

Kernel-based approach to operator approximation for partial differential equations has been shown to be unconditionally stable for linear PDEs and numerically exhibit unconditional stability for non-linear PDEs. These methods have the same…

Numerical Analysis · Mathematics 2025-11-25 Andrew Christlieb , Sining Gong , Hyoseon Yang

Learning a kernel matrix from relative comparison human feedback is an important problem with applications in collaborative filtering, object retrieval, and search. For learning a kernel over a large number of objects, existing methods face…

Machine Learning · Computer Science 2015-01-13 Eric Heim , Matthew Berger , Lee M. Seversky , Milos Hauskrecht

In this paper, we propose a data-adaptive non-parametric kernel learning framework in margin based kernel methods. In model formulation, given an initial kernel matrix, a data-adaptive matrix with two constraints is imposed in an entry-wise…

Machine Learning · Computer Science 2020-10-16 Fanghui Liu , Xiaolin Huang , Chen Gong , Jie Yang , Li Li

Modeling geophysical processes as low-dimensional dynamical systems and regressing their vector field from data is a promising approach for learning emulators of such systems. We show that when the kernel of these emulators is also learned…

Atmospheric and Oceanic Physics · Physics 2021-08-11 Boumediene Hamzi , Romit Maulik , Houman Owhadi

Kernel methods are considered an effective technique for on-line learning. Many approaches have been developed for compactly representing the dual solution of a kernel method when the problem imposes memory constraints. However, in…

Machine Learning · Computer Science 2016-07-21 Giovanni Da San Martino , Nicolò Navarin , Alessandro Sperduti

Conventional wisdom to improve the effectiveness of economic dispatch is to design the load forecasting method as accurately as possible. However, this approach can be problematic due to the temporal and spatial correlations between system…

Optimization and Control · Mathematics 2020-03-02 Chenbei Lu , Kui Wang , Chenye Wu

We propose an efficient distributed online learning protocol for low-latency real-time services. It extends a previously presented protocol to kernelized online learners that represent their models by a support vector expansion. While such…

Machine Learning · Computer Science 2019-12-02 Michael Kamp , Sebastian Bothe , Mario Boley , Michael Mock

In quantum kernel learning, the primary method involves using a quantum computer to calculate the inner product between feature vectors, thereby obtaining a Gram matrix used as a kernel in machine learning models such as support vector…

Quantum Physics · Physics 2024-05-17 Hiroshi Yamauchi , Tomah Sogabe , Rodney Van Meter