English
Related papers

Related papers: Numerical Methods for Kernel Slicing

200 papers

Many scientific computing problems can be reduced to Matrix-Matrix Multiplications (MMM), making the General Matrix Multiply (GEMM) kernels in the Basic Linear Algebra Subroutine (BLAS) of interest to the high-performance computing…

Hardware Architecture · Computer Science 2023-05-31 Louis Ledoux , Marc Casas

Random Fourier features is one of the most popular techniques for scaling up kernel methods, such as kernel ridge regression. However, despite impressive empirical results, the statistical properties of random Fourier features are still not…

Machine Learning · Computer Science 2018-05-22 Haim Avron , Michael Kapralov , Cameron Musco , Christopher Musco , Ameya Velingker , Amir Zandieh

In this work we consider the problem of learning a positive semidefinite kernel matrix from relative comparisons of the form: "object A is more similar to object B than it is to C", where comparisons are given by humans. Existing solutions…

Machine Learning · Computer Science 2014-04-17 Eric Heim , Hamed Valizadegan , Milos Hauskrecht

Kernel methods have a wide spectrum of applications in machine learning. Recently, a link between quantum computing and kernel theory has been formally established, opening up opportunities for quantum techniques to enhance various existing…

Quantum Physics · Physics 2020-03-25 Carsten Blank , Daniel K. Park , June-Koo Kevin Rhee , Francesco Petruccione

In real-world machine learning applications, data subsets correspond to especially critical outcomes: vulnerable cyclist detections are safety-critical in an autonomous driving task, and "question" sentences might be important to a dialogue…

Machine Learning · Computer Science 2020-03-03 Vincent S. Chen , Sen Wu , Zhenzhen Weng , Alexander Ratner , Christopher Ré

This paper presents new and effective algorithms for learning kernels. In particular, as shown by our empirical results, these algorithms consistently outperform the so-called uniform combination solution that has proven to be difficult to…

Machine Learning · Computer Science 2024-05-01 Corinna Cortes , Mehryar Mohri , Afshin Rostamizadeh

In statistical machine learning, kernel methods allow to consider infinite dimensional feature spaces with a computational cost that only depends on the number of observations. This is usually done by solving an optimization problem…

Optimization and Control · Mathematics 2019-01-17 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

Machine learning (ML) is transforming all areas of science. The complex and time-consuming calculations in molecular simulations are particularly suitable for a machine learning revolution and have already been profoundly impacted by the…

Chemical Physics · Physics 2019-11-11 Frank Noé , Alexandre Tkatchenko , Klaus-Robert Müller , Cecilia Clementi

This paper presents an iterative method suitable for inverting semilinear problems which are important kernels in many numerical applications. The primary idea is to employ a parametrization that is able to reduce semilinear problems into…

Numerical Analysis · Mathematics 2019-08-02 Prosper Torsu

Learning a distance metric from the given training samples plays a crucial role in many machine learning tasks, and various models and optimization algorithms have been proposed in the past decade. In this paper, we generalize several…

Machine Learning · Computer Science 2013-09-24 Faqiang Wang , Wangmeng Zuo , Lei Zhang , Deyu Meng , David Zhang

Kernel methods are powerful learning methodologies that allow to perform non-linear data analysis. Despite their popularity, they suffer from poor scalability in big data scenarios. Various approximation methods, including random feature…

Machine Learning · Statistics 2022-06-14 Bharath Sriperumbudur , Nicholas Sterge

Random Fourier features is a widely used, simple, and effective technique for scaling up kernel methods. The existing theoretical analysis of the approach, however, remains focused on specific learning tasks and typically gives pessimistic…

Machine Learning · Statistics 2021-02-08 Zhu Li , Jean-Francois Ton , Dino Oglic , Dino Sejdinovic

When solving data analysis problems it is important to integrate prior knowledge and/or structural invariances. This paper contributes by a novel framework for incorporating algebraic invariance structure into kernels. In particular, we…

Machine Learning · Statistics 2014-12-01 Franz J. Király , Andreas Ziehe , Klaus-Robert Müller

The functional characterization of different neuronal types has been a longstanding and crucial challenge. With the advent of physical quantum computers, it has become possible to apply quantum machine learning algorithms to translate…

Quantum Physics · Physics 2025-02-11 Xavier Vasques , Hanhee Paik , Laura Cif

Kernel means are frequently used to represent probability distributions in machine learning problems. In particular, the well known kernel density estimator and the kernel mean embedding both have the form of a kernel mean. Unfortunately,…

Machine Learning · Statistics 2015-03-03 E. Cruz Cortés , C. Scott

Quantum machine learning (QML) is the spearhead of quantum computer applications. In particular, quantum neural networks (QNN) are actively studied as the method that works both in near-term quantum computers and fault-tolerant quantum…

Quantum Physics · Physics 2022-09-07 Kouhei Nakaji , Hiroyuki Tezuka , Naoki Yamamoto

We introduce a fast algorithm for computing sparse Fourier transforms supported on smooth curves or surfaces. This problem appear naturally in several important problems in wave scattering and reflection seismology. The main observation is…

Numerical Analysis · Mathematics 2008-01-11 Lexing Ying

Quantum computers have the opportunity to be transformative for a variety of computational tasks. Recently, there have been proposals to use the unsimulatably of large quantum devices to perform regression, classification, and other machine…

These lecture notes endeavour to collect in one place the mathematical background required to understand the properties of kernels in general and the Random Fourier Features approximation of Rahimi and Recht (NIPS 2007) in particular. We…

Machine Learning · Computer Science 2020-05-05 Amitabha Bagchi

For a real sequence of length of m = nl, we may deduce its congruence derivative sequence with length of l. The discrete Fourier transform of original sequence can be calculated by the discrete Fourier transform of the congruence derivative…

Signal Processing · Electrical Eng. & Systems 2019-04-19 Jiasong Wang , Changchuan Yin