中文
相关论文

相关论文: Reduced-Set Kernel Principal Components Analysis f…

200 篇论文

The goal of this paper is to revisit Kernel Principal Component Analysis (KPCA) through dualization of a difference of convex functions. This allows to naturally extend KPCA to multiple objective functions and leads to efficient…

机器学习 · 计算机科学 2023-06-12 Francesco Tonin , Alex Lambert , Panagiotis Patrinos , Johan A. K. Suykens

Kernel means are frequently used to represent probability distributions in machine learning problems. In particular, the well known kernel density estimator and the kernel mean embedding both have the form of a kernel mean. Unfortunately,…

机器学习 · 统计学 2015-03-03 E. Cruz Cortés , C. Scott

In this paper we present new algorithms for training reduced-size nonlinear representations in the Kernel Dictionary Learning (KDL) problem. Standard KDL has the drawback of a large size of the kernel matrix when the data set is large.…

信号处理 · 电气工程与系统科学 2023-07-19 Denis C. Ilie-Ablachim , Bogdan Dumitrescu

The problem of estimating the kernel mean in a reproducing kernel Hilbert space (RKHS) is central to kernel methods in that it is used by classical approaches (e.g., when centering a kernel PCA matrix), and it also forms the core inference…

机器学习 · 统计学 2014-11-05 Krikamol Muandet , Bharath Sriperumbudur , Bernhard Schölkopf

An improved version of the sparse multiway kernel spectral clustering (KSC) is presented in this brief. The original algorithm is derived from weighted kernel principal component (KPCA) analysis formulated within the primal-dual…

机器学习 · 计算机科学 2023-10-23 Mihaly Novak , Rocco Langone , Carlos Alzate , Johan Suykens

We present a subsampling strategy for the offline stage of the Reduced Basis Method. The approach is aimed at bringing down the considerable offline costs associated with using a finely-sampled training set. The proposed algorithm exploits…

数值分析 · 数学 2023-01-24 Sridhar Chellappa , Lihong Feng , Peter Benner

Purpose: To introduce, develop, and evaluate a novel denoising technique for diffusion MRI that leverages non-linear redundancy in the data to boost the SNR while preserving signal information. Methods: We exploit non-linear redundancy of…

We consider the problem of simultaneously learning to linearly combine a very large number of kernels and learn a good predictor based on the learnt kernel. When the number of kernels $d$ to be combined is very large, multiple kernel…

机器学习 · 计算机科学 2015-03-20 Arash Afkanpour , András György , Csaba Szepesvári , Michael Bowling

Dataset distillation compresses large datasets into smaller synthetic coresets which retain performance with the aim of reducing the storage and computational burden of processing the entire dataset. Today's best-performing algorithm,…

机器学习 · 计算机科学 2022-10-24 Noel Loo , Ramin Hasani , Alexander Amini , Daniela Rus

Stochastic gradient descent algorithms for training linear and kernel predictors are gaining more and more importance, thanks to their scalability. While various methods have been proposed to speed up their convergence, the model selection…

机器学习 · 计算机科学 2014-06-17 Francesco Orabona

Kernel matrices, as well as weighted graphs represented by them, are ubiquitous objects in machine learning, statistics and other related fields. The main drawback of using kernel methods (learning and inference using kernel matrices) is…

机器学习 · 计算机科学 2022-12-02 Ainesh Bakshi , Piotr Indyk , Praneeth Kacham , Sandeep Silwal , Samson Zhou

Several statistical approaches based on reproducing kernels have been proposed to detect abrupt changes arising in the full distribution of the observations and not only in the mean or variance. Some of these approaches enjoy good…

统计理论 · 数学 2017-10-13 Alain Celisse , Guillemette Marot , Morgane Pierre-Jean , Guillem Rigaill

Dictionary learning and component analysis models are fundamental for learning compact representations that are relevant to a given task (feature extraction, dimensionality reduction, denoising, etc.). The model complexity is encoded by…

机器学习 · 统计学 2018-11-13 Mehdi Bahri , Yannis Panagakis , Stefanos Zafeiriou

Tensor decomposition is one of the well-known approaches to reduce the latency time and number of parameters of a pre-trained model. However, in this paper, we propose an approach to use tensor decomposition to reduce training time of…

计算机视觉与模式识别 · 计算机科学 2020-06-30 Mostafa Elhoushi , Ye Henry Tian , Zihao Chen , Farhan Shafiq , Joey Yiwei Li

The generalization performance of kernel methods is largely determined by the kernel, but common kernels are stationary thus input-independent and output-independent, that limits their applications on complicated tasks. In this paper, we…

机器学习 · 计算机科学 2023-08-30 Jian Li , Yong Liu , Weiping Wang

A well-recognized limitation of kernel learning is the requirement to handle a kernel matrix, whose size is quadratic in the number of training examples. Many methods have been proposed to reduce this computational cost, mostly by using a…

机器学习 · 计算机科学 2014-11-06 Nicolò Cesa-Bianchi , Yishay Mansour , Ohad Shamir

The main purpose of this work is the one of providing an efficient scheme for constructing reduced interpolation models for kernel bases. In literature such problem is mainly addressed via the well-established knot insertion or knot removal…

数值分析 · 数学 2021-07-14 Francesco Marchetti , Emma Perracchione

In deep learning models, learning more with less data is becoming more important. This paper explores how neural networks with normalized Radial Basis Function (RBF) kernels can be trained to achieve better sample efficiency. Moreover, we…

Deep learning, especially convolutional neural networks, has triggered accelerated advancements in computer vision, bringing changes into our daily practice. Furthermore, the standardized deep learning modules (also known as backbone…

计算机视觉与模式识别 · 计算机科学 2022-12-02 Hongzhi Zhu , Robert Rohling , Septimiu Salcudean

Kernel methods have been proven to be a powerful tool for the integration and analysis of highthroughput technologies generated data. Kernels offer a nonlinear version of any linear algorithm solely based on dot products. The kernelized…

应用统计 · 统计学 2024-11-27 Mitja Briscik , Marie-Agnès Dillies , Sébastien Déjean