English
Related papers

Related papers: Fast O(1) bilateral filtering using trigonometric …

200 papers

We consider supervised learning problems within the positive-definite kernel framework, such as kernel ridge regression, kernel logistic regression or the support vector machine. With kernels leading to infinite-dimensional feature spaces,…

Machine Learning · Computer Science 2013-05-23 Francis Bach

To accelerate kernel methods, we propose a near input sparsity time algorithm for sampling the high-dimensional feature space implicitly defined by a kernel transformation. Our main contribution is an importance sampling method for…

Data Structures and Algorithms · Computer Science 2020-07-15 David P. Woodruff , Amir Zandieh

Kernel smoothers are considered near the boundary of the interval. Kernels which minimize the expected mean square error are derived. These kernels are equivalent to using a linear weighting function in the local polynomial regression. It…

Methodology · Statistics 2019-12-03 Alexander Sidorenko , Kurt S. Riedel

The efficient realization of linear space-variant (non-convolution) filters is a challenging computational problem in image processing. In this paper, we demonstrate that it is possible to filter an image with a Gaussian-like elliptic…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Kunal Narayan Chaudhury , Arrate Munoz-Barrutia , Michael Unser

We introduce a nonparametric algorithm to learn interaction kernels of mean-field equations for 1st-order systems of interacting particles. The data consist of discrete space-time observations of the solution. By least squares with…

Machine Learning · Statistics 2020-10-30 Quanjun Lang , Fei Lu

Random projections have proven extremely useful in many signal processing and machine learning applications. However, they often require either to store a very large random matrix, or to use a different, structured matrix to reduce the…

Emerging Technologies · Computer Science 2016-08-26 Alaa Saade , Francesco Caltagirone , Igor Carron , Laurent Daudet , Angélique Drémeau , Sylvain Gigan , Florent Krzakala

Deep networks are nowadays becoming popular in many computer vision and pattern recognition tasks. Among these networks, deep kernels are particularly interesting and effective, however, their computational complexity is a major issue…

Computer Vision and Pattern Recognition · Computer Science 2018-12-24 Hichem Sahbi

We present simple, user-friendly bounds for the expected operator norm of a random kernel matrix under general conditions on the kernel function $k(\cdot,\cdot)$. Our approach uses decoupling results for U-statistics and the non-commutative…

Machine Learning · Statistics 2025-11-07 Chiraag Kaushik , Justin Romberg , Vidya Muthukumar

We present an algorithm for L1-norm kernel PCA and provide a convergence analysis for it. While an optimal solution of L2-norm kernel PCA can be obtained through matrix decomposition, finding that of L1-norm kernel PCA is not trivial due to…

Machine Learning · Statistics 2020-06-12 Cheolmin Kim , Diego Klabjan

This paper presents a kernelized version of the t-SNE algorithm, capable of mapping high-dimensional data to a low-dimensional space while preserving the pairwise distances between the data points in a non-Euclidean metric. This can be…

Machine Learning · Computer Science 2023-11-22 Denis C. Ilie-Ablachim , Bogdan Dumitrescu , Cristian Rusu

Purpose- High speed image processing is a challenging task for real-time applications such as product quality control of manufacturing lines. Smart image sensors use an array of in-pixel processors to facilitate high-speed real-time image…

Signal Processing · Electrical Eng. & Systems 2021-10-06 Ahmad Reza Danesh , Mehdi Habibi

Kernel approximation via nonlinear random feature maps is widely used in speeding up kernel machines. There are two main challenges for the conventional kernel approximation methods. First, before performing kernel approximation, a good…

Machine Learning · Statistics 2015-03-16 Felix X. Yu , Sanjiv Kumar , Henry Rowley , Shih-Fu Chang

The general perception is that kernel methods are not scalable, and neural nets are the methods of choice for nonlinear learning problems. Or have we simply not tried hard enough for kernel methods? Here we propose an approach that scales…

Machine Learning · Computer Science 2015-09-11 Bo Dai , Bo Xie , Niao He , Yingyu Liang , Anant Raj , Maria-Florina Balcan , Le Song

The bilateral filter is a useful nonlinear filter which without smoothing edges, it does spatial averaging. In the literature, the effectiveness of this method for image denoising is shown. In this paper, an extension of this method is…

Computer Vision and Pattern Recognition · Computer Science 2017-02-07 Seyede Mahya Hazavei , Hamid Reza Shahdoosti

The problem of estimating the kernel mean in a reproducing kernel Hilbert space (RKHS) is central to kernel methods in that it is used by classical approaches (e.g., when centering a kernel PCA matrix), and it also forms the core inference…

Machine Learning · Statistics 2014-11-05 Krikamol Muandet , Bharath Sriperumbudur , Bernhard Schölkopf

We consider the following problem: given an unsorted array of $n$ elements, and a sequence of intervals in the array, compute the median in each of the subarrays defined by the intervals. We describe a simple algorithm which uses O(n) space…

Data Structures and Algorithms · Computer Science 2009-01-14 Beat Gfeller , Peter Sanders

One approach to improving the running time of kernel-based machine learning methods is to build a small sketch of the input and use it in lieu of the full kernel matrix in the machine learning task of interest. Here, we describe a version…

Machine Learning · Statistics 2015-11-10 Ahmed El Alaoui , Michael W. Mahoney

Topological data analysis offers a rich source of valuable information to study vision problems. Yet, so far we lack a theoretically sound connection to popular kernel-based learning techniques, such as kernel SVMs or kernel PCA. In this…

Machine Learning · Statistics 2014-12-24 Jan Reininghaus , Stefan Huber , Ulrich Bauer , Roland Kwitt

Despite several algorithmic advances in the training of convolutional neural networks (CNNs) over the years, their generalization capabilities are still subpar across several pertinent domains, particularly within open-set tasks often found…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Colton R. Crum , Adam Czajka

Kernel methods have recently attracted resurgent interest, showing performance competitive with deep neural networks in tasks such as speech recognition. The random Fourier features map is a technique commonly used to scale up kernel…

Machine Learning · Computer Science 2018-02-01 Tri Dao , Christopher De Sa , Christopher Ré