English
Related papers

Related papers: A Fractional Fox H-Function Kernel for Support Vec…

200 papers

We propose a simple architecture for deep reinforcement learning by embedding inputs into a learned Fourier basis and show that it improves the sample efficiency of both state-based and image-based RL. We perform infinite-width analysis of…

Machine Learning · Computer Science 2021-12-07 Alexander C. Li , Deepak Pathak

For the binary classification problem, a novel nonlinear kernel-free quadratic hyper-surface support vector machine with 0-1 loss function (QSSVM$_{0/1}$) is proposed. Specifically, the task of QSSVM$_{0/1}$ is to seek a quadratic…

Optimization and Control · Mathematics 2024-04-17 Mingyang Wu , Zhixia Yang , Junyou Ye

Face recognition has witnessed significant progresses due to the advances of deep convolutional neural networks (CNNs), the central challenge of which, is feature discrimination. To address it, one group tries to exploit mining-based…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Xiaobo Wang , Shuo Wang , Shifeng Zhang , Tianyu Fu , Hailin Shi , Tao Mei

In supervised learning using kernel methods, we often encounter a large-scale finite-sum minimization over a reproducing kernel Hilbert space (RKHS). Large-scale finite-sum problems can be solved using efficient variants of Newton method,…

Machine Learning · Computer Science 2022-06-07 Ting-Jui Chang , Shahin Shahrampour

We study a compositional variant of kernel ridge regression in which the predictor is applied to a coordinate-wise reweighting of the inputs. Formulated as a variational problem, this model provides a simple testbed for feature learning in…

Machine Learning · Computer Science 2025-11-05 Feng Ruan , Keli Liu , Michael Jordan

The random Fourier features (RFFs) method is a powerful and popular technique in kernel approximation for scalability of kernel methods. The theoretical foundation of RFFs is based on the Bochner theorem that relates symmetric, positive…

Machine Learning · Computer Science 2022-09-20 Mingzhen He , Fan He , Fanghui Liu , Xiaolin Huang

Plant breeders and agricultural researchers can increase crop productivity by identifying desirable features, disease resistance, and nutritional content by analysing the Dry Bean dataset. This study analyses and compares different Support…

Machine Learning · Computer Science 2023-07-18 Anant Mehta , Prajit Sengupta , Divisha Garg , Harpreet Singh , Yosi Shacham Diamand

Functional regression is very crucial in functional data analysis and a linear relationship between scalar response and functional predictor is often assumed. However, the linear assumption may not hold in practice, which makes the methods…

Methodology · Statistics 2023-01-18 Rou Zhong , Dongxue Wang , Jingxiao Zhang

An increasing amount of collected data are high-dimensional multi-way arrays (tensors), and it is crucial for efficient learning algorithms to exploit this tensorial structure as much as possible. The ever-present curse of dimensionality…

Machine Learning · Computer Science 2021-08-04 Kirandeep Kour , Sergey Dolgov , Martin Stoll , Peter Benner

Restricted kernel machines (RKMs) represent a versatile and powerful framework within the kernel machine family, leveraging conjugate feature duality to address a wide range of machine learning tasks, including classification, regression,…

Machine Learning · Computer Science 2025-04-17 Ritik Mishra , Mushir Akhtar , M. Tanveer

Under the frequency domain framework for weakly dependent functional time series, a key element is the spectral density kernel which encapsulates the second-order dynamics of the process. We propose a class of spectral density kernel…

Statistics Theory · Mathematics 2018-12-11 Tingyi Zhu , Dimitris N. Politis

In this paper, we propose a fast surrogate leverage weighted sampling strategy to generate refined random Fourier features for kernel approximation. Compared to the current state-of-the-art method that uses the leverage weighted scheme…

Machine Learning · Computer Science 2019-11-22 Fanghui Liu , Xiaolin Huang , Yudong Chen , Jie Yang , Johan A. K. Suykens

This article characterizes the exact asymptotics of random Fourier feature (RFF) regression, in the realistic setting where the number of data samples $n$, their dimension $p$, and the dimension of feature space $N$ are all large and…

Machine Learning · Statistics 2022-01-11 Zhenyu Liao , Romain Couillet , Michael W. Mahoney

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…

Machine Learning · Statistics 2026-05-14 Rafael Oliveira

Random Fourier features provide a way to tackle large-scale machine learning problems with kernel methods. Their slow Monte Carlo convergence rate has motivated the research of deterministic Fourier features whose approximation error can…

Machine Learning · Computer Science 2021-10-20 Frederiek Wesel , Kim Batselier

Symmetry, where certain features remain invariant under geometric transformations, can often serve as a powerful prior in designing convolutional neural networks (CNNs). While conventional CNNs inherently support translational equivariance,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Yuexi Du , Jiazhen Zhang , Nicha C. Dvornek , John A. Onofrey

Gaussian Process (GP) has gained much attention in cosmology due to its ability to reconstruct cosmological data in a model-independent manner. In this study, we compare two methods for GP kernel selection: Approximate Bayesian Computation…

Cosmology and Nongalactic Astrophysics · Physics 2023-06-07 Hao Zhang , Yu-Chen Wang , Tong-Jie Zhang , Ting-ting Zhang

We present neural frailty machine (NFM), a powerful and flexible neural modeling framework for survival regressions. The NFM framework utilizes the classical idea of multiplicative frailty in survival analysis to capture unobserved…

Machine Learning · Computer Science 2023-10-05 Ruofan Wu , Jiawei Qiao , Mingzhe Wu , Wen Yu , Ming Zheng , Tengfei Liu , Tianyi Zhang , Weiqiang Wang

The paper presents a new framework for complex Support Vector Regression as well as Support Vector Machines for quaternary classification. The method exploits the notion of widely linear estimation to model the input-out relation for…

Machine Learning · Computer Science 2016-11-15 Pantelis Bouboulis , Sergios Theodoridis , Charalampos Mavroforakis , Leoni Dalla

We present a new smooth, Gaussian-like kernel that allows the kernel density estimate for an angular distribution to be exactly represented by a finite number of its Fourier series coefficients. Distributions of angular quantities, such as…

Computer Vision and Pattern Recognition · Computer Science 2016-06-10 Michael T. McCann , Matthew Fickus , Jelena Kovacevic