English
Related papers

Related papers: Kernel Risk-Sensitive Loss: Definition, Properties…

200 papers

Existing measures and representations for trajectories have two longstanding fundamental shortcomings, i.e., they are computationally expensive and they can not guarantee the `uniqueness' property of a distance function: dist(X,Y) = 0 if…

Machine Learning · Computer Science 2023-01-03 Yufan Wang , Kai Ming Ting , Yuanyi Shang

As a promising step, the performance of data analysis and feature learning are able to be improved if certain pattern matching mechanism is available. One of the feasible solutions can refer to the importance estimation of instances, and…

Machine Learning · Computer Science 2020-11-17 Miao Cheng , Xinge You

We propose two new methods to address the weak scaling problems of KRR: the Balanced KRR (BKRR) and K-means KRR (KKRR). These methods consider alternative ways to partition the input dataset into p different parts, generating p different…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-03 Yang You , James Demmel , Cho-Jui Hsieh , Richard Vuduc

Kernel Regularized Least Squares (KRLS) is a popular method for flexibly estimating models that may have complex relationships between variables. However, its usefulness to many researchers is limited for two reasons. First, existing…

Machine Learning · Statistics 2023-09-12 Qing Chang , Max Goplerud

We consider the problem of streaming kernel regression, when the observations arrive sequentially and the goal is to recover the underlying mean function, assumed to belong to an RKHS. The variance of the noise is not assumed to be known.…

Machine Learning · Statistics 2017-08-03 Audrey Durand , Odalric-Ambrym Maillard , Joelle Pineau

We propose the adaptive random Fourier features Gaussian kernel LMS (ARFF-GKLMS). Like most kernel adaptive filters based on stochastic gradient descent, this algorithm uses a preset number of random Fourier features to save computation…

Signal Processing · Electrical Eng. & Systems 2022-07-18 Wei Gao , Jie Chen , Cédric Richard , Wentao Shi , Qunfei Zhang

Stemming from information-theoretic learning, the correntropy criterion and its applications to machine learning tasks have been extensively explored and studied. Its application to regression problems leads to the robustness enhanced…

Machine Learning · Computer Science 2020-07-23 Yunlong Feng

Sparse adaptive channel estimation problem is one of the most important topics in broadband wireless communications systems due to its simplicity and robustness. So far many sparsity-aware channel estimation algorithms have been developed…

Information Theory · Computer Science 2015-04-15 Wentao Ma , Hua Qua , Guan Gui , Li Xu , Jihong Zhaoa , Badong Chen

Kernel methods, particularly kernel ridge regression (KRR), are time-proven, powerful nonparametric regression techniques known for their rich capacity, analytical simplicity, and computational tractability. The analysis of their predictive…

Statistics Theory · Mathematics 2025-09-23 Xin Bing , Xin He , Chao Wang

We propose a scalable robust learning algorithm combining kernel smoothing and robust optimization. Our method is motivated by the convex analysis perspective of distributionally robust optimization based on probability metrics, such as the…

Machine Learning · Computer Science 2022-02-22 Jia-Jie Zhu , Christina Kouridi , Yassine Nemmour , Bernhard Schölkopf

Functional regression is very crucial in functional data analysis and a linear relationship between scalar response and functional predictor is often assumed. However, the linear assumption may not hold in practice, which makes the methods…

Methodology · Statistics 2023-01-18 Rou Zhong , Dongxue Wang , Jingxiao Zhang

In this study, we establish a basis for selecting similarity measures when applying machine learning techniques to solve materials science problems. This selection is considered with an emphasis on the distinctiveness between materials that…

Machine Learning · Computer Science 2019-03-27 Tran-Thai Dang , Tien-Lam Pham , Hiori Kino , Takashi Miyake , Hieu-Chi Dam

In this paper, we propose a novel adaptive kernel for the radial basis function (RBF) neural networks. The proposed kernel adaptively fuses the Euclidean and cosine distance measures to exploit the reciprocating properties of the two. The…

Machine Learning · Statistics 2019-05-10 Shujaat Khan , Imran Naseem , Roberto Togneri , Mohammed Bennamoun

We are interested in a framework of online learning with kernels for low-dimensional but large-scale and potentially adversarial datasets. We study the computational and theoretical performance of online variations of kernel Ridge…

Machine Learning · Statistics 2019-05-30 Rémi Jézéquel , Pierre Gaillard , Alessandro Rudi

We propose a novel adaptive kernel based regression method for complex-valued signals: the generalized complex-valued kernel least-mean-square (gCKLMS). We borrow from the new results on widely linear reproducing kernel Hilbert space…

Machine Learning · Statistics 2019-10-02 Rafael Boloix-Tortosa , Juan José Murillo-Fuentes , Sotirios A. Tsaftaris

The Kalman filter provides an optimal estimation for a linear system with Gaussian noise. However when the noises are non-Gaussian in nature, its performance deteriorates rapidly. For non-Gaussian noises, maximum correntropy Kalman filter…

Optimization and Control · Mathematics 2023-02-07 Joydeb Saha , Shovan Bhaumik

Kernel ridge regression is used to approximate the kinetic energy of non-interacting fermions in a one-dimensional box as a functional of their density. The properties of different kernels and methods of cross-validation are explored, and…

We consider the task of robust non-linear regression in the presence of both inlier noise and outliers. Assuming that the unknown non-linear function belongs to a Reproducing Kernel Hilbert Space (RKHS), our goal is to estimate the set of…

Machine Learning · Computer Science 2017-08-02 George Papageorgiou , Pantelis Bouboulis , Sergios Theodoridis

Online change detection involves monitoring a stream of data for changes in the statistical properties of incoming observations. A good change detector will detect any changes shortly after they occur, while raising few false alarms.…

Statistics Theory · Mathematics 2020-03-03 Thomas Flynn , Shinjae Yoo

Similarity plays a fundamental role in many areas, including data mining, machine learning, statistics and various applied domains. Inspired by the success of ensemble methods and the flexibility of trees, we propose to learn a similarity…

Machine Learning · Computer Science 2019-08-29 Donghui Yan , Songxiang Gu , Ying Xu , Zhiwei Qin