English
Related papers

Related papers: Conditional KRR: Injecting Unpenalized Features in…

200 papers

We consider the task of robust non-linear regression in the presence of both inlier noise and outliers. Assuming that the unknown non-linear function belongs to a Reproducing Kernel Hilbert Space (RKHS), our goal is to estimate the set of…

Machine Learning · Computer Science 2017-08-02 George Papageorgiou , Pantelis Bouboulis , Sergios Theodoridis

We consider the problem of conditional independence (CI) testing and adopt a kernel-based approach. Kernel-based CI tests embed variables in reproducing kernel Hilbert spaces, regress their embeddings on the conditioning variables, and test…

Machine Learning · Statistics 2026-04-07 Luca Bergen , Dino Sejdinovic , Vanessa Didelez

The paper introduces a new efficient nonlinear one-class classifier formulated as the Rayleigh quotient criterion optimisation. The method, operating in a reproducing kernel Hilbert space, minimises the scatter of target distribution along…

Machine Learning · Computer Science 2019-02-12 Shervin Rahimzadeh Arashloo , Josef Kittler

We propose a novel parameter estimation procedure that works efficiently for conditional random fields (CRF). This algorithm is an extension to the maximum likelihood estimation (MLE), using loss functions defined by Bregman divergences…

Machine Learning · Computer Science 2015-08-11 Yuan Cao

The large amount of online data and vast array of computing resources enable current researchers in both industry and academia to employ the power of deep learning with neural networks. While deep models trained with massive amounts of data…

Machine Learning · Computer Science 2020-06-15 Shuai Tang , Virginia R. de Sa

Kernel learning methods are among the most effective learning methods and have been vigorously studied in the past decades. However, when tackling with complicated tasks, classical kernel methods are not flexible or "rich" enough to…

Machine Learning · Computer Science 2019-10-08 Jiaxuan Xie , Fanghui Liu , Kaijie Wang , Xiaolin Huang

This paper studies random operator-valued positive definite (p.d.) kernels and their connection to moment dilations. A class of random p.d. kernels is introduced in which the positivity requirement is imposed only in expectation, extending…

Functional Analysis · Mathematics 2025-08-15 James Tian

Detecting unobserved confounders is crucial for reliable causal inference in observational studies. Existing methods require either linearity assumptions or multiple heterogeneous environments, limiting applicability to nonlinear…

Machine Learning · Statistics 2026-01-05 Yikai Chen , Yunxin Mao , Chunyuan Zheng , Hao Zou , Shanzhi Gu , Shixuan Liu , Yang Shi , Wenjing Yang , Kun Kuang , Haotian Wang

Often we wish to predict a large number of variables that depend on each other as well as on other observed variables. Structured prediction methods are essentially a combination of classification and graphical modeling, combining the…

Machine Learning · Statistics 2010-11-19 Charles Sutton , Andrew McCallum

We study classes of reproducing kernels $K$ on general domains; these are kernels which arise commonly in machine learning models; models based on certain families of reproducing kernel Hilbert spaces. They are the positive definite kernels…

Functional Analysis · Mathematics 2017-08-22 Palle Jorgensen , Feng Tian

There is currently a huge effort to understand the potential and limitations of variational quantum machine learning (QML) based on the optimization of parameterized quantum circuits. Recent proposals toward dequantizing variational QML…

Quantum Physics · Physics 2025-04-01 Ryan Sweke , Seongwook Shin , Elies Gil-Fuster

Kernel method has been developed as one of the standard approaches for nonlinear learning, which however, does not scale to large data set due to its quadratic complexity in the number of samples. A number of kernel approximation methods…

Machine Learning · Computer Science 2018-09-20 Lingfei Wu , Ian E. H. Yen , Jie Chen , Rui Yan

Pixel-level labelling tasks, such as semantic segmentation, play a central role in image understanding. Recent approaches have attempted to harness the capabilities of deep learning techniques for image recognition to tackle pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2016-04-15 Shuai Zheng , Sadeep Jayasumana , Bernardino Romera-Paredes , Vibhav Vineet , Zhizhong Su , Dalong Du , Chang Huang , Philip H. S. Torr

In standard supervised machine learning, it is necessary to provide a label for every input in the data. While raw data in many application domains is easily obtainable on the Internet, manual labelling of this data is prohibitively…

Machine Learning · Computer Science 2023-09-07 Konstantinos Christopher Tsiolis

We study the covariate shift problem in the context of nonparametric regression over a reproducing kernel Hilbert space (RKHS). We focus on two natural families of covariate shift problems defined using the likelihood ratios between the…

Statistics Theory · Mathematics 2023-06-07 Cong Ma , Reese Pathak , Martin J. Wainwright

Kernel power $k$-means (KPKM) leverages a family of means to mitigate local minima issues in kernel $k$-means. However, KPKM faces two key limitations: (1) the computational burden of the full kernel matrix restricts its use on extensive…

Machine Learning · Computer Science 2025-11-14 Yixi Chen , Weixuan Liang , Tianrui Liu , Jun-Jie Huang , Ao Li , Xueling Zhu , Xinwang Liu

We propose a framework for transfer learning of discount curves across different fixed-income product classes. Motivated by challenges in estimating discount curves from sparse or noisy data, we extend kernel ridge regression (KR) to a…

Machine Learning · Statistics 2026-01-14 Nicolas Camenzind , Damir Filipovic

Regularized empirical risk minimization using kernels and their corresponding reproducing kernel Hilbert spaces (RKHSs) plays an important role in machine learning. However, the actually used kernel often depends on one or on a few…

Machine Learning · Statistics 2017-09-25 Andreas Christmann , Daohong Xiang , Ding-Xuan Zhou

We introduce an original method of multidimensional ridge penalization in functional local linear regressions. The nonparametric regression of functional data is extended from its multivariate counterpart, and is known to be sensitive to…

Methodology · Statistics 2021-09-20 Wentian Huang , David Ruppert

Kernel method-based one-class classifier is mainly used for outlier or novelty detection. In this letter, kernel ridge regression (KRR) based one-class classifier (KOC) has been extended for learning using privileged information (LUPI).…

Machine Learning · Computer Science 2019-04-18 Chandan Gautam , Aruna Tiwari , M. Tanveer