English
Related papers

Related papers: Multi-Kernel Correntropy for Robust Learning

200 papers

As a promising step, the performance of data analysis and feature learning are able to be improved if certain pattern matching mechanism is available. One of the feasible solutions can refer to the importance estimation of instances, and…

Machine Learning · Computer Science 2020-11-17 Miao Cheng , Xinge You

Markov Chain Monte Carlo (MCMC) is a powerful method for drawing samples from non-standard probability distributions and is utilized across many fields and disciplines. Methods such as Metropolis-Adjusted Langevin (MALA) and Hamiltonian…

Computation · Statistics 2024-10-28 Lee Devlin , Paul Horridge , Peter L. Green , Simon Maskell

Quantum kernel methods, i.e., kernel methods with quantum kernels, offer distinct advantages as a hybrid quantum-classical approach to quantum machine learning (QML), including applicability to Noisy Intermediate-Scale Quantum (NISQ)…

Quantum Physics · Physics 2022-11-29 Daniel T. Chang

The Partial Least Square Regression (PLSR) exhibits admirable competence for predicting continuous variables from inter-correlated brain recordings in the brain-computer interface. However, PLSR is in essence formulated based on the least…

Signal Processing · Electrical Eng. & Systems 2023-11-22 Yuanhao Li , Badong Chen , Gang Wang , Natsue Yoshimura , Yasuharu Koike

Disturbance observers have been attracting continuing research efforts and are widely used in many applications. Among them, the Kalman filter-based disturbance observer is an attractive one since it estimates both the state and the…

Systems and Control · Electrical Eng. & Systems 2023-10-31 Shilei Li , Dawei Shi , Yunjiang Lou , Wulin Zou , Ling Shi

We introduce a gradient-based learning method to automatically adapt Markov chain Monte Carlo (MCMC) proposal distributions to intractable targets. We define a maximum entropy regularised objective function, referred to as generalised speed…

Machine Learning · Statistics 2020-01-07 Michalis K. Titsias , Petros Dellaportas

We present a collaborative learning method called Mutual Contrastive Learning (MCL) for general visual representation learning. The core idea of MCL is to perform mutual interaction and transfer of contrastive distributions among a cohort…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Chuanguang Yang , Zhulin An , Linhang Cai , Yongjun Xu

The kernel Maximum Mean Discrepancy~(MMD) is a popular multivariate distance metric between distributions that has found utility in two-sample testing. The usual kernel-MMD test statistic is a degenerate U-statistic under the null, and thus…

Methodology · Statistics 2025-09-16 Shubhanshu Shekhar , Ilmun Kim , Aaditya Ramdas

Symmetry, where certain features remain invariant under geometric transformations, can often serve as a powerful prior in designing convolutional neural networks (CNNs). While conventional CNNs inherently support translational equivariance,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Yuexi Du , Jiazhen Zhang , Nicha C. Dvornek , John A. Onofrey

Involutive MCMC is a unifying mathematical construction for MCMC kernels that generalizes many classic and state-of-the-art MCMC algorithms, from reversible jump MCMC to kernels based on deep neural networks. But as with MCMC samplers more…

Computation · Statistics 2020-07-22 Marco Cusumano-Towner , Alexander K. Lew , Vikash K. Mansinghka

Distributed estimation over networks draws much attraction in recent years. In many situations, due to imperfect information communication among nodes, the performance of traditional diffusion adaptive algorithms such as the diffusion LMS…

Information Theory · Computer Science 2018-02-15 Yicong He , Fei Wang , Shiyuan Wang , Pengju Ren , Badong Chen

Robust regression aims to develop methods for estimating an unknown regression function in the presence of outliers, heavy-tailed distributions, or contaminated data, which can severely impact performance. Most existing theoretical results…

Machine Learning · Statistics 2025-03-27 Hongwei Wen , Annika Betken , Wouter Koolen

Sequential Monte Carlo (SMC) methods are not only a popular tool in the analysis of state space models, but offer an alternative to MCMC in situations where Bayesian inference must proceed via simulation. This paper introduces a new SMC…

Computation · Statistics 2010-05-11 Paul Fearnhead , Benjamin M. Taylor

Interest in multioutput kernel methods is increasing, whether under the guise of multitask learning, multisensor networks or structured output data. From the Gaussian process perspective a multioutput Mercer kernel is a covariance function…

Machine Learning · Statistics 2009-12-18 Mauricio A. Álvarez , David Luengo , Michalis K. Titsias , Neil D. Lawrence

In the univariate setting, using the kernel spectral representation is an appealing approach for generating stationary covariance functions. However, performing the same task for multiple-output Gaussian processes is substantially more…

Machine Learning · Statistics 2021-03-15 Fergus Simpson , Alexis Boukouvalas , Vaclav Cadek , Elvijs Sarkans , Nicolas Durrande

Graph spectral techniques for measuring graph similarity, or for learning the cluster number, require kernel smoothing. The choice of kernel function and bandwidth are typically chosen in an ad-hoc manner and heavily affect the resulting…

Machine Learning · Statistics 2019-12-20 Diego Granziol , Robin Ru , Stefan Zohren , Xiaowen Dong , Michael Osborne , Stephen Roberts

Multi-agent collaborative perception (MCP) has recently attracted much attention. It includes three key processes: communication for sharing, collaboration for integration, and reconstruction for different downstream tasks. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Tianhang Wang , Guang Chen , Kai Chen , Zhengfa Liu , Bo Zhang , Alois Knoll , Changjun Jiang

We investigate the application of randomized quasi-Monte Carlo (RQMC) methods in random feature approximations for kernel-based learning. Compared to the classical Monte Carlo (MC) approach \citep{rahimi2007random}, RQMC improves the…

Methodology · Statistics 2025-09-09 Yian Huang , Zhen Huang

Tremendous variation in the scale of people/head size is a critical problem for crowd counting. To improve the scale invariance of feature representation, recent works extensively employ Convolutional Neural Networks with multi-column…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Zhi-Qi Cheng , Jun-Xiu Li , Qi Dai , Xiao Wu , Jun-Yan He , Alexander Hauptmann

Recommender systems guide users through vast amounts of information by suggesting items based on their predicted preferences. Collaborative filtering-based deep learning techniques have regained popularity due to their straightforward…

Machine Learning · Computer Science 2024-09-11 Makbule Gulcin Ozsoy