English
Related papers

Related papers: Multi-Kernel Regression with Sparsity Constraint

200 papers

Multi-view problems can be faced with latent variable models since they are able to find low-dimensional projections that fairly capture the correlations among the multiple views that characterise each datum. On the other hand,…

In this paper we propose an extension of the iteratively regularized Gauss--Newton method to the Banach space setting by defining the iterates via convex optimization problems. We consider some a posteriori stopping rules to terminate the…

Numerical Analysis · Mathematics 2013-06-11 Qinian Jin , Min Zhong

Multiple Kernel Learning, or MKL, extends (kernelized) SVM by attempting to learn not only a classifier/regressor but also the best kernel for the training task, usually from a combination of existing kernel functions. Most MKL methods seek…

Machine Learning · Computer Science 2016-03-07 John Moeller , Sarathkrishna Swaminathan , Suresh Venkatasubramanian

In the last few decades, significant achievements have been attained in predicting where humans look at images through different computational models. However, how to determine contributions of different visual features to overall saliency…

Computer Vision and Pattern Recognition · Computer Science 2013-07-23 Yasin Kavak , Erkut Erdem , Aykut Erdem

Training deep neural networks is known to require a large number of training samples. However, in many applications only few training samples are available. In this work, we tackle the issue of training neural networks for classification…

Machine Learning · Computer Science 2017-12-25 Soufiane Belharbi , Clément Chatelain , Romain Hérault , Sébastien Adam

We develop a variational framework to understand the properties of the functions learned by neural networks fit to data. We propose and study a family of continuous-domain linear inverse problems with total variation-like regularization in…

Machine Learning · Statistics 2021-02-15 Rahul Parhi , Robert D. Nowak

Wide neural networks are biased towards learning certain functions, influencing both the rate of convergence of gradient descent (GD) and the functions that are reachable with GD in finite training time. As such, there is a great need for…

Machine Learning · Computer Science 2024-03-21 Amnon Geifman , Daniel Barzilai , Ronen Basri , Meirav Galun

In this work, we introduce a spatio-temporal kernel for Gaussian process (GP) regression-based sound field estimation. Notably, GPs have the attractive property that the sound field is a linear function of the measurements, allowing the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-08 David Sundström , Shoichi Koyama , Andreas Jakobsson

Kernel function plays a crucial role in machine learning algorithms such as classifiers. In this paper, we aim to improve the classification performance and reduce the reading out burden of quantum classifiers. We devise a universally…

Quantum Physics · Physics 2025-05-08 Li Xu , Xiao-yu Zhang , Ming Li , Shu-qian Shen

This paper introduces a novel framework for generative models based on Restricted Kernel Machines (RKMs) with joint multi-view generation and uncorrelated feature learning, called Gen-RKM. To enable joint multi-view generation, this…

Machine Learning · Computer Science 2020-12-18 Arun Pandey , Joachim Schreurs , Johan A. K. Suykens

This paper investigates the supervised learning problem with observations drawn from certain general stationary stochastic processes. Here by \emph{general}, we mean that many stationary stochastic processes can be included. We show that…

Machine Learning · Statistics 2016-05-11 Hanyuan Hang , Yunlong Feng , Ingo Steinwart , Johan A. K. Suykens

We introduce kernel-summability methods in Banach spaces using the vector-valued integrals and prove an analogue of the Silverman-Toeplitz Theorem for regular kernel-summability methods. We also show that if $X$ is a Banach space and one…

Functional Analysis · Mathematics 2023-07-18 Pierre-Olivier Parisé

In this paper, we are interested in constructing general graph-based regularizers for multiple kernel learning (MKL) given a structure which is used to describe the way of combining basis kernels. Such structures are represented by…

Machine Learning · Statistics 2014-02-14 Ziming Zhang

The problem of minimizing the least squares functional with a Fr\'echet differentiable, lower semi-continuous, convex penalizer $J$ is considered to be solved. The penalizer maps the functions of Banach space $\mathcal{V}$ into…

Optimization and Control · Mathematics 2015-11-17 Erdem Altuntac

Generative modeling has recently shown great promise in computer vision, but it has mostly focused on synthesizing visually realistic images. In this paper, motivated by multi-task learning of shareable feature representations, we consider…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

The paper presents a novel approach to direct covariance function learning for Bayesian optimisation, with particular emphasis on experimental design problems where an existing corpus of condensed knowledge is present. The method presented…

Distributed learning is an effective way to analyze big data. In distributed regression, a typical approach is to divide the big data into multiple blocks, apply a base regression algorithm on each of them, and then simply average the…

Machine Learning · Computer Science 2017-08-08 Zhengchu Guo , Lei Shi , Qiang Wu

At initialization, artificial neural networks (ANNs) are equivalent to Gaussian processes in the infinite-width limit, thus connecting them to kernel methods. We prove that the evolution of an ANN during training can also be described by a…

Machine Learning · Computer Science 2020-02-11 Arthur Jacot , Franck Gabriel , Clément Hongler

Neural kernels have drastically increased performance on diverse and nonstandard data modalities but require significantly more compute, which previously limited their application to smaller datasets. In this work, we address this by…

Machine Learning · Statistics 2023-03-10 Ben Adlam , Jaehoon Lee , Shreyas Padhy , Zachary Nado , Jasper Snoek

In many artificial intelligence and computer vision systems, the same object can be observed at distinct viewpoints or by diverse sensors, which raises the challenges for recognizing objects from different, even heterogeneous views.…

Machine Learning · Statistics 2020-04-03 Xiaoyun Li , Jie Gui , Ping Li