English
Related papers

Related papers: Sparse Multiple Kernel Learning with Geometric Con…

200 papers

We present a sparse knowledge gradient (SpKG) algorithm for adaptively selecting the targeted regions within a large RNA molecule to identify which regions are most amenable to interactions with other molecules. Experimentally, such regions…

Optimization and Control · Mathematics 2015-08-10 Yan Li , Kristofer G. Reyes , Jorge Vazquez-Anderson , Yingfei Wang , Lydia M. Contreras , Warren B. Powell

Kernel-based learning algorithms are widely used in machine learning for problems that make use of the similarity between object pairs. Such algorithms first embed all data points into an alternative space, where the inner product between…

Machine Learning · Statistics 2017-09-21 Amir-Hossein Karimi

We propose a deep learning approach for discovering kernels tailored to identifying clusters over sample data. Our neural network produces sample embeddings that are motivated by--and are at least as expressive as--spectral clustering. Our…

Machine Learning · Computer Science 2020-01-03 Chieh Wu , Zulqarnain Khan , Yale Chang , Stratis Ioannidis , Jennifer Dy

Recent image degradation estimation methods have enabled single-image super-resolution (SR) approaches to better upsample real-world images. Among these methods, explicit kernel estimation approaches have demonstrated unprecedented…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Royson Lee , Rui Li , Stylianos I. Venieris , Timothy Hospedales , Ferenc Huszár , Nicholas D. Lane

We are interested in a framework of online learning with kernels for low-dimensional but large-scale and potentially adversarial datasets. We study the computational and theoretical performance of online variations of kernel Ridge…

Machine Learning · Statistics 2019-05-30 Rémi Jézéquel , Pierre Gaillard , Alessandro Rudi

In sparse coding it is common to tile an image into nonoverlapping patches, and then use a dictionary to create a sparse representation of each tile independently. In this situation, the overcompleteness of the dictionary is the number of…

Quantitative Methods · Quantitative Biology 2014-06-18 Peter F. Schultz , Dylan M. Paiton , Wei Lu , Garrett T. Kenyon

In this abstract paper, we introduce a new kernel learning method by a nonparametric density estimator. The estimator consists of a group of k-centroids clusterings. Each clustering randomly selects data points with randomly selected…

Machine Learning · Computer Science 2017-08-02 Xiao-Lei Zhang

When faced with learning a set of inter-related tasks from a limited amount of usable data, learning each task independently may lead to poor generalization performance. Multi-Task Learning (MTL) exploits the latent relations between tasks…

Machine Learning · Computer Science 2015-08-14 Niloofar Yousefi , Michael Georgiopoulos , Georgios C. Anagnostopoulos

Simultaneously solving multiple related learning tasks is beneficial under a variety of circumstances, but the prior knowledge necessary to correctly model task relationships is rarely available in practice. In this paper, we develop a…

Machine Learning · Computer Science 2013-07-02 Francesco Dinuzzo

We present a Gaussian kernel loss function and training algorithm for convolutional neural networks that can be directly applied to both distance metric learning and image classification problems. Our method treats all training features…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Benjamin J. Meyer , Ben Harwood , Tom Drummond

We consider the two-group classification problem and propose a kernel classifier based on the optimal scoring framework. Unlike previous approaches, we provide theoretical guarantees on the expected risk consistency of the method. We also…

Machine Learning · Statistics 2021-04-01 Alexander F. Lapanowski , Irina Gaynanova

Learning can be seen as approximating an unknown function by interpolating the training data. Kriging offers a solution to this problem based on the prior specification of a kernel. We explore a numerical approximation approach to kernel…

Machine Learning · Statistics 2019-05-01 Houman Owhadi , Gene Ryan Yoo

The accuracy and complexity of kernel learning algorithms is determined by the set of kernels over which it is able to optimize. An ideal set of kernels should: admit a linear parameterization (tractability); be dense in the set of all…

Machine Learning · Statistics 2020-05-04 Brendon K. Colbert , Matthew M. Peet

Kernel methods are one of the cornerstones of learning-based control, modern system identification, surrogate modelling, and related fields. A key advantage of this class of learning and function approximation methods is the availability of…

Numerical Analysis · Mathematics 2026-05-20 Tizian Wenzel , Abdullah Tokmak , Christian Fiedler

Learning kernels in operators from data lies at the intersection of inverse problems and statistical learning, providing a powerful framework for capturing non-local dependencies in function spaces and high-dimensional settings. In contrast…

Statistics Theory · Mathematics 2025-06-24 Sichong Zhang , Xiong Wang , Fei Lu

We consider scattered data approximation on product regions of equal and different dimensionality. On each of these regions, we assume quasi-uniform but unstructured data sites and construct optimal sparse grids for scattered data…

Numerical Analysis · Mathematics 2026-04-24 Michael Griebel , Helmut Harbrecht , Michael Multerer

We propose a novel adaptive kernel based regression method for complex-valued signals: the generalized complex-valued kernel least-mean-square (gCKLMS). We borrow from the new results on widely linear reproducing kernel Hilbert space…

Machine Learning · Statistics 2019-10-02 Rafael Boloix-Tortosa , Juan José Murillo-Fuentes , Sotirios A. Tsaftaris

Choosing a proper set of kernel functions is an important problem in learning Gaussian Process (GP) models since each kernel structure has different model complexity and data fitness. Recently, automatic kernel composition methods provide…

Machine Learning · Computer Science 2021-02-25 Anh Tong , Toan Tran , Hung Bui , Jaesik Choi

Kernel methods serve as powerful tools to capture nonlinear patterns behind data in machine learning. The quantum kernel, integrating kernel theory with quantum computing, has attracted widespread attention. However, existing studies…

Quantum Physics · Physics 2025-05-23 Jing Li , Yanqi Song , Sujuan Qin , Fei Gao

Low-rank approximation of kernels is a fundamental mathematical problem with widespread algorithmic applications. Often the kernel is restricted to an algebraic variety, e.g., in problems involving sparse or low-rank data. We show that…

Machine Learning · Computer Science 2023-10-02 Jason M. Altschuler , Pablo A. Parrilo