中文
相关论文

相关论文: Solving $\ell^p\!$-norm regularization with tensor…

200 篇论文

This paper introduces a new and effective algorithm for learning kernels in a Multi-Task Learning (MTL) setting. Although, we consider a MTL scenario here, our approach can be easily applied to standard single task learning, as well. As…

Kernelization is the standard framework to analyze preprocessing routines mathematically. Here, in terms of efficiency, we demand the preprocessing routine to run in time polynomial in the input size. However, today, various NP-complete…

计算复杂性 · 计算机科学 2025-08-15 Hendrik Molter , Meirav Zehavi

We introduce a regularization loss based on kernel mean embeddings with rotation-invariant kernels on the hypersphere (also known as dot-product kernels) for self-supervised learning of image representations. Besides being fully competitive…

计算机视觉与模式识别 · 计算机科学 2023-03-09 Léon Zheng , Gilles Puy , Elisa Riccietti , Patrick Pérez , Rémi Gribonval

The accuracy and complexity of kernel learning algorithms is determined by the set of kernels over which it is able to optimize. An ideal set of kernels should: admit a linear parameterization (tractability); be dense in the set of all…

机器学习 · 统计学 2020-05-04 Brendon K. Colbert , Matthew M. Peet

Various methods in statistical learning build on kernels considered in reproducing kernel Hilbert spaces. In applications, the kernel is often selected based on characteristics of the problem and the data. This kernel is then employed to…

机器学习 · 统计学 2024-03-12 Paul Dommel , Alois Pichler

The computational complexity of kernel methods has often been a major barrier for applying them to large-scale learning problems. We argue that this barrier can be effectively overcome. In particular, we develop methods to scale up kernel…

We study the higher H\"older regularity of local weak solutions to a class of nonlinear nonlocal elliptic equations with kernels that satisfy a mild continuity assumption. An interesting feature of our main result is that the obtained…

偏微分方程分析 · 数学 2021-01-19 Simon Nowak

We present a general framework to learn functions in tensor product reproducing kernel Hilbert spaces (TP-RKHSs). The methodology is based on a novel representer theorem suitable for existing as well as new spectral penalties for tensors.…

机器学习 · 计算机科学 2013-10-21 Marco Signoretto , Lieven De Lathauwer , Johan A. K. Suykens

We present a general regularization-based framework for Multi-task learning (MTL), in which the similarity between tasks can be learned or refined using $\ell_p$-norm Multiple Kernel learning (MKL). Based on this very general formulation…

机器学习 · 统计学 2015-07-01 Christian Widmer , Marius Kloft , Vipin T Sreedharan , Gunnar Rätsch

In this work, we investigate the generalization properties of random feature methods. Our analysis extends prior results for Tikhonov regularization to a broad class of spectral regularization techniques and further generalizes the setting…

机器学习 · 统计学 2026-03-03 Mike Nguyen , Nicole Mücke

The performance of reproducing kernel Hilbert space-based methods is known to be sensitive to the choice of the reproducing kernel. Choosing an adequate reproducing kernel can be challenging and computationally demanding, especially in…

机器学习 · 计算机科学 2023-11-07 Emilio Ruiz-Moreno , Baltasar Beferull-Lozano

Adversarial training has emerged as a key technique to enhance model robustness against adversarial input perturbations. Many of the existing methods rely on computationally expensive min-max problems that limit their application in…

Kernel methods are among the most popular techniques in machine learning. From a frequentist/discriminative perspective they play a central role in regularization theory as they provide a natural choice for the hypotheses space and the…

机器学习 · 统计学 2012-04-17 Mauricio A. Alvarez , Lorenzo Rosasco , Neil D. Lawrence

We present a data-driven method for computing approximate forward reachable sets using separating kernels in a reproducing kernel Hilbert space. We frame the problem as a support estimation problem, and learn a classifier of the support as…

最优化与控制 · 数学 2020-11-20 Adam J. Thorpe , Kendric R. Ortiz , Meeko M. K. Oishi

We prove existence of strong solutions to a family of some semilinear parabolic free boundary problems by means of elliptic regularization. Existence of solutions is obtained in two steps: we first show some uniform energy estimates and…

偏微分方程分析 · 数学 2023-06-12 Alessandro Audrito , Tomás Sanz-Perela

We give a universal kernel that renders all the regular languages linearly separable. We are not able to compute this kernel efficiently and conjecture that it is intractable, but we do have an efficient $\eps$-approximation.

机器学习 · 计算机科学 2007-12-07 Leonid , Kontorovich

Deep neural networks (NN) have achieved great success in many applications. However, why do deep neural networks obtain good generalization at an over-parameterization regime is still unclear. To better understand deep NN, we establish the…

机器学习 · 统计学 2021-12-02 Yueming Lyu , Ivor Tsang

Kernelized maximum-likelihood (ML) expectation maximization (EM) methods have recently gained prominence in PET image reconstruction, outperforming many previous state-of-the-art methods. But they are not immune to the problems of…

图像与视频处理 · 电气工程与系统科学 2021-03-05 Shiyao Guo , Yuxia Sheng , Shenpeng Li , Li Chai , Jingxin Zhang

We propose a novel class of kernels to alleviate the high computational cost of large-scale nonparametric learning with kernel methods. The proposed kernel is defined based on a hierarchical partitioning of the underlying data domain, where…

机器学习 · 计算机科学 2017-08-15 Jie Chen , Haim Avron , Vikas Sindhwani

Tensor decomposition methods allow us to learn the parameters of latent variable models through decomposition of low-order moments of data. A significant limitation of these algorithms is that there exists no general method to regularize…

机器学习 · 统计学 2019-05-28 Omer Gottesman , Weiwei Pan , Finale Doshi-Velez