English
Related papers

Related papers: On Kernelization with Access to NP-Oracles

200 papers

In this work we introduce KERNELIZED TRANSFORMER, a generic, scalable, data driven framework for learning the kernel function in Transformers. Our framework approximates the Transformer kernel as a dot product between spectral feature maps…

Machine Learning · Computer Science 2022-07-22 Sankalan Pal Chowdhury , Adamos Solomou , Avinava Dubey , Mrinmaya Sachan

The kernel trick concept, formulated as an inner product in a feature space, facilitates powerful extensions to many well-known algorithms. While the kernel matrix involves inner products in the feature space, the sample covariance matrix…

Computation · Statistics 2017-07-20 Tomer Lancewicki

Marginalization -- summing a function over all assignments to a subset of its inputs -- is a fundamental computational problem with applications from probabilistic inference to formal verification. Despite its computational hardness in…

Computational Complexity · Computer Science 2025-07-16 Oliver Broadrick , Sanyam Agarwal , Guy Van den Broeck , Markus Bläser

Multigraph matching is a recent variant of the graph matching problem. In this framework, the optimization procedure considers several graphs and enforces the consistency of the matches along the graphs. This constraint can be formalized as…

Machine Learning · Computer Science 2022-10-12 François-Xavier Dupé , Rohit Yadav , Guillaume Auzias , S. Takerkart

Recent works have shown that on sufficiently over-parametrized neural nets, gradient descent with relatively large initialization optimizes a prediction function in the RKHS of the Neural Tangent Kernel (NTK). This analysis leads to global…

Machine Learning · Statistics 2020-04-28 Colin Wei , Jason D. Lee , Qiang Liu , Tengyu Ma

A coreset (or core-set) of an input set is its small summation, such that solving a problem on the coreset as its input, provably yields the same result as solving the same problem on the original (full) set, for a given family of problems…

Machine Learning · Computer Science 2019-10-22 Ibrahim Jubran , Alaa Maalouf , Dan Feldman

Learning can be seen as approximating an unknown function by interpolating the training data. Kriging offers a solution to this problem based on the prior specification of a kernel. We explore a numerical approximation approach to kernel…

Machine Learning · Statistics 2019-05-01 Houman Owhadi , Gene Ryan Yoo

Kernel methods are powerful tools in various data analysis tasks. Yet, in many cases, their time and space complexity render them impractical for large datasets. Various kernel approximation methods were proposed to overcome this issue,…

Machine Learning · Computer Science 2022-05-24 Roy Mitz , Yoel Shkolnisky

Kernel means are frequently used to represent probability distributions in machine learning problems. In particular, the well known kernel density estimator and the kernel mean embedding both have the form of a kernel mean. Unfortunately,…

Machine Learning · Statistics 2015-03-03 E. Cruz Cortés , C. Scott

A fundamental graph problem is to recognize whether the vertex set of a graph $G$ can be bipartitioned into sets $A$ and $B$ such that $G[A]$ and $G[B]$ satisfy properties $\Pi_A$ and $\Pi_B$, respectively. This so-called…

Computational Complexity · Computer Science 2019-08-27 Iyad Kanj , Christian Komusiewicz , Manuel Sorge , Erik Jan van Leeuwen

In this work, we study the $k$-median clustering problem with an additional equal-size constraint on the clusters, from the perspective of parameterized preprocessing. Our main result is the first lossy ($2$-approximate) polynomial kernel…

Data Structures and Algorithms · Computer Science 2021-07-16 Sayan Bandyapadhyay , Fedor V. Fomin , Petr A. Golovach , Nidhi Purohit , Kirill Simonov

Quantum neural networks (QNNs) and quantum kernels stand as prominent figures in the realm of quantum machine learning, poised to leverage the nascent capabilities of near-term quantum computers to surmount classical machine learning…

Quantum Physics · Physics 2023-12-14 Yiming Huang , Huiyuan Wang , Yuxuan Du , Xiao Yuan

We illustrate the strength of Algebraic Methods, adapting Gaussian Elimination and Substitution to the problem of Exact Boolean Satisfiability. For 1-in-3 SAT with non-negated literals we are able to obtain considerably smaller equivalent…

Computational Complexity · Computer Science 2020-11-02 Valentin Bura

Until recently, techniques for obtaining lower bounds for kernelization were one of the most sought after tools in the field of parameterized complexity. Now, after a strong influx of techniques, we are in the fortunate situation of having…

Data Structures and Algorithms · Computer Science 2015-03-19 Stefan Kratsch

In the NP-hard Edge Dominating Set problem (EDS) we are given a graph $G=(V,E)$ and an integer $k$, and need to determine whether there is a set $F\subseteq E$ of at most $k$ edges that are incident with all (other) edges of $G$. It is…

Data Structures and Algorithms · Computer Science 2019-01-14 Eva-Maria C. Hols , Stefan Kratsch

This paper presents an iterative method suitable for inverting semilinear problems which are important kernels in many numerical applications. The primary idea is to employ a parametrization that is able to reduce semilinear problems into…

Numerical Analysis · Mathematics 2019-08-02 Prosper Torsu

Many algorithms for ranked data become computationally intractable as the number of objects grows due to the complex geometric structure induced by rankings. An additional challenge is posed by partial rankings, i.e. rankings in which the…

Machine Learning · Computer Science 2022-07-19 Michelangelo Conserva , Marc Peter Deisenroth , K S Sesh Kumar

We study efficient preprocessing for the undirected Feedback Vertex Set problem, a fundamental problem in graph theory which asks for a minimum-sized vertex set whose removal yields an acyclic graph. More precisely, we aim to determine for…

Data Structures and Algorithms · Computer Science 2022-06-10 David Dekker , Bart M. P. Jansen

Interpolation and approximation of functionals with conditionally positive definite kernels is considered on sets of centers that are not determining for polynomials. It is shown that polynomial consistency is sufficient in order to define…

Numerical Analysis · Mathematics 2025-08-26 Oleg Davydov

In this paper, we introduce a new kernel function which differs from previous functions, and play an important role for generating a new design of primal-dual interior point algorithms for semidefinite linear complementarity problem. Its…

Numerical Analysis · Mathematics 2021-08-18 Nabila Abdessemed , Rachid Benacer , Naima Boudiaf