English
Related papers

Related papers: On the convergence of generalized kernel-based int…

200 papers

Finding dense subgraphs of a large graph is a standard problem in graph mining that has been studied extensively both for its theoretical richness and its many practical applications. In this paper we introduce a new family of dense…

Data Structures and Algorithms · Computer Science 2021-06-07 Nate Veldt , Austin R. Benson , Jon Kleinberg

Kernel approximation methods create explicit, low-dimensional kernel feature maps to deal with the high computational and memory complexity of standard techniques. This work studies a supervised kernel learning methodology to optimize such…

Machine Learning · Computer Science 2020-02-17 Mert Al , Zejiang Hou , Sun-Yuan Kung

Considering a regression model, we address the question of testing the nullity of the regression function. The testing procedure is available when the variance of the observations is unknown and does not depend on any prior information on…

Statistics Theory · Mathematics 2019-04-08 Thi Thien Trang Bui

We present a general approximation framework for weighted integer covering problems. In a weighted integer covering problem, the goal is to determine a non-negative integer solution $x$ to system $\{ Ax \geq r \}$ minimizing a non-negative…

Discrete Mathematics · Computer Science 2017-04-28 Britta Peis , José Verschae , Andreas Wierz

Interpolation and approximation of functionals with conditionally positive definite kernels is considered on sets of centers that are not determining for polynomials. It is shown that polynomial consistency is sufficient in order to define…

Numerical Analysis · Mathematics 2025-08-26 Oleg Davydov

Kernel methods are popular in clustering due to their generality and discriminating power. However, we show that many kernel clustering criteria have density biases theoretically explaining some practically significant artifacts empirically…

Machine Learning · Statistics 2017-12-11 Dmitrii Marin , Meng Tang , Ismail Ben Ayed , Yuri Boykov

Recent empirical work has shown that hierarchical convolutional kernels inspired by convolutional neural networks (CNNs) significantly improve the performance of kernel methods in image classification tasks. A widely accepted explanation…

Machine Learning · Statistics 2022-06-06 Theodor Misiakiewicz , Song Mei

An approach for effective implementation of greedy selection methodologies, to approximate an image partitioned into blocks, is proposed. The method is specially designed for approximating partitions on a transformed image. It evolves by…

Computer Vision and Pattern Recognition · Computer Science 2015-06-17 Laura Rebollo-Neira , Ryszard Maciol , Shabnam Bibi

Kernel-based K-means clustering has gained popularity due to its simplicity and the power of its implicit non-linear representation of the data. A dominant concern is the memory requirement since memory scales as the square of the number of…

Machine Learning · Statistics 2016-12-05 Farhad Pourkamali-Anaraki , Stephen Becker

The asymptotically precise estimation of the generalization of kernel methods has recently received attention due to the parallels between neural networks and their associated kernels. However, prior works derive such estimates for training…

Machine Learning · Computer Science 2024-03-19 Maksim Velikanov , Maxim Panov , Dmitry Yarotsky

Standard video frame interpolation methods first estimate optical flow between input frames and then synthesize an intermediate frame guided by motion. Recent approaches merge these two steps into a single convolution process by convolving…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Simon Niklaus , Long Mai , Feng Liu

Gaussian processes (GPs) provide flexible distributions over functions, with inductive biases controlled by a kernel. However, in many applications Gaussian processes can struggle with even moderate input dimensionality. Learning a low…

Machine Learning · Computer Science 2020-01-01 Ian A. Delbridge , David S. Bindel , Andrew Gordon Wilson

``Benign overfitting'', the ability of certain algorithms to interpolate noisy training data and yet perform well out-of-sample, has been a topic of considerable recent interest. We show, using a fixed design setup, that an important class…

Machine Learning · Computer Science 2023-04-14 Daniel Beaglehole , Mikhail Belkin , Parthe Pandit

To accelerate kernel methods, we propose a near input sparsity time algorithm for sampling the high-dimensional feature space implicitly defined by a kernel transformation. Our main contribution is an importance sampling method for…

Data Structures and Algorithms · Computer Science 2020-07-15 David P. Woodruff , Amir Zandieh

We give a general method for rounding linear programs that combines the commonly used iterated rounding and randomized rounding techniques. In particular, we show that whenever iterated rounding can be applied to a problem with some slack,…

Data Structures and Algorithms · Computer Science 2019-07-19 Nikhil Bansal

We study the problem of estimating a random process from the observations collected by a network of sensors that operate under resource constraints. When the dynamics of the process and sensor observations are described by a state-space…

Signal Processing · Electrical Eng. & Systems 2018-07-24 Abolfazl Hashemi , Mahsa Ghasemi , Haris Vikalo , Ufuk Topcu

In many applications of machine learning, a large number of variables are considered. Motivated by machine learning of interacting particle systems, we consider the situation when the number of input variables goes to infinity. First, we…

Machine Learning · Computer Science 2023-10-30 Christian Fiedler , Michael Herty , Sebastian Trimpe

In a standard NP-complete optimization problem we introduce an interpolating algorithm between the quick decrease along the gradient (greedy dynamics) and a slow decrease close to the level curves (reluctant dynamics). We find that for a…

Mathematical Physics · Physics 2007-05-23 P. Contucci , C. Giardina' , C. Giberti , F. Unguendoli , C. Vernia

We investigate iterated compositions of weighted sums of Gaussian kernels and provide an interpretation of the construction that shows some similarities with the architectures of deep neural networks. On the theoretical side, we show that…

Machine Learning · Statistics 2016-12-05 Ingo Steinwart , Philipp Thomann , Nico Schmid

We describe a parallel approximation algorithm for maximizing monotone submodular functions subject to hereditary constraints on distributed memory multiprocessors. Our work is motivated by the need to solve submodular optimization problems…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-18 Shivaram Gopal , S M Ferdous , Hemanta K. Maji , Alex Pothen