English
Related papers

Related papers: Dynamic Maintenance of Kernel Density Estimation D…

200 papers

Current meta-learning approaches focus on learning functional representations of relationships between variables, i.e. on estimating conditional expectations in regression. In many applications, however, we are faced with conditional…

Machine Learning · Statistics 2021-02-25 Jean-Francois Ton , Lucian Chan , Yee Whye Teh , Dino Sejdinovic

High-dimensional dense embeddings have become central to modern Information Retrieval, but many dimensions are noisy or redundant. Recently proposed DIME (Dimension IMportance Estimation), provides query-dependent scores to identify…

Information Retrieval · Computer Science 2026-04-13 Giulio D'Erasmo , Cesare Campagnano , Antonio Mallia , Pierpaolo Brutti , Nicola Tonellotto , Fabrizio Silvestri

Adaptive experiments improve efficiency by adjusting treatment assignments based on past outcomes, but this adaptivity breaks the i.i.d.\ assumptions that underpin classical asymptotics. At the same time, many questions of interest are…

Machine Learning · Statistics 2026-05-05 Houssam Zenati , Bariscan Bozkurt , Arthur Gretton

The Neural Autoregressive Distribution Estimator (NADE) and its real-valued version RNADE are competitive density models of multidimensional data across a variety of domains. These models use a fixed, arbitrary ordering of the data…

Machine Learning · Statistics 2014-01-14 Benigno Uria , Iain Murray , Hugo Larochelle

In this paper, the flexibility, versatility and predictive power of kernel regression are combined with now lavishly available network data to create regression models with even greater predictive performances. Building from previous work…

Machine Learning · Statistics 2020-11-05 E. Pei , E. Fokoué

We study the construction of coresets for kernel density estimates. That is we show how to approximate the kernel density estimate described by a large point set with another kernel density estimate with a much smaller point set. For…

Machine Learning · Computer Science 2017-10-13 Jeff M. Phillips , Wai Ming Tai

Kernel regression is an essential and ubiquitous tool for non-parametric data analysis, particularly popular among time series and spatial data. However, the central operation which is performed many times, evaluating a kernel on the data…

Machine Learning · Computer Science 2017-06-01 Yan Zheng , Jeff M. Phillips

This article presents a three-step framework for learning and solving partial differential equations (PDEs) using kernel methods. Given a training set consisting of pairs of noisy PDE solutions and source/boundary terms on a mesh, kernel…

Machine Learning · Statistics 2023-04-03 Da Long , Nicole Mrvaljevic , Shandian Zhe , Bamdad Hosseini

One of the fundamental problems in machine learning is the estimation of a probability distribution from data. Many techniques have been proposed to study the structure of data, most often building around the assumption that observations…

Machine Learning · Statistics 2013-02-22 Oren Rippel , Ryan Prescott Adams

In distributed networks, it is often useful for the nodes to be aware of dense subgraphs, e.g., such a dense subgraph could reveal dense subtructures in otherwise sparse graphs (e.g. the World Wide Web or social networks); these might…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-08-08 Atish Das Sarma , Ashwin Lall , Danupon Nanongkai , Amitabh Trehan

Learning with kernels is an important concept in machine learning. Standard approaches for kernel methods often use predefined kernels that require careful selection of hyperparameters. To mitigate this burden, we propose in this paper a…

Machine Learning · Computer Science 2020-06-26 Yufan Zhou , Changyou Chen , Jinhui Xu

The Neural Tangent Kernel (NTK) offers a powerful tool to study the functional dynamics of neural networks. In the so-called lazy, or kernel regime, the NTK remains static during training and the network function is linear in the static…

Machine Learning · Computer Science 2025-07-28 Yuzhi Liu , Zixuan Chen , Zirui Zhang , Yufei Liu , Giulia Lanzillotta

We use a support vector regressor based on a projected quantum kernel method to predict the density structure of 1D fermionic systems of interest in quantum chemistry and quantum matter. The kernel is built on with the observables of a…

Quantum Physics · Physics 2025-09-01 Francesco Perciavalle , Francesco Plastina , Michele Pisarra , Nicola Lo Gullo

Graph-based methods pervade the inference toolkits of numerous disciplines including sociology, biology, neuroscience, physics, chemistry, and engineering. A challenging problem encountered in this context pertains to determining the…

Machine Learning · Computer Science 2018-09-25 Daniel Romero , Vassilis N. Ioannidis , Georgios B. Giannakis

Kernel matrices, as well as weighted graphs represented by them, are ubiquitous objects in machine learning, statistics and other related fields. The main drawback of using kernel methods (learning and inference using kernel matrices) is…

Machine Learning · Computer Science 2022-12-02 Ainesh Bakshi , Piotr Indyk , Praneeth Kacham , Sandeep Silwal , Samson Zhou

Structural equation models (SEMs) have been widely adopted for inference of causal interactions in complex networks. Recent examples include unveiling topologies of hidden causal networks over which processes such as spreading diseases, or…

Machine Learning · Statistics 2017-04-05 Yanning Shen , Brian Baingana , Georgios B. Giannakis

Deep kernel learning provides an elegant and principled framework for combining the structural properties of deep learning algorithms with the flexibility of kernel methods. By means of a deep neural network, we learn a parametrized kernel…

Machine Learning · Computer Science 2020-12-14 Prudencio Tossou , Basile Dura , Francois Laviolette , Mario Marchand , Alexandre Lacoste

A major goal of computer vision is to enable computers to interpret visual situations---abstract concepts (e.g., "a person walking a dog," "a crowd waiting for a bus," "a picnic") whose image instantiations are linked more by their common…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Anthony D. Rhodes , Max H. Quinn , Melanie Mitchell

We derive and analyze a generic, recursive algorithm for estimating all splits in a finite cluster tree as well as the corresponding clusters. We further investigate statistical properties of this generic clustering algorithm when it…

Machine Learning · Statistics 2021-11-02 Ingo Steinwart , Bharath K. Sriperumbudur , Philipp Thomann

Physics-informed neural network architectures have emerged as a powerful tool for developing flexible PDE solvers which easily assimilate data, but face challenges related to the PDE discretization underpinning them. By instead adapting a…

Numerical Analysis · Mathematics 2020-12-11 Ravi G. Patel , Indu Manickam , Nathaniel A. Trask , Mitchell A. Wood , Myoungkyu Lee , Ignacio Tomas , Eric C. Cyr