English
Related papers

Related papers: Understanding Machine-learned Density Functionals

200 papers

Approximations based on random Fourier features have recently emerged as an efficient and formally consistent methodology to design large-scale kernel machines. By expressing the kernel as a Fourier expansion, features are generated based…

Computer Vision and Pattern Recognition · Computer Science 2012-03-08 Eduard Gabriel Băzăvan , Fuxin Li , Cristian Sminchisescu

This tutorial provides a gentle introduction to kernel density estimation (KDE) and recent advances regarding confidence bands and geometric/topological features. We begin with a discussion of basic properties of KDE: the convergence rate…

Methodology · Statistics 2017-09-13 Yen-Chi Chen

We review machine learning methods employing positive definite kernels. These methods formulate learning and estimation problems in a reproducing kernel Hilbert space (RKHS) of functions defined on the data domain, expanded in terms of a…

Statistics Theory · Mathematics 2009-09-29 Thomas Hofmann , Bernhard Schölkopf , Alexander J. Smola

We propose a specialized string kernel for small bio-molecules, peptides and pseudo-sequences of binding interfaces. The kernel incorporates physico-chemical properties of amino acids and elegantly generalize eight kernels, such as the…

Quantitative Methods · Quantitative Biology 2014-01-29 Sébastien Giguère , Mario Marchand , François Laviolette , Alexandre Drouin , Jacques Corbeil

In this paper, we consider the coefficient-based regularized distribution regression which aims to regress from probability measures to real-valued responses over a reproducing kernel Hilbert space (RKHS), where the regularization is put on…

Machine Learning · Statistics 2022-08-29 Yuan Mao , Lei Shi , Zheng-Chu Guo

The purpose of this paper is to answer a few open questions in the interface of kernel methods and PDE gradient flows. Motivated by recent advances in machine learning, particularly in generative modeling and sampling, we present a rigorous…

Machine Learning · Statistics 2024-10-29 Jia-Jie Zhu , Alexander Mielke

The landscape of low-energy effective field theories stemming from string theory is too vast for a systematic exploration. However, the meadows of the string landscape may be fertile ground for the application of machine learning…

High Energy Physics - Theory · Physics 2024-03-07 Stefano Lanza

Improvement of statistical learning models in order to increase efficiency in solving classification or regression problems is still a goal pursued by the scientific community. In this way, the support vector machine model is one of the…

Machine Learning · Statistics 2019-11-22 Anderson Ara , Mateus Maia , Samuel Macêdo , Francisco Louzada

We propose a strategy for land use classification which exploits Multiple Kernel Learning (MKL) to automatically determine a suitable combination of a set of features without requiring any heuristic knowledge about the classification task.…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Claudio Cusano , Paolo Napoletano , Raimondo Schettini

In finite mixture models, apart from underlying mixing measure, true kernel density function of each subpopulation in the data is, in many scenarios, unknown. Perhaps the most popular approach is to choose some kernel functions that we…

Statistics Theory · Mathematics 2017-09-26 Nhat Ho , XuanLong Nguyen , Ya'acov Ritov

In real applications of Reinforcement Learning (RL), such as robotics, low latency and energy efficient inference is very desired. The use of sparsity and pruning for optimizing Neural Network inference, and particularly to improve energy…

Machine Learning · Computer Science 2024-05-14 Dmitry A. Ivanov , Denis A. Larionov , Oleg V. Maslennikov , Vladimir V. Voevodin

Learning can be seen as approximating an unknown function by interpolating the training data. Kriging offers a solution to this problem based on the prior specification of a kernel. We explore a numerical approximation approach to kernel…

Machine Learning · Statistics 2019-05-01 Houman Owhadi , Gene Ryan Yoo

In this chapter, we discuss recent advances and new opportunities through methods of machine learning for the field of classical density functional theory, dealing with the equilibrium properties of thermal nano- and micro-particle systems…

Statistical Mechanics · Physics 2024-06-12 Alessandro Simon , Martin Oettel

In this paper, we consider the problem of designing a training set using the most informative molecules from a specified library to build data-driven molecular property models. Specifically, we use (i) sparse generalized group additivity…

Data Analysis, Statistics and Probability · Physics 2019-06-26 Bowen Li , Srinivas Rangarajan

This paper introduces a new and effective algorithm for learning kernels in a Multi-Task Learning (MTL) setting. Although, we consider a MTL scenario here, our approach can be easily applied to standard single task learning, as well. As…

Machine Learning · Computer Science 2017-07-13 Niloofar Yousefi , Cong Li , Mansooreh Mollaghasemi , Georgios Anagnostopoulos , Michael Georgiopoulos

Kernel ridge regression (KRR) is a foundational tool in machine learning, with recent work emphasizing its connections to neural networks. However, existing theory primarily addresses the i.i.d. setting, while real-world data often exhibits…

Machine Learning · Statistics 2025-10-20 Dechen Zhang , Zhenmei Shi , Yi Zhang , Yingyu Liang , Difan Zou

The saturation effects, which originally refer to the fact that kernel ridge regression (KRR) fails to achieve the information-theoretical lower bound when the regression function is over-smooth, have been observed for almost 20 years and…

Machine Learning · Statistics 2025-03-04 Weihao Lu , Haobo Zhang , Yicheng Li , Qian Lin

We consider the task of robust non-linear regression in the presence of both inlier noise and outliers. Assuming that the unknown non-linear function belongs to a Reproducing Kernel Hilbert Space (RKHS), our goal is to estimate the set of…

Machine Learning · Computer Science 2017-08-02 George Papageorgiou , Pantelis Bouboulis , Sergios Theodoridis

We propose a new method for feature learning and function estimation in supervised learning via regularised empirical risk minimisation. Our approach considers functions as expectations of Sobolev functions over all possible one-dimensional…

Machine Learning · Statistics 2025-05-01 Bertille Follain , Francis Bach

To accelerate kernel methods, we propose a near input sparsity time algorithm for sampling the high-dimensional feature space implicitly defined by a kernel transformation. Our main contribution is an importance sampling method for…

Data Structures and Algorithms · Computer Science 2020-07-15 David P. Woodruff , Amir Zandieh