English
Related papers

Related papers: Understanding Machine-learned Density Functionals

200 papers

The use of machine learning (ML) algorithms in molecular simulations has become commonplace in recent years. There now exists, for instance, a multitude of ML force field algorithms that have enabled simulations approaching ab initio level…

Chemical Physics · Physics 2025-04-17 Jakub K. Sowa , Peter J. Rossky

We present a novel kernel-based machine learning algorithm for identifying the low-dimensional geometry of the effective dynamics of high-dimensional multiscale stochastic systems. Recently, the authors developed a mathematical framework…

Dynamical Systems · Mathematics 2020-02-04 Andreas Bittracher , Stefan Klus , Boumediene Hamzi , Péter Koltai , Christof Schütte

Within the context of studies for novel measurement solutions for future particle physics experiments, we developed a performant kNN-based regressor to infer the energy of highly-relativistic muons from the pattern of their radiation losses…

High Energy Physics - Experiment · Physics 2022-03-08 T. Dorigo , Sofia Guglielmini , Jan Kieseler , Lukas Layer , Giles C. Strong

We present a Kernel Ridge Regression (KRR) based supervised learning method combined with Genetic Algorithms (GAs) for the calculation of quasiparticle energies within Many-Body Green's Functions Theory. These energies representing…

Computational Physics · Physics 2020-12-04 Gianluca Tirimbó , Onur Çaylak , Björn Baumeier

In this paper, we establish minimax optimal rates of convergence for prediction in a semi-functional linear model that consists of a functional component and a less smooth nonparametric component. Our results reveal that the smoother…

Statistics Theory · Mathematics 2021-11-01 Keli Guo , Jun Fan , Lixing Zhu

A common challenge in nonparametric inference is its high computational complexity when data volume is large. In this paper, we develop computationally efficient nonparametric testing by employing a random projection strategy. In the…

Statistics Theory · Mathematics 2018-02-20 Meimei Liu , Zuofeng Shang , Guang Cheng

In this paper, we investigate a divide and conquer approach to Kernel Ridge Regression (KRR). Given n samples, the division step involves separating the points based on some underlying disjoint partition of the input space (possibly via…

Machine Learning · Statistics 2016-08-08 Rashish Tandon , Si Si , Pradeep Ravikumar , Inderjit Dhillon

This paper studies the linear convergence of the subspace constrained mean shift (SCMS) algorithm, a well-known algorithm for identifying a density ridge defined by a kernel density estimator. By arguing that the SCMS algorithm is a special…

Machine Learning · Statistics 2025-05-13 Yikun Zhang , Yen-Chi Chen

We present a machine learning (ML) framework for predicting Green's functions of molecular systems, from which photoemission spectra and quasiparticle energies at quantum many-body level can be obtained. Kernel ridge regression is adopted…

Chemical Physics · Physics 2023-12-05 Christian Venturella , Christopher Hillenbrand , Jiachen Li , Tianyu Zhu

Tree ensembles such as random forests (RFs) and gradient boosting machines (GBMs) are among the most widely used supervised learners, yet their theoretical properties remain incompletely understood. We adopt a spectral perspective on these…

Machine Learning · Statistics 2026-05-13 Binh Duc Vu , David S. Watson

We consider multi-agent stochastic optimization problems over reproducing kernel Hilbert spaces (RKHS). In this setting, a network of interconnected agents aims to learn decision functions, i.e., nonlinear statistical models, that are…

Optimization and Control · Mathematics 2018-07-04 Alec Koppel , Santiago Paternain , Cedric Richard , Alejandro Ribeiro

Compositional disorder is common in crystal compounds. In these compounds, some atoms are randomly distributed at some crystallographic sites. For such compounds, randomness forms many non-identical independent structures. Thus, calculating…

Materials Science · Physics 2022-12-23 Mostafa Yaghoobi , Mojtaba Alaei

The one-body reduced density matrix (1-RDM) of a many-body system at zero temperature gives direct access to many observables, such as the charge density, kinetic energy and occupation numbers. It would be desirable to express it as a…

Computational Physics · Physics 2021-01-27 Jack Wetherell , Andrea Costamagna , Matteo Gatti , Lucia Reining

In this paper, we analyze the spatial information of deep features, and propose two complementary regressions for robust visual tracking. First, we propose a kernelized ridge regression model wherein the kernel value is defined as the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-25 Chong Sun , Dong Wang , Huchuan Lu , Ming-Hsuan Yang

It is well known that kernel ridge regression (KRR) is a popular nonparametric regression estimator. Nonetheless, in the presence of a large data set with size $n\gg 1,$ the KRR estimator has the drawback to require an intensive…

Statistics Theory · Mathematics 2023-01-19 Asma Ben Saber , Abderrazek Karoui

In this paper, we propose a random projection approach to estimate variance in kernel ridge regression. Our approach leads to a consistent estimator of the true variance, while being computationally more efficient. Our variance estimator is…

Statistics Theory · Mathematics 2018-09-18 Meimei Liu , Jean Honorio , Guang Cheng

Understanding the spectral properties of kernels offers a principled perspective on generalization and representation quality. While deep models achieve state-of-the-art accuracy in molecular property prediction, kernel methods remain…

Machine Learning · Computer Science 2025-10-17 Asma Jamali , Tin Sum Cheng , Rodrigo A. Vargas-Hernández

Kernel Ridge Regression (KRR) is a simple yet powerful technique for non-parametric regression whose computation amounts to solving a linear system. This system is usually dense and highly ill-conditioned. In addition, the dimensions of the…

Numerical Analysis · Computer Science 2017-07-18 Haim Avron , Kenneth L. Clarkson , David P. Woodruff

This paper focuses on learning rate analysis of distributed kernel ridge regression for strong mixing sequences. Using a recently developed integral operator approach and a classical covariance inequality for Banach-valued strong mixing…

Machine Learning · Computer Science 2021-11-05 Zirui Sun , Shao-Bo Lin

Conventional seismic techniques for detecting the subsurface geologic features are challenged by limited data coverage, computational inefficiency, and subjective human factors. We developed a novel data-driven geological feature detection…

Machine Learning · Computer Science 2018-09-26 Youzuo Lin , Shusen Wang , Jayaraman Thiagarajan , George Guthrie , David Coblentz