English
Related papers

Related papers: Kernel-learning parameter prediction and evaluatio…

200 papers

Structural kernels are a flexible learning paradigm that has been widely used in Natural Language Processing. However, the problem of model selection in kernel-based methods is usually overlooked. Previous approaches mostly rely on setting…

Computation and Language · Computer Science 2015-08-11 Daniel Beck , Trevor Cohn , Christian Hardmeier , Lucia Specia

The Kernel Polynomial Method (KPM) is one of the fast diagonalization methods used for simulations of quantum systems in research fields of condensed matter physics and chemistry. The algorithm has a difficulty to be parallelized on a…

Computational Physics · Physics 2011-05-30 Shixun Zhang , Shinichi Yamagiwa , Masahiko Okumura , Seiji Yunoki

We present a method for nonlinear parametric optimization based on algebraic geometry. The problem to be studied, which arises in optimal control, is to minimize a polynomial function with parameters subject to semialgebraic constraints.…

Optimization and Control · Mathematics 2007-05-23 Ioannis A. Fotiou , Philipp Rostalski , Bernd Sturmfels , Manfred Morari

Numerical solvers of Partial Differential Equations (PDEs) are of fundamental significance to science and engineering. To date, the historical reliance on legacy techniques has circumscribed possible integration of big data knowledge and…

Numerical Analysis · Mathematics 2024-08-12 Xi Han , Fei Hou , Hong Qin

This article presents a three-step framework for learning and solving partial differential equations (PDEs) using kernel methods. Given a training set consisting of pairs of noisy PDE solutions and source/boundary terms on a mesh, kernel…

Machine Learning · Statistics 2023-04-03 Da Long , Nicole Mrvaljevic , Shandian Zhe , Bamdad Hosseini

Gaussian Processes (GPs) are highly expressive, probabilistic models. A major limitation is their computational complexity. Naively, exact GP inference requires $\mathcal{O}(N^3)$ computations with $N$ denoting the number of modeled points.…

Machine Learning · Computer Science 2022-06-23 Gordian Edenhofer , Reimar H. Leike , Philipp Frank , Torsten A. Enßlin

We obtain upper bounds for the estimation error of Kernel Ridge Regression (KRR) for all non-negative regularization parameters, offering a geometric perspective on various phenomena in KRR. As applications: 1. We address the multiple…

Statistics Theory · Mathematics 2024-10-10 Georgios Gavrilopoulos , Guillaume Lecué , Zong Shang

Gaussian Processes (GPs) are known to provide accurate predictions and uncertainty estimates even with small amounts of labeled data by capturing similarity between data points through their kernel function. However traditional GP kernels…

Machine Learning · Computer Science 2021-11-16 Ankur Mallick , Chaitanya Dwivedi , Bhavya Kailkhura , Gauri Joshi , T. Yong-Jin Han

We utilize connections between molecular coarse-graining approaches and implicit generative models in machine learning to describe a new framework for systematic molecular coarse-graining (CG). Focus is placed on the formalism encompassing…

Chemical Physics · Physics 2020-09-11 Aleksander E. P. Durumeric , Gregory A. Voth

Choosing the most adequate kernel is crucial in many Machine Learning applications. Gaussian Process is a state-of-the-art technique for regression and classification that heavily relies on a kernel function. However, in the Gaussian…

Machine Learning · Computer Science 2019-10-15 Ibai Roman , Roberto Santana , Alexander Mendiburu , Jose A. Lozano

Restarted GMRES is a robust and widely used iterative solver for linear systems. The control of the restart parameter is a key task to accelerate convergence and to prevent the well-known stagnation phenomenon. We focus on the…

Numerical Analysis · Mathematics 2026-02-19 Lennart Duvenbeck , Cedric Riethmüller , Christian Rohde

This paper proposes a new gradient-based optimization approach for designing optimal feedback kernels for parabolic distributed parameter systems with boundary control. Unlike traditional kernel optimization methods for parabolic systems,…

Optimization and Control · Mathematics 2016-03-16 Zhigang Ren , Chao Xu , Qun Lin , Ryan Loxton

This paper conducts a comprehensive study of the learning curves of kernel ridge regression (KRR) under minimal assumptions. Our contributions are three-fold: 1) we analyze the role of key properties of the kernel, such as its spectral…

Machine Learning · Computer Science 2024-10-24 Tin Sum Cheng , Aurelien Lucchi , Anastasis Kratsios , David Belius

Machine learning (ML) entered the field of computational micromagnetics only recently. The main objective of these new approaches is the automatization of solutions of parameter-dependent problems in micromagnetism such as fast response…

Computational Physics · Physics 2021-07-15 Sebastian Schaffer , Norbert J. Mauser , Thomas Schrefl , Dieter Suess , Lukas Exl

This paper presents a learnable solver tailored to iteratively solve sparse linear systems from discretized partial differential equations (PDEs). Unlike traditional approaches relying on specialized expertise, our solver streamlines the…

Numerical Analysis · Mathematics 2024-05-10 Yan Xie , Minrui Lv , Chensong Zhang

This paper introduces an active learning framework for manifold Gaussian Process (GP) regression, combining manifold learning with strategic data selection to improve accuracy in high-dimensional spaces. Our method jointly optimizes a…

Machine Learning · Statistics 2026-05-12 Yuanxing Cheng , Lulu Kang , Yiwei Wang , Chun Liu

Gaussian Process Regression is a well-known machine learning technique for which several quantum algorithms have been proposed. We show here that in a wide range of scenarios these algorithms show no exponential speedup. We achieve this by…

Quantum Physics · Physics 2025-07-04 Dominic Lowe , M. S. Kim , Roberto Bondesan

In this paper, we develop a new parallel auxiliary grid algebraic multigrid (AMG) method to leverage the power of graphic processing units (GPUs). In the construction of the hierarchical coarse grid, we use a simple and fixed coarsening…

Numerical Analysis · Mathematics 2012-12-07 Lu Wang , Xiaozhe Hu , Jonathan Cohen , Jinchao Xu

Learning to generate neural network parameters conditioned on task descriptions and architecture specifications is pivotal for advancing model adaptability and transfer learning. Existing methods especially those based on diffusion models…

Machine Learning · Computer Science 2025-04-04 Soro Bedionita , Bruno Andreis , Song Chong , Sung Ju Hwang

Models of gravitational waveforms play a critical role in detecting and characterizing the gravitational waves (GWs) from compact binary coalescences. Waveforms from numerical relativity (NR), while highly accurate, are too computationally…

High Energy Astrophysical Phenomena · Physics 2018-01-03 Zoheyr Doctor , Ben Farr , Daniel E. Holz , Michael Pürrer